00000100:00100000:1.0:1789395113.555362:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:1.0:1789395113.555592:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239537792 00000100:00100000:1.0:1789395113.555597:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239537792 00000100:00100000:1.0:1789395113.555631:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1789395113.555638:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6512:x1876316239537792:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395113.555701:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6512:x1876316239537792:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.555708:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1789395113.555994:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1789395113.556002:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6512:x1876316239537920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395113.556050:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6512:x1876316239537920:12345-0@lo:1000:mdt00_001.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.556056:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1789395113.564296:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239538176 00000100:00100000:1.0:1789395113.564304:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239538176 00000100:00100000:1.0:1789395113.564357:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1789395113.564368:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239538176:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395113.565139:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7455:x1876316239538176:12345-0@lo:1000:osp_up0-1.0 Request processed in 772us (1090us total) trans 4294983388 rc 0/0 00000100:00100000:1.0:1789395113.565147:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00010000:00010000:1.0:1789395113.571578:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395113.571589:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3168fce lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3168fd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.571600:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395113.571606:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3168fce lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3168fd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395113.571618:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3168fce lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3168fd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.571649:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3168fce lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3168fd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.571655:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395113.571683:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3168fce lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3168fd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.571690:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3168fce lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3168fd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.571708:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395113.571710:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395113.571711:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395113.571909:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239538432 00000100:00100000:1.0:1789395113.571925:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239538432 00000100:00100000:1.0:1789395113.571968:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1789395113.571975:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fbd43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3637:x1876316239538432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.571986:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.572001:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af3168fd5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3168fce expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.572012:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:1.0:1789395113.572018:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.572161:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fbd43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3637:x1876316239538432:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.572169:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1789395113.614810:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231651840 00000100:00100000:1.0:1789395113.614820:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231651840 00010000:00010000:1.0:1789395113.620166:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620174:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620181:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620187:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395113.620191:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620199:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620210:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1504:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:1.0:1789395113.620213:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395113.620216:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620223:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3168f03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620237:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620315:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620322:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620327:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395113.620330:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620337:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620344:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc0:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:1.0:1789395113.620346:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395113.620349:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.620355:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af3168f0a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.637530:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239539072:0@lo:104: 00010000:00010000:1.0:1789395113.637553:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.637950:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239539200 00000100:00100000:1.0:1789395113.637954:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239539200 00010000:00010000:1.0:1789395113.637975:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3168fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3168ff8 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.638004:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1789395113.638010:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3637:x1876316239539200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.638023:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.645057:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3168fff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3168ff8 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.645078:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:1.0:1789395113.645084:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.645093:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.645109:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169045 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.645147:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.645230:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239539200:12345-0@lo:103:ldlm_bl.0 Request processed in 7217us (7348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.645239:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000004:00080000:1.0:1789395113.645765:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 692 rpc_version 692 00000020:00100000:1.0:1789395113.645793:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395113.645802:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f2d80 x1876316239539456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395113.645821:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239539456:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395113.645861:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.645891:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.652056:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239539584 00000100:00100000:1.0:1789395113.652063:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239539584 00000100:00100000:1.0:1789395113.652119:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789395113.652127:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239539584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395113.652174:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239539584:12345-0@lo:400:kworker.0 Request processed in 48us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.652183:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789395113.652221:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239539968 00000100:00100000:1.0:1789395113.652227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239539968 00000100:00100000:1.0:1789395113.652257:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1789395113.652267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239540096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395113.652303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239540096:12345-0@lo:400:kworker.0 Request processed in 38us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.652310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1789395113.652326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1789395113.652336:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239539968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395113.652366:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239539968:12345-0@lo:400:kworker.0 Request processed in 34us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.652371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1789395113.652380:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1789395113.652404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239540480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395113.652436:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239540480:12345-0@lo:400:kworker.0 Request processed in 50us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.652445:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1789395113.652827:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239540352 00000100:00100000:1.0:1789395113.652832:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239540352 00000100:00100000:1.0:1789395113.662199:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789395113.662208:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239540352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395113.662264:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239540352:12345-0@lo:400:kworker.0 Request processed in 57us (9515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.662271:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789395113.662314:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239540352:0@lo:400:kworker.0 00000100:00100000:1.0:1789395113.666296:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231652736 00000100:00100000:1.0:1789395113.666306:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231652736 00010000:00010000:1.0:1789395113.666342:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169037 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105958 expref: 11 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.666381:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1463 00000100:00100000:1.0:1789395113.666409:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231652736:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.666423:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.666430:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169037 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105958 expref: 11 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.666443:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105958 expref: 11 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.666463:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff89a3ca2fbc00) 00010000:00010000:1.0:1789395113.666468:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316907d lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.666486:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316907d lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.666494:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316907d lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.666513:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.666561:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231652736:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.666569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1463 00000100:00100000:1.0:1789395113.681560:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395113.688701:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239542144 00000100:00100000:1.0:1789395113.688713:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239542144 00000004:00080000:1.0:1789395113.699638:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 691 rpc_version 691 00000020:00100000:1.0:1789395113.699674:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395113.699683:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f1880 x1876316239542400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395113.699706:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239542400:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395113.699765:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.699797:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.700856:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239542400:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395113.702656:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395113.702830:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239542656 00000100:00100000:1.0:1789395113.702837:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239542656 00000100:00100000:1.0:1789395113.702879:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239542528 00000100:00100000:1.0:1789395113.702881:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239542528 00000100:00100000:1.0:1789395113.702901:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1789395113.702912:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3637:x1876316239542656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.702924:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.702942:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169053 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316904c expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.702958:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b800) 00010000:00010000:1.0:1789395113.703117:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.703156:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3637:x1876316239542656:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.703166:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1789395113.703208:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239542656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395113.703295:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239542528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.714541:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395113.726935:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395113.741128:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239542912 00000100:00100000:1.0:1789395113.741134:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239542912 00000100:00100000:1.0:1789395113.741184:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:1.0:1789395113.741195:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c1b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6511:x1876316239542912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395113.741291:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c1b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6511:x1876316239542912:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.741298:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:1.0:1789395113.751684:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231653504 00000100:00100000:1.0:1789395113.751693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231653504 00010000:00010000:1.0:1789395113.751732:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3168fc7 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105943 expref: 10 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.751803:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1465 00000100:00100000:1.0:1789395113.751812:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231653504:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.751826:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.751832:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3168fc7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105943 expref: 10 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.751844:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3168fc7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105943 expref: 10 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752030:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3168fc7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105943 expref: 10 pid: 10512 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752048:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d800) 00010000:00010000:1.0:1789395113.752053:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31690bc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31690b5 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752063:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31690bc lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af31690b5 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752070:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31690bc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af31690b5 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752113:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31690bc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31690b5 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.752125:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239543424:0@lo:105: 00000100:00100000:1.0:1789395113.752174:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.752211:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.752602:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239543424:0@lo:105: 00010000:00010000:1.0:1789395113.752615:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.752652:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231653504:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 840us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.752659:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1465 00010000:00010000:1.0:1789395113.752677:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345a00/0xff35729af31690b5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31690bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752690:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345a00/0xff35729af31690b5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31690bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395113.752707:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395113.752738:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752746:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.752754:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.752768:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239543552:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1789395113.752794:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.752812:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.752824:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239543552 00000100:00100000:1.0:1789395113.752827:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239543552 00000100:00100000:1.0:1789395113.752852:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1789395113.752858:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6511:x1876316239543552:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395113.752872:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395113.752886:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31690ca lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31690c3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.753038:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31690ca lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31690c3 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.753050:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31690ca lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31690c3 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.753058:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb994c874 (ffff89a4c8e8d900) 00010000:00010000:1.0:1789395113.753061:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395113.753063:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417400, rc 0) 00000100:00100000:1.0:1789395113.753093:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6511:x1876316239543552:12345-0@lo:101:mdt00_000.0 Request processed in 235us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.753109:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1789395113.753220:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239543552:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395113.753231:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.753240:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395113.753250:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395113.753279:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239543680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395113.753303:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.753318:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.754814:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239543680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395113.754879:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239543808:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395113.755129:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.755189:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.758677:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239544192 00000100:00100000:1.0:1789395113.758682:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239544192 00000100:00100000:1.0:1789395113.758738:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1789395113.758745:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6511:x1876316239544192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395113.758820:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6511:x1876316239544192:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.758826:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000004:00080000:1.0:1789395113.767124:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 693 rpc_version 693 00000020:00100000:1.0:1789395113.767231:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395113.767241:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f1180 x1876316239544576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395113.767263:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239544576:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395113.767329:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.767360:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.768753:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239544576:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395113.769754:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239544704 00000100:00100000:1.0:1789395113.769761:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239544704 00000100:00100000:1.0:1789395113.769799:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:1.0:1789395113.769807:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6511:x1876316239544704:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395113.769824:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395113.769840:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af31690e6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31690df expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.769860:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af31690e6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31690df expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.769873:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af31690e6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31690df expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.769881:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc1:0x0].0x0 (ffff89a4c8e8db00) 00010000:00010000:1.0:1789395113.769885:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395113.769889:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416c00, rc 0) 00000100:00100000:1.0:1789395113.769927:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6511:x1876316239544704:12345-0@lo:101:mdt00_000.0 Request processed in 121us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.769933:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000004:00200000:0.0:1789395113.770201:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1506:0x0]: returning size 4096 00000004:00080000:0.0:1789395113.770209:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395113.770217:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345a00/0xff35729af31690b5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31690bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.770223:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345a00/0xff35729af31690b5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31690bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.770230:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345a00/0xff35729af31690b5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31690bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.770254:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395113.770259:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395113.770264:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.770271:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395113.770346:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3d8c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17498:x1876316231653376:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 29449us (29614us total) trans 4294983390 rc 0/0 00000100:00100000:0.0:1789395113.770358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23221 00000100:00100000:0.0:1789395113.847753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395113.848508:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239544960 00000100:00100000:1.0:1789395113.848513:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239544960 00000100:00100000:1.0:1789395113.848546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1789395113.848554:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239544960:12345-0@lo:104: 00010000:00010000:1.0:1789395113.848566:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.848616:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395113.848622:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239544960:12345-0@lo:104: Request processed in 70us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.848629:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00010000:00010000:1.0:1789395113.848648:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395113.848654:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.848662:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395113.848667:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395113.848675:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.848701:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.848708:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395113.848725:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.848733:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417200/0xff35729af31690c3 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31690ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.848750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395113.848752:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395113.848753:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395113.848763:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239545088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395113.848804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.848838:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239545088 00000100:00100000:1.0:1789395113.848842:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239545088 00010000:00010000:1.0:1789395113.848857:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31690ca lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af31690c3 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.848879:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1789395113.848886:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3636:x1876316239545088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395113.848908:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.852449:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316905a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169061 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395113.852477:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316905a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169061 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.852519:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316905a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169061 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.852527:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395113.852716:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316905a lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169061 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395113.852735:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968356 is committed 00000001:00080000:1.0:1789395113.852750:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968355 is committed 00000020:00080000:1.0:1789395113.852758:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 360 batchid updated 00000020:00080000:1.0:1789395113.852780:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca34f3c0 refcount 2 committed 0 result 0 batchid 361 00000100:00100000:0.0:1789395113.852785:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239545216 00000020:00080000:1.0:1789395113.852786:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009c5700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca34f900 00000020:00080000:1.0:1789395113.852790:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].362 00000020:00080000:1.0:1789395113.852792:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009c5100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a4fefc8e00 00000020:00080000:1.0:1789395113.852795:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].362 00000100:00100000:0.0:1789395113.852804:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239545216 00010000:00010000:1.0:1789395113.852836:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.852847:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.852855:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395113.852859:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00010000:00010000:1.0:1789395113.852867:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395113.852874:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395113.852874:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3637:x1876316239545216:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1789395113.852887:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.852891:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.852900:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x176:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:1.0:1789395113.852905:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395113.853025:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169061 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316905a expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.853039:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee50ff8a (ffff89a3c9b1b200) 00010000:00010000:0.0:1789395113.853046:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395113.853083:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853093:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3168fea lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853120:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853126:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853132:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853137:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395113.853140:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853146:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853155:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff89a3ca2fbc00) 00010000:00010000:1.0:1789395113.853158:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395113.853161:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853168:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de000/0xff35729af3168ff1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789395113.853192:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 361 committed batchid 360 00080000:02000000:1.0:1789395113.853211:0:7463:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:1.0:1789395113.853280:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c9b9c9c0 with version 692 00000020:00080000:1.0:1789395113.853292:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 360 cancel update log [0x200000401:0x3:0x0].361: rc = 0 00000020:00080000:1.0:1789395113.853363:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 360 cancel update log [0x240000400:0x3:0x0].361: rc = 0 00000020:00080000:1.0:1789395113.853374:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 361 committed batchid 360 00010000:00010000:1.0:1789395113.853455:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31690ca lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af31690c3 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853480:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb994c874 (ffff89a4c8e8d900) 00010000:00010000:1.0:1789395113.853485:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31690fb lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853494:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31690fb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853502:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31690fb lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.853527:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.853721:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239545088:12345-0@lo:103:ldlm_bl.0 Request processed in 4834us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.853729:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000004:00080000:1.0:1789395113.853754:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 692 rpc_version 692 00000020:00100000:1.0:1789395113.853833:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395113.853841:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f3480 x1876316239545472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395113.853864:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239545472:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395113.853903:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.854003:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.854046:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239545088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395113.857015:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1876316239545216:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 4136us (4354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395113.857030:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1789395113.857078:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239545472 00000100:00100000:0.0:1789395113.857085:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239545472 00000100:00100000:0.0:1789395113.857138:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1789395113.857147:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7455:x1876316239545472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395113.857773:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239545472:12345-0@lo:1000:osp_up0-1.0 Request processed in 175us (3418us total) trans 4294983391 rc 0/0 00000100:00100000:0.0:1789395113.857785:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1789395113.857953:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239545472:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395113.863867:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231654016 00000100:00100000:0.0:1789395113.863877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231654016 00000100:00100000:0.0:1789395113.863941:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23224 00000100:00100000:0.0:1789395113.863953:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17501:x1876316231654016:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395113.863980:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395113.864000:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169109 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1506:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210597b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.864065:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.864081:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.864093:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395113.864195:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1506:0x0]: returning size 4096 00000004:00200000:0.0:1789395113.864201:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395113.864240:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169109 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1506:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210597b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.864257:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210597b expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.864265:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1506:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:0.0:1789395113.864268:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395113.864272:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015200, rc 0) 00000100:00100000:0.0:1789395113.864335:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17501:x1876316231654016:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 384us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395113.864342:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23224 00000100:00100000:0.0:1789395113.875410:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395113.887358:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000020:00080000:1.0:1789395113.901693:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 361 00000004:00080000:1.0:1789395113.901749:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c9b9c600 with version 693 00000020:00080000:1.0:1789395113.901761:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 361 cancel update log [0x200000401:0x3:0x0].362: rc = 0 00000020:00080000:1.0:1789395113.901828:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 361 cancel update log [0x240000400:0x3:0x0].362: rc = 0 00000020:00080000:1.0:1789395113.901836:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 361 00000004:00080000:1.0:1789395113.901844:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 693 rpc_version 693 00000020:00100000:1.0:1789395113.901873:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395113.901883:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f0700 x1876316239546112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395113.901905:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239546112:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395113.901944:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.901977:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395113.916872:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395113.916921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395113.917209:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231654656 00000100:00100000:1.0:1789395113.917219:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231654656 00000100:00100000:1.0:1789395113.917422:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23227 00000100:00100000:1.0:1789395113.917434:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17501:x1876316231654656:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:1.0:1789395113.917491:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.917517:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169110 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210597b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.917533:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1506:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:1.0:1789395113.917538:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395113.917589:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.917598:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.917613:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.917634:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546240:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395113.917682:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.918083:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.918117:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231654400 00000100:00100000:1.0:1789395113.918122:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231654400 00000100:00100000:1.0:1789395113.918166:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1227 00000100:00100000:1.0:1789395113.918175:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231654400:12345-192.168.203.54@tcp:103:rmdir.0 00010000:00010000:1.0:1789395113.918187:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395113.918201:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169102 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105974 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.918214:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1506:0x0].0x0 (ffff89a3c9b1b100) 00010000:00010000:1.0:1789395113.918223:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395113.918270:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231654400:12345-192.168.203.54@tcp:103:rmdir.0 Request processed in 95us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395113.918277:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1227 00000100:00100000:1.0:1789395113.919178:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968356 gen 2 00000004:00080000:1.0:1789395113.919185:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968352 committed transno 4294968356 00000020:00080000:1.0:1789395113.919191:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca349840 refcount 2 committed 0 result 0 batchid 366 00000020:00080000:1.0:1789395113.919195:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca349240 00000020:00080000:1.0:1789395113.919198:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].363 00000020:00080000:1.0:1789395113.919200:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c79b9a00 00000020:00080000:1.0:1789395113.919203:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].366 00000004:00080000:1.0:1789395113.919578:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968354 committed transno 4294968356 00000004:00080000:1.0:1789395113.919589:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968356 committed transno 4294968356 00000100:00100000:1.0:1789395113.919606:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546240:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395113.919626:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.919637:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395113.919653:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395113.920114:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af3169141 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.920123:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af3169141 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395113.920133:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af3169141 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395113.920152:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546368:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395113.920210:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395113.920298:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395113.927553:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546368:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395113.927586:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af3169141 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169148 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.927600:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af3169141 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169148 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395113.927625:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1789395113.927675:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546496:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395113.927737:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395113.927779:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395113.928175:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546496:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395113.928221:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239546624:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395113.928243:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395113.928267:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395113.952641:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395113.953216:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231654784 00000100:00100000:0.0:1789395113.953226:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231654784 00010000:00010000:0.0:1789395113.953262:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af316911e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105982 expref: 18 pid: 7813 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395113.953306:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1468 00000100:00100000:0.0:1789395113.953316:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231654784:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395113.953332:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395113.953337:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af316911e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105982 expref: 18 pid: 7813 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.953349:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af316911e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105982 expref: 18 pid: 7813 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.953373:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc1:0x0].0x0 (ffff89a4fbb8ef00) 00010000:00010000:0.0:1789395113.953377:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169164 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.953415:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169164 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.953423:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169164 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395113.953442:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395113.953490:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231654784:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 175us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395113.953498:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1468 00000100:00100000:0.0:1789395113.986825:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239547392 00000100:00100000:0.0:1789395113.986839:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239547392 00000100:00100000:0.0:1789395113.986898:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1789395113.986907:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239547392:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395113.995654:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239547392:12345-0@lo:403:mdt00_002.0 Request processed in 8739us (14953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395113.995669:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1789395114.004604:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239547776 00000100:00100000:0.0:1789395114.004611:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239547776 00000100:00100000:0.0:1789395114.004649:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1789395114.004657:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3639:x1876316239547776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.004669:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.004687:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169172 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316916b expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.004701:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc1:0x0].0x0 (ffff89a4c8e8db00) 00010000:00010000:0.0:1789395114.004709:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.004741:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239547776:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.004748:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00010000:00010000:0.0:1789395114.005474:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.014057:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239547904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.014133:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395114.014139:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.014147:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.014153:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.014162:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.014194:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.014201:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.014219:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.014226:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af3169133 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316913a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.014240:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.014241:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.014243:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.014252:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239548032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.014279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.018302:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239548032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395114.059852:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.087490:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.087948:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239548160 00000100:00100000:1.0:1789395114.087953:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239548160 00000100:00100000:1.0:1789395114.087987:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1789395114.087995:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239548160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.088064:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239548160:12345-0@lo:1000:mdt00_002.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.088072:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1789395114.088290:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239548288 00000100:00100000:1.0:1789395114.088295:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239548288 00000100:00100000:1.0:1789395114.088326:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:1.0:1789395114.088332:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239548288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.088421:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239548288:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395114.088427:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:0.0:1789395114.091503:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8435:1876316239548544:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395114.091536:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31691a3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316919c expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.091549:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b700) 00010000:00010000:0.0:1789395114.091551:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.091555:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31691a3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316919c expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.091574:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:0.0:1789395114.091625:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239548416:12345-0@lo:101:mdt00_002.0 Request processed in 2899us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.091633:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:0.0:1789395114.097537:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.097730:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231655552 00000100:00100000:1.0:1789395114.097740:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231655552 00010000:00010000:1.0:1789395114.097779:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af31690ae lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210596d expref: 17 pid: 7813 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.097819:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1470 00000100:00100000:1.0:1789395114.097830:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d0224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231655552:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.097844:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.097851:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af31690ae lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210596d expref: 17 pid: 7813 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.097865:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af31690ae lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210596d expref: 17 pid: 7813 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.097887:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af31690ae lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210596d expref: 17 pid: 7813 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.097903:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b700) 00010000:00010000:1.0:1789395114.097911:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31691a3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316919c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.097921:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31691a3 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316919c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.097930:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31691a3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316919c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.097964:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31691a3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316919c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.097977:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239548672:0@lo:105: 00000100:00100000:1.0:1789395114.098025:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.098067:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4df47cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.099809:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239548800 00000100:00100000:1.0:1789395114.099816:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239548800 00000100:00100000:1.0:1789395114.099862:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:1.0:1789395114.099871:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239548800:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.099885:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.099902:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31691b1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31691aa expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.099925:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31691b1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31691aa expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.099938:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31691b1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31691aa expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.099952:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x872f39a (ffff89a4d0654100) 00010000:00010000:1.0:1789395114.099955:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.099958:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417000, rc 0) 00000100:00100000:1.0:1789395114.100002:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239548800:12345-0@lo:101:mdt00_002.0 Request processed in 132us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.100008:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:0.0:1789395114.100108:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239548800:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.100135:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.100144:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.100158:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1789395114.100194:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239548928:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.100224:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.100250:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.100368:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239548928 00000100:00100000:1.0:1789395114.100373:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239548928 00000100:00100000:1.0:1789395114.100433:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1789395114.100441:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239548928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.100516:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239548928:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.100523:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:0.0:1789395114.100751:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239548928:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.100791:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239549056:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.100816:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.100839:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.100885:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239549056 00000100:00100000:1.0:1789395114.100890:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239549056 00000100:00100000:1.0:1789395114.100918:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1789395114.100924:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.100989:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549056:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395114.100996:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:0.0:1789395114.101079:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239549056:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.101232:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239549184:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.101256:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.101277:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.101323:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239549184 00000100:00100000:1.0:1789395114.101327:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239549184 00000100:00100000:1.0:1789395114.101358:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1789395114.101365:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.101864:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549184:12345-0@lo:1000:mdt00_002.0 Request processed in 498us (606us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395114.101872:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:0.0:1789395114.102030:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239549184:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.102083:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239549312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.102194:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.102249:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.106370:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239549440 00000100:00100000:1.0:1789395114.106378:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239549440 00000100:00100000:1.0:1789395114.106451:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1789395114.106460:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.106578:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549440:12345-0@lo:1000:mdt00_002.0 Request processed in 119us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.106586:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1789395114.107378:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239549568 00000100:00100000:1.0:1789395114.107408:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239549568 00000100:00100000:1.0:1789395114.107444:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1789395114.107451:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.107691:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239549568:12345-0@lo:1000:mdt00_002.0 Request processed in 239us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.107699:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000004:00080000:1.0:1789395114.118134:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 694 rpc_version 694 00000020:00100000:1.0:1789395114.118195:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395114.118206:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f2680 x1876316239549824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395114.118231:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239549824:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.118308:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.118348:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4df47cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.119665:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239549824:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.121612:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239549952 00000100:00100000:1.0:1789395114.121620:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239549952 00000100:00100000:1.0:1789395114.121666:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1789395114.121677:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6513:x1876316239549952:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.121697:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.121715:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31691cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31691c6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121739:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31691cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31691c6 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121751:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31691cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31691c6 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121758:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbf:0x0].0x0 (ffff89a4d0654400) 00010000:00010000:1.0:1789395114.121761:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.121764:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416e00, rc 0) 00000100:00100000:1.0:1789395114.121812:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:6513:x1876316239549952:12345-0@lo:101:mdt00_002.0 Request processed in 137us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.121818:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1789395114.121855:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239549952:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.121871:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af31691c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31691cd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121881:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af31691c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31691cd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395114.121902:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f6b20ff reply state 00000000e71ddbc7 transno 4294968358 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121914:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121921:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbf:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:1.0:1789395114.121923:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395114.121926:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395114.121931:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af31691c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31691cd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121939:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af31691c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31691cd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.121950:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xbf:0x0] 00000004:00010000:1.0:1789395114.121956:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f6b20ff reply state 00000000e71ddbc7 transno 4294968358 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121964:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.121970:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a3ca2fb200) 00010000:00010000:1.0:1789395114.121972:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395114.121974:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1789395114.121979:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x178:0x0]: returning size 4096 00000004:00080000:1.0:1789395114.121987:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395114.121996:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dec00/0xff35729af316919c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31691a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.122002:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dec00/0xff35729af316919c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31691a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.122009:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dec00/0xff35729af316919c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31691a3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.122029:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395114.122034:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395114.122038:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.122045:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.122256:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17510:x1876316231655424:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 34579us (34774us total) trans 4294968358 rc 0/0 00000100:00100000:1.0:1789395114.122264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23230 00000100:00100000:0.0:1789395114.147430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.160418:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231655936 00000100:00100000:0.0:1789395114.160428:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231655936 00000100:00100000:0.0:1789395114.160498:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23232 00000100:00100000:0.0:1789395114.160508:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17512:x1876316231655936:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395114.160529:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.160552:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31691d4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210599e expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160679:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160694:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160703:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160714:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160728:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31691b1 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31691aa expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160737:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.160770:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31691b1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af31691aa expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.160783:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239550208:0@lo:104: 00000100:00100000:0.0:1789395114.160829:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.161331:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.161601:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239550592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395114.161631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.161651:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395114.161657:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239550720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395114.161677:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.161858:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789395114.161867:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239550464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395114.161886:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789395114.161936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239550336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395114.161950:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395114.161957:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239550848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395114.161982:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.162326:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239550464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 460us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.162333:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789395114.162348:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789395114.162355:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239550720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789395114.162377:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395114.162433:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239550720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.162438:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789395114.162457:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239550592 00000100:00100000:1.0:1789395114.162461:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239550592 00000100:00100000:1.0:1789395114.162488:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1789395114.162494:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3636:x1876316239550592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789395114.162519:0:17997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445085184 avail 1298845696 00000100:00100000:1.0:1789395114.162550:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3636:x1876316239550592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.162556:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1789395114.162612:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1789395114.162619:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239550208:12345-0@lo:104: 00010000:00010000:1.0:1789395114.162633:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.162679:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395114.162685:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239550208:12345-0@lo:104: Request processed in 68us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.162691:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00010000:00010000:1.0:1789395114.162706:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395114.162712:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.162719:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395114.162725:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395114.162734:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.162758:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.162765:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395114.162777:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.162785:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df000/0xff35729af31691aa lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31691b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.162802:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395114.162803:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395114.162805:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395114.162809:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395114.162817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239550976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395114.162846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.162887:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239550208:0@lo:104: 00010000:00010000:1.0:1789395114.162906:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.163108:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239550464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395114.163133:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239550848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395114.165632:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239551104 00000100:00100000:0.0:1789395114.165638:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239551104 00000100:00100000:0.0:1789395114.165681:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1789395114.165689:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1876316239551104:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1789395114.165701:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.165725:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169148 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb994c874 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169141 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.165742:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb994c874 (ffff89a3ca2fb600) 00010000:00010000:0.0:1789395114.165750:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.165817:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239551104:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 128us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.165825:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00010000:00010000:0.0:1789395114.165888:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31691b1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af31691aa expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.165899:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x872f39a (ffff89a4d0654100) 00010000:00010000:0.0:1789395114.165904:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.165913:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.165925:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.165954:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.165981:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239550976:12345-0@lo:103:ldlm_bl.0 Request processed in 2780us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.165988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1789395114.166063:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239550976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.166088:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.166108:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.166197:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10512:1876316239551232:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789395114.166227:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.166284:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4df47cd80 going to sleep for 11 seconds 00000004:00080000:1.0:1789395114.166371:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 695 rpc_version 695 00000020:00100000:1.0:1789395114.166405:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395114.166412:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f6300 x1876316239551488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395114.166426:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239551488:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395114.166452:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.166565:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.166624:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239551232 00000100:00100000:0.0:1789395114.166630:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239551232 00000100:00100000:0.0:1789395114.166665:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239551488 00000100:00100000:0.0:1789395114.166668:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239551488 00000100:00100000:0.0:1789395114.166683:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1789395114.166690:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:10512:x1876316239551232:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395114.166758:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:10512:x1876316239551232:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.166765:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1789395114.166778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1789395114.166785:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239551488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395114.166874:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239551488:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (420us total) trans 4294968359 rc 0/0 00000100:00100000:0.0:1789395114.166881:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1789395114.166949:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239551488:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395114.166968:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10512:1876316239551232:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789395114.167008:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31691e9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x178:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167020:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31691e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167029:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31691e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395114.167055:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31691e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167067:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167074:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167081:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167088:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167106:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395114.167110:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167115:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167122:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4fbb8ee00) 00010000:00010000:1.0:1789395114.167124:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.167127:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167131:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af31691db lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167139:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167142:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167146:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167149:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395114.167150:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167153:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167160:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x872f39a (ffff89a4d0654100) 00010000:00010000:1.0:1789395114.167161:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.167163:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167166:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31691e2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167196:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31691d4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210599e expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167213:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31691e9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210599e expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.167221:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a4d0654e00) 00010000:00010000:1.0:1789395114.167223:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395114.167225:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416c00, rc 0) 00000100:00100000:1.0:1789395114.167274:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17512:x1876316231655936:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 6766us (7002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.167281:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23232 00000100:00100000:0.0:1789395114.170315:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.170411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231656064 00000100:00100000:1.0:1789395114.170421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231656064 00000100:00100000:1.0:1789395114.170489:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23233 00000100:00100000:1.0:1789395114.170500:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17512:x1876316231656064:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395114.170523:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.170542:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31691f0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021059a5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.170618:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31691f7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.170632:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31691f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.170643:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31691f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395114.170743:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x178:0x0]: returning size 4096 00000004:00200000:1.0:1789395114.170749:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395114.170785:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31691f0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059a5 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.170803:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31691f7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x178:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059a5 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.170811:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a3ca2fb200) 00010000:00010000:1.0:1789395114.170815:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395114.170819:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417400, rc 0) 00000100:00100000:1.0:1789395114.171168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17512:x1876316231656064:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 668us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.171176:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23233 00000100:00100000:0.0:1789395114.174842:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.179198:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231656320 00000100:00100000:1.0:1789395114.179216:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231656320 00000100:00100000:1.0:1789395114.179371:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23235 00000100:00100000:1.0:1789395114.179409:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17512:x1876316231656320:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395114.179442:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.179472:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316920c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021059b3 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.179564:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.179581:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31691cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31691c6 expref: 5 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.179590:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169213 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.179637:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31691cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af31691c6 expref: 5 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.179656:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239551616:0@lo:104: 00000100:00100000:1.0:1789395114.179727:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.179788:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.180452:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239551616:0@lo:104: 00010000:00010000:0.0:1789395114.180486:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.193637:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 696 rpc_version 696 00000020:00100000:1.0:1789395114.193676:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395114.193685:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f4a80 x1876316239552000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395114.193710:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239552000:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395114.197282:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.197351:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.199214:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239552000:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395114.201996:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231656704 00000100:00100000:1.0:1789395114.202009:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231656704 00000100:00100000:1.0:1789395114.202072:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23236 00000100:00100000:1.0:1789395114.202082:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17512:x1876316231656704:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:1.0:1789395114.202173:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.202210:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af31691f7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x178:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059a5 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.202230:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a3ca2fb200) 00010000:00010000:1.0:1789395114.202236:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395114.202304:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.202313:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.202323:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.202349:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552128:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.202462:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.202502:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.202860:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239552128 00000100:00100000:0.0:1789395114.202867:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239552128 00000100:00100000:0.0:1789395114.202918:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1789395114.202928:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:6513:x1876316239552128:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.202941:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.202964:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169221 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316921a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.202995:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169221 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316921a expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.203011:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169221 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316921a expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.203019:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4fbb8e900) 00010000:00010000:0.0:1789395114.203023:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.203026:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:0.0:1789395114.203079:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6513:x1876316239552128:12345-0@lo:101:mdt00_002.0 Request processed in 153us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.203085:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:1.0:1789395114.203722:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983394 gen 2 00000004:00080000:1.0:1789395114.203731:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983389 committed transno 4294983394 00000020:00080000:1.0:1789395114.203739:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca33ae40 refcount 2 committed 0 result 0 batchid 362 00000020:00080000:1.0:1789395114.203744:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ec00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca33ac00 00000020:00080000:1.0:1789395114.203748:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].363 00000020:00080000:1.0:1789395114.203751:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c83c3200 00000020:00080000:1.0:1789395114.203754:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].363 00000004:00080000:1.0:1789395114.203815:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983391 committed transno 4294983394 00000004:00080000:1.0:1789395114.203830:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983392 committed transno 4294983394 00000004:00080000:1.0:1789395114.203838:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983394 committed transno 4294983394 00000100:00100000:1.0:1789395114.203866:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552128:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.203901:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.203916:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.203935:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395114.203978:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.203986:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.203995:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.204016:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552256:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.204062:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.204110:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239552256 00000100:00100000:1.0:1789395114.204115:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239552256 00000100:00100000:1.0:1789395114.204171:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1789395114.204179:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6513:x1876316239552256:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.204190:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.204206:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316922f lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169228 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.204231:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316922f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169228 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.204243:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316922f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169228 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.204250:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x872f39a (ffff89a4d0654000) 00010000:00010000:1.0:1789395114.204253:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.204256:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416400, rc 0) 00000100:00100000:1.0:1789395114.204287:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239552256:12345-0@lo:101:mdt00_002.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.204294:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1789395114.204323:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.204341:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552256:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.204353:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316922f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.204364:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316922f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.204379:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1789395114.204462:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552384:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.204494:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.204516:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.204533:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239552384 00000100:00100000:1.0:1789395114.204538:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239552384 00000100:00100000:1.0:1789395114.204565:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:1.0:1789395114.204572:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239552384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.204647:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239552384:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.204656:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:1.0:1789395114.204685:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552384:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.204734:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552512:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.204769:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.204793:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239552512 00000100:00100000:1.0:1789395114.204798:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239552512 00000100:00100000:1.0:1789395114.204829:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1789395114.204838:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239552512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.204920:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239552512:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (150us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395114.204927:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1789395114.204944:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.204961:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552512:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789395114.205009:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205017:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205026:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.205038:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552640:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.205069:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.205088:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239552640 00000100:00100000:1.0:1789395114.205103:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239552640 00000100:00100000:1.0:1789395114.205130:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1789395114.205138:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239552640:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.205148:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.205164:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316923d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169236 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205184:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316923d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169236 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205195:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316923d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169236 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205204:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a4d0654200) 00010000:00010000:1.0:1789395114.205207:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395114.205209:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417e00, rc 0) 00000100:00100000:1.0:1789395114.205233:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239552640:12345-0@lo:101:mdt00_002.0 Request processed in 97us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.205239:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1789395114.205255:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.205270:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552640:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.205284:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205292:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205314:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169244 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205322:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169244 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205330:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169244 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205347:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316924b lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205358:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169205 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059ac expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205366:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316924b lrc: 4/0,1 mode: --/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205419:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059ac expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.205433:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169205 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059ac expref: 10 pid: 6512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.205443:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239552768:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395114.205640:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000020:00080000:0.0:1789395114.205895:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 362 committed batchid 361 00000020:00080000:0.0:1789395114.205973:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 361 00000100:00100000:1.0:1789395114.208375:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239552768:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395114.208441:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316924b lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213671:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316924b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213681:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316924b lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213728:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213736:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213746:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.213766:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239552896:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.213808:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.213838:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239552896 00000100:00100000:1.0:1789395114.213842:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239552896 00000100:00100000:1.0:1789395114.213890:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:1.0:1789395114.213898:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239552896:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.213913:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.213926:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169259 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169252 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213947:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169213 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059b3 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213956:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169259 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169252 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213979:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059b3 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.213992:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059b3 expref: 13 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.214003:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239553024:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395114.214051:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.214120:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.219253:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239553024:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395114.219290:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169259 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169252 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.219304:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbf:0x0].0x0 (ffff89a4d0654400) 00010000:00010000:1.0:1789395114.219307:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395114.219311:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169259 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169252 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.219321:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169259 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169252 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.219328:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417800, rc 0) 00000100:00100000:1.0:1789395114.219405:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239552896:12345-0@lo:101:mdt00_002.0 Request processed in 5487us (5575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.219413:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1789395114.220217:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239553152 00000100:00100000:0.0:1789395114.220224:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239553152 00000100:00100000:0.0:1789395114.220281:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789395114.220290:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1876316239553152:12345-0@lo:105: 00010000:00010000:0.0:1789395114.220301:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.220312:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.220321:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.220334:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.220342:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.220350:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.220380:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca417000) 00000100:00100000:0.0:1789395114.220445:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1876316239553152:12345-0@lo:105: Request processed in 156us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.220452:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1789395114.222917:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239553280 00000100:00100000:1.0:1789395114.222926:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239553280 00000100:00100000:1.0:1789395114.223005:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1789395114.223015:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239553280:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1789395114.229222:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239553280:12345-0@lo:403:mdt00_002.0 Request processed in 6201us (6393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.229236:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000004:00080000:0.0:1789395114.235974:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 695 rpc_version 695 00000020:00100000:0.0:1789395114.236018:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395114.236029:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca140e00 x1876316239553536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395114.236053:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239553536:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395114.236135:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.236169:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.238145:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239553536:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1789395114.242175:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395114.242188:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242200:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.242207:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.242217:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242258:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242264:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.242290:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242299:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af3169252 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169259 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242316:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395114.242320:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242326:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.242330:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.242342:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242356:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242361:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.242367:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416800/0xff35729af3169236 lrc: 3/0,0 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316923d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.242373:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.242375:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.242377:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.242416:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239553792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.242778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.242818:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395114.242824:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239553664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.242844:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.243125:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239553792 00000100:00100000:0.0:1789395114.243132:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239553792 00000100:00100000:0.0:1789395114.243207:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239553664 00000100:00100000:0.0:1789395114.243210:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239553664 00000100:00100000:1.0:1789395114.243672:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1789395114.243684:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3639:x1876316239553792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.243697:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.243714:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316923d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x178:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169236 expref: 11 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243727:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a4d0654200) 00010000:00010000:1.0:1789395114.243736:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.243782:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3639:x1876316239553792:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.243788:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1789395114.243802:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1789395114.243807:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3639:x1876316239553664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.243814:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.243823:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169259 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169252 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243831:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbf:0x0].0x0 (ffff89a4d0654400) 00010000:00010000:1.0:1789395114.243837:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.243864:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3639:x1876316239553664:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.243870:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00010000:00010000:1.0:1789395114.243885:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395114.243890:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243898:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395114.243903:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395114.243912:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243934:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243939:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395114.243955:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243963:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316921a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169221 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.243978:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395114.243980:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395114.243981:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395114.243986:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395114.243994:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239553920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395114.244018:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.244400:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239553920 00000100:00100000:1.0:1789395114.244406:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239553920 00000100:00100000:1.0:1789395114.244436:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1789395114.244442:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3637:x1876316239553920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.244451:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.244462:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169221 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316921a expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.244483:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4fbb8e900) 00010000:00010000:1.0:1789395114.244491:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.244516:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3637:x1876316239553920:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.244522:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1789395114.244567:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239553920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395114.271047:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.289250:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.309742:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.309801:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8436:1876316239554432:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395114.309833:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af316928a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169283 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.309848:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1b000) 00010000:00010000:1.0:1789395114.309851:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.309856:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af316928a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169283 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.309866:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345000, rc 0) 00000100:00100000:1.0:1789395114.309920:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239554304:12345-0@lo:101:mdt00_002.0 Request processed in 14349us (14478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.309929:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:1.0:1789395114.309975:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554304:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.309992:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.310003:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.312427:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239554560 00000100:00100000:1.0:1789395114.312433:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239554560 00000100:00100000:1.0:1789395114.312472:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1789395114.312479:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6496:x1876316239554560:12345-0@lo:105: 00010000:00010000:1.0:1789395114.312491:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.312503:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.312513:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.312522:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.312530:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.312544:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.312565:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3c9345400) 00010000:00010000:0.0:1789395114.312582:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.312594:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.312611:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6496:x1876316239554560:12345-0@lo:105: Request processed in 131us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.312619:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000004:00080000:0.0:1789395114.312624:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395114.312662:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.312671:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.312681:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.312696:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554688:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395114.312728:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.312758:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.312982:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239554688 00000100:00100000:1.0:1789395114.312988:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239554688 00000100:00100000:1.0:1789395114.313026:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:1.0:1789395114.313034:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239554688:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.313049:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.313064:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169291 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.313087:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169291 expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.313114:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169291 expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.313123:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xcefb0e88 (ffff89a4d0654100) 00010000:00010000:1.0:1789395114.313126:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.313129:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417800, rc 0) 00000100:00100000:1.0:1789395114.313162:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239554688:12345-0@lo:101:mdt00_002.0 Request processed in 130us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.313172:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:0.0:1789395114.314225:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554688:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.314244:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.314255:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.314272:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1789395114.314312:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554816:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.314347:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.314374:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.314432:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239554816 00000100:00100000:1.0:1789395114.314439:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239554816 00000100:00100000:1.0:1789395114.314476:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1789395114.314486:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239554816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.314557:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239554816:12345-0@lo:1000:mdt00_002.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.314566:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:0.0:1789395114.314697:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554816:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.314737:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554944:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.314764:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.314776:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.315035:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239554944:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.315111:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.315134:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.315155:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.315484:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239555072 00000100:00100000:1.0:1789395114.315489:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239555072 00000100:00100000:1.0:1789395114.315525:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1789395114.315533:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239555072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.315605:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239555072:12345-0@lo:1000:mdt00_002.0 Request processed in 72us (469us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395114.315613:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1789395114.315714:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.315768:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555200:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.315801:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.315829:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.316317:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555200:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.316366:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555328:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.316435:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.316447:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239555328 00000100:00100000:1.0:1789395114.316451:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239555328 00000100:00100000:0.0:1789395114.316451:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.316548:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:1.0:1789395114.316654:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239555328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.316770:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239555328:12345-0@lo:1000:mdt00_002.0 Request processed in 213us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.316777:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1789395114.316924:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555328:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.316966:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555456:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.316988:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.317006:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.317215:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239555456:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1789395114.318163:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].369, 2168 off564888 00000040:00080000:0.0:1789395114.318242:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].366, 2368 off613520 00000004:00080000:0.0:1789395114.318249:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca35c600 with version 697 00000100:00100000:1.0:1789395114.318840:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239555712 00000100:00100000:1.0:1789395114.318846:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239555712 00000100:00100000:1.0:1789395114.318893:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:1.0:1789395114.318901:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239555712:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395114.319458:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239555712:12345-0@lo:1000:osp_up1-0.0 Request processed in 556us (755us total) trans 4294968362 rc 0/0 00000100:00100000:1.0:1789395114.319466:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1789395114.320426:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239555840 00000100:00100000:0.0:1789395114.320432:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239555840 00000100:00100000:0.0:1789395114.320468:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:0.0:1789395114.320476:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6513:x1876316239555840:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.320490:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.320507:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af31692b4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31692ad expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.320529:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af31692b4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31692ad expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.320541:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af31692b4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31692ad expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.320549:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:0.0:1789395114.320552:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.320555:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014400, rc 0) 00000100:00100000:0.0:1789395114.320592:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6513:x1876316239555840:12345-0@lo:101:mdt00_002.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.320599:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00010000:00010000:0.0:1789395114.320903:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395114.320912:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.320920:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.320926:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.320933:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.320970:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.320978:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.321004:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.321015:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169283 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316928a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.321033:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.321035:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.321037:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.321101:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239555968 00000100:00100000:0.0:1789395114.321106:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239555968 00000100:00100000:0.0:1789395114.321147:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1789395114.321156:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+12:3637:x1876316239555968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.321167:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.321182:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af316928a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169283 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.321194:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1b000) 00010000:00010000:0.0:1789395114.321200:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.321232:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+11:3637:x1876316239555968:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.321239:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1789395114.369173:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231657984 00000100:00100000:0.0:1789395114.369185:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231657984 00000100:00100000:0.0:1789395114.369245:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23241 00000100:00100000:0.0:1789395114.369256:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17515:x1876316231657984:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395114.369275:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.369298:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af31692bb lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021059c8 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369361:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31692c2 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369375:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31692c2 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369407:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31692c2 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369419:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af31692c9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369429:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169291 expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369437:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af31692c9 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.369469:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169291 expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.369484:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239556096:0@lo:104: 00000100:00100000:0.0:1789395114.369542:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.369587:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c180 going to sleep for 11 seconds 00010000:00010000:0.0:1789395114.372825:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395114.372833:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.372842:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.372847:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.372857:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.372891:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.372898:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.372929:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.372937:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014200/0xff35729af3169291 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169298 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.372956:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.372957:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.372959:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.373005:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239556096:0@lo:104: 00010000:00010000:0.0:1789395114.373024:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af31692c9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.373291:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239556224 00000100:00100000:0.0:1789395114.373297:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239556224 00010000:00010000:0.0:1789395114.373334:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169291 expref: 11 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.373365:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1789395114.373373:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239556224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.373407:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.380230:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316922f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395114.380250:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316922f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.380294:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316922f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.380300:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395114.380344:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416000/0xff35729af3169228 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x872f39a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316922f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395114.380361:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968362 is committed 00000001:00080000:1.0:1789395114.380375:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968361 is committed 00000020:00080000:1.0:1789395114.380421:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 362 batchid updated 00000020:00080000:1.0:1789395114.380435:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca33a840 refcount 2 committed 0 result 0 batchid 363 00000020:00080000:1.0:1789395114.380439:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca33a6c0 00000020:00080000:1.0:1789395114.380442:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].364 00000020:00080000:1.0:1789395114.380444:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7bb5600 00000020:00080000:1.0:1789395114.380447:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].364 00010000:00010000:1.0:1789395114.381164:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381177:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381185:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381192:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395114.381198:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381274:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381290:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x178:0x0].0x0 (ffff89a3ca2fb200) 00010000:00010000:1.0:1789395114.381294:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.381299:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381306:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31691b8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.381324:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395114.381451:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 363 committed batchid 362 00000004:00080000:0.0:1789395114.381715:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35c180 with version 696 00000020:00080000:0.0:1789395114.381729:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 362 cancel update log [0x200000401:0x3:0x0].363: rc = 0 00000020:00080000:0.0:1789395114.381775:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 362 cancel update log [0x240000400:0x3:0x0].363: rc = 0 00000020:00080000:0.0:1789395114.381784:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 362 00000004:00080000:0.0:1789395114.381792:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 696 rpc_version 696 00000020:00100000:0.0:1789395114.381815:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395114.381824:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c98f0700 x1876316239556608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395114.381842:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239556608:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395114.382297:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382305:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382311:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395114.382315:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382327:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382339:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbf:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:1.0:1789395114.382342:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.382346:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382352:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af31691bf lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382436:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169298 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169291 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382447:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xcefb0e88 (ffff89a4d0654100) 00010000:00010000:1.0:1789395114.382452:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af31692c9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382461:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af31692c9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382473:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af31692c9 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.382553:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.382603:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239556224:12345-0@lo:103:ldlm_bl.0 Request processed in 9230us (9387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.382621:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1789395114.382639:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.382661:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.382685:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239556608 00000100:00100000:1.0:1789395114.382692:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239556608 00000100:00100000:1.0:1789395114.382726:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1789395114.382734:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7455:x1876316239556608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.382861:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239556608:12345-0@lo:1000:osp_up0-1.0 Request processed in 127us (223us total) trans 4294983397 rc 0/0 00000100:00100000:1.0:1789395114.382868:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1789395114.382945:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239556608:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395114.383326:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239556736 00000100:00100000:0.0:1789395114.383332:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239556736 00000100:00100000:0.0:1789395114.383379:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1789395114.383408:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:10512:x1876316239556736:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395114.383553:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:10512:x1876316239556736:12345-0@lo:1000:mdt00_004.0 Request processed in 145us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.383622:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1789395114.388058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.388172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231658112 00000100:00100000:1.0:1789395114.388181:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231658112 00000100:00100000:1.0:1789395114.388272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23242 00000100:00100000:1.0:1789395114.388283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17515:x1876316231658112:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395114.388308:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.388329:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af31692d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1508:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021059cf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.388453:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31692de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1508:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.388467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31692de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1508:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.388477:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31692de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1508:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395114.388588:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1508:0x0]: returning size 4096 00000004:00200000:1.0:1789395114.388594:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395114.388631:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af31692d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059cf expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.388646:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31692de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1508:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059cf expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.388661:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1508:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:1.0:1789395114.388664:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395114.388668:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416e00, rc 0) 00000100:00100000:1.0:1789395114.388720:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17515:x1876316231658112:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 439us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.388726:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23242 00000100:00100000:1.0:1789395114.396019:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.401318:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.402030:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239556864 00000100:00100000:1.0:1789395114.402036:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239556864 00000100:00100000:1.0:1789395114.402076:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1789395114.402084:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239556864:12345-0@lo:104: 00010000:00010000:1.0:1789395114.402106:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af31692ad lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31692b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.402183:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395114.402190:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239556864:12345-0@lo:104: Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.402197:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1789395114.402347:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395114.402438:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239556992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395114.402462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.402528:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239556992 00000100:00100000:0.0:1789395114.402534:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239556992 00010000:00010000:0.0:1789395114.402562:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af31692b4 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af31692ad expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.402589:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1789395114.402598:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239556992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.402609:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.409719:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af31692b4 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af31692ad expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.409738:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:1.0:1789395114.409744:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.409754:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.409762:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.409797:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.409883:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239556992:12345-0@lo:103:ldlm_bl.0 Request processed in 7284us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.409896:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1789395114.409961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239556992:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1789395114.410261:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 697 rpc_version 697 00000020:00100000:1.0:1789395114.410288:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395114.410296:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a42a00 x1876316239557248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395114.410318:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239557248:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.410361:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.410686:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.410712:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239557248:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395114.416904:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.416948:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.417006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231658752 00000100:00100000:1.0:1789395114.417018:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231658752 00000100:00100000:1.0:1789395114.417085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23245 00000100:00100000:1.0:1789395114.417238:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17515:x1876316231658752:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:1.0:1789395114.417290:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.417314:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af31692de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1508:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059cf expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.417335:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1508:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:1.0:1789395114.417340:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395114.417849:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.417858:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.417869:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.417891:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557376:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.417940:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.418016:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.418131:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239557376 00000100:00100000:0.0:1789395114.418136:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239557376 00000100:00100000:0.0:1789395114.418202:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:0.0:1789395114.418210:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c1b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6513:x1876316239557376:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.418219:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.418235:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169308 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169301 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.418258:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169308 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169301 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.418270:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169308 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169301 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.418284:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4fbb8e300) 00010000:00010000:0.0:1789395114.418287:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.418289:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015600, rc 0) 00000100:00100000:0.0:1789395114.418331:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c1b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239557376:12345-0@lo:101:mdt00_002.0 Request processed in 122us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.418337:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1789395114.418627:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968362 gen 2 00000004:00080000:1.0:1789395114.418634:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968357 committed transno 4294968362 00000020:00080000:1.0:1789395114.418640:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c8081600 refcount 2 committed 0 result 0 batchid 368 00000020:00080000:1.0:1789395114.418644:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009c5100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c8081480 00000020:00080000:1.0:1789395114.418647:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].365 00000020:00080000:1.0:1789395114.418650:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009c5f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82d3a00 00000020:00080000:1.0:1789395114.418652:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].368 00000004:00080000:1.0:1789395114.418673:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968359 committed transno 4294968362 00000004:00080000:1.0:1789395114.418684:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968360 committed transno 4294968362 00000004:00080000:1.0:1789395114.418692:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968362 committed transno 4294968362 00000100:00100000:1.0:1789395114.418710:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557376:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.418728:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.418744:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.418760:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395114.418785:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af316930f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.418792:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af316930f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.418800:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af316930f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.418814:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557504:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.418841:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.418867:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.419232:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557504:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.419245:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af316930f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169316 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.419254:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417600/0xff35729af316930f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169316 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.419266:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395114.419297:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557632:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.419323:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.419423:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.419839:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557632:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.419880:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557760:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.419904:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.420011:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.420080:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239557760 00000100:00100000:0.0:1789395114.420085:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239557760 00000100:00100000:0.0:1789395114.420115:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1789395114.420122:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239557760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.420206:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239557760:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (301us total) trans 0 rc 1/1 00000100:00100000:0.0:1789395114.420213:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:1.0:1789395114.420272:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557760:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789395114.420315:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420324:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420332:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.420344:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557888:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.420368:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.420425:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.420509:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239557888 00000100:00100000:0.0:1789395114.420514:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239557888 00000100:00100000:0.0:1789395114.420530:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:0.0:1789395114.420536:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239557888:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.420545:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.420560:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af3169324 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316931d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.420580:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af3169324 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316931d expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.420592:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af3169324 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316931d expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.420605:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1508:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:0.0:1789395114.420608:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395114.420611:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014200, rc 0) 00000100:00100000:0.0:1789395114.420649:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239557888:12345-0@lo:101:mdt00_002.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.420656:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1789395114.420723:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239557888:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.420735:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420744:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420764:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af316932b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420772:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af316932b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420780:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af316932b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420796:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169332 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420808:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31692ec lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059d6 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420815:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169332 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420836:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31692ec lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059d6 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.420850:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af31692ec lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059d6 expref: 17 pid: 6511 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.420860:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239558016:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395114.420928:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.426714:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239558016:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395114.426747:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169332 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.427112:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.428162:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239558144 00000100:00100000:0.0:1789395114.428168:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239558144 00000100:00100000:0.0:1789395114.428216:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:0.0:1789395114.428223:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239558144:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.428240:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.428254:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169339 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.428276:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 6 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.428285:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.428446:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 6 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.428461:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 6 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.428476:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79be300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8436:1876316239558272:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395114.428678:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.434009:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79be300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8436:1876316239558272:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395114.434049:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.434062:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:0.0:1789395114.434066:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395114.434071:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.434080:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.434088:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:0.0:1789395114.434161:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239558144:12345-0@lo:101:mdt00_002.0 Request processed in 5937us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.434170:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:0.0:1789395114.436876:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.437171:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231659008 00000100:00100000:1.0:1789395114.437182:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231659008 00010000:00010000:1.0:1789395114.437361:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 7 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.437674:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1479 00000100:00100000:1.0:1789395114.437686:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231659008:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.437702:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.437709:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 7 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.437722:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 7 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.437744:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af31692fa lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059dd expref: 7 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.437759:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:1.0:1789395114.437765:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.437774:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.437782:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.437813:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169340 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169339 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.437827:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239558400:0@lo:105: 00000100:00100000:1.0:1789395114.437877:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.437918:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.440439:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1789395114.440564:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239558528:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1789395114.444159:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239558528:12345-0@lo:403:mdt00_002.0 Request processed in 3703us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.444174:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000004:00080000:0.0:1789395114.447179:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 698 rpc_version 698 00000020:00100000:0.0:1789395114.447285:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395114.447296:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79bed80 x1876316239558784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395114.447319:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239558784:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395114.447407:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.447439:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.448734:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239558784:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1789395114.453127:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395114.453134:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453142:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.453146:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.453153:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453174:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453181:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.453211:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453218:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af316931d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169324 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453236:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395114.453239:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453245:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.453248:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.453261:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453276:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453281:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.453301:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453308:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af3169301 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169308 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.453320:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.453321:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.453323:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.453331:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239559040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.459129:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.459158:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239558912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.459192:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.459348:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239558912 00000100:00100000:0.0:1789395114.459352:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239558912 00010000:00010000:1.0:1789395114.462127:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.463379:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239559040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.463556:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239558912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.479751:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.496285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.496914:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239559296:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.496963:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239559424:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.496990:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.497013:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.497327:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239559424:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789395114.497377:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.497406:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.497416:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.497427:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239559552:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395114.497450:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.497474:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.502459:0:17997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:17997:1876316239559680:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395114.502459:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:1.0:1789395114.502493:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af3169371 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316936a expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.502506:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b800) 00010000:00010000:1.0:1789395114.502509:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.502514:0:17997:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af3169371 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316936a expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.502524:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df800, rc 0) 00000100:00100000:1.0:1789395114.502579:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239559552:12345-0@lo:101:mdt00_002.0 Request processed in 4892us (5127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.502587:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1789395114.502883:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239559552:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.502900:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.502911:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.503720:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239559808 00000100:00100000:0.0:1789395114.503726:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239559808 00000100:00100000:0.0:1789395114.503774:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1789395114.503792:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239559808:12345-0@lo:105: 00010000:00010000:0.0:1789395114.503805:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.503816:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.503825:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.503832:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.503840:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.503848:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.503867:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca014e00) 00000100:00100000:0.0:1789395114.503920:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239559808:12345-0@lo:105: Request processed in 138us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.503927:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1789395114.504111:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239559808:0@lo:105: 00010000:00010000:1.0:1789395114.504124:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.504166:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231659648:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1398us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.504178:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1480 00000100:00100000:0.0:1789395114.505215:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239559936 00000100:00100000:0.0:1789395114.505224:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239559936 00000100:00100000:0.0:1789395114.505274:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:0.0:1789395114.505282:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239559936:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.505299:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.505319:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316937f lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169378 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.505346:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316937f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169378 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.505359:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316937f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169378 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.505367:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x3caee148 (ffff89a4fbb8e500) 00010000:00010000:0.0:1789395114.505370:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.505373:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:0.0:1789395114.505459:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239559936:12345-0@lo:101:mdt00_002.0 Request processed in 177us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.505467:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:0.0:1789395114.505851:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239559936:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.505869:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169378 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316937f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.505881:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169378 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316937f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.505901:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1789395114.505944:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560064:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.505977:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.506036:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.506149:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239560064 00000100:00100000:1.0:1789395114.506155:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239560064 00000100:00100000:1.0:1789395114.506225:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1789395114.506232:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.506303:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560064:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.506310:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1789395114.506629:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239560192 00000100:00100000:0.0:1789395114.506634:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239560192 00000100:00100000:0.0:1789395114.506656:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:0.0:1789395114.506663:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.506734:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560192:12345-0@lo:1000:mdt00_002.0 Request processed in 72us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395114.506741:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:0.0:1789395114.506766:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560192:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.506837:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560320:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.506863:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.506877:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.506888:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239560320 00000100:00100000:0.0:1789395114.506891:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239560320 00000100:00100000:0.0:1789395114.506906:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:0.0:1789395114.506911:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.506956:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560320:12345-0@lo:1000:mdt00_002.0 Request processed in 43us (91us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395114.506962:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:0.0:1789395114.506986:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560320:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507030:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560448:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507051:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.507064:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.507088:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239560448 00000100:00100000:0.0:1789395114.507099:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239560448 00000100:00100000:0.0:1789395114.507117:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:0.0:1789395114.507122:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507167:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560448:12345-0@lo:1000:mdt00_002.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.507174:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:0.0:1789395114.507197:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560448:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507234:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560576:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507256:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.507269:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.507280:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239560576 00000100:00100000:0.0:1789395114.507283:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239560576 00000100:00100000:0.0:1789395114.507300:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:0.0:1789395114.507305:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507364:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560576:12345-0@lo:1000:mdt00_002.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.507370:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:0.0:1789395114.507415:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560576:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507449:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560704:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507471:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.507484:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.507495:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239560704 00000100:00100000:0.0:1789395114.507498:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239560704 00000100:00100000:0.0:1789395114.507513:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1789395114.507519:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.507559:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239560704:12345-0@lo:1000:mdt00_002.0 Request processed in 39us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.507566:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1789395114.507590:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239560704:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1789395114.508334:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].366, 2168 off556856 00000040:00080000:0.0:1789395114.508425:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].366, 2368 off608040 00000004:00080000:0.0:1789395114.508432:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35ccc0 with version 698 00000004:00080000:1.0:1789395114.508727:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 698 rpc_version 698 00000020:00100000:1.0:1789395114.508756:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395114.508764:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a43100 x1876316239560960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395114.508780:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239560960:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.508821:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.508837:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.509915:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239560960:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1789395114.510031:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169386 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510046:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169386 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510057:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169386 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510083:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316938d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510099:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316938d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510107:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316938d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510134:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510141:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510150:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.510165:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239561088:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395114.510193:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.510216:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.510314:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239561088 00000100:00100000:1.0:1789395114.510319:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239561088 00000100:00100000:1.0:1789395114.510355:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:1.0:1789395114.510363:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6513:x1876316239561088:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.510375:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.510524:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316939b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169394 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.510546:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316939b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169394 expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.510570:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316939b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169394 expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.510578:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff89a4d0654500) 00010000:00010000:1.0:1789395114.510581:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.510585:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417200, rc 0) 00000100:00100000:1.0:1789395114.510615:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:6513:x1876316239561088:12345-0@lo:101:mdt00_002.0 Request processed in 253us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.510621:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:0.0:1789395114.510813:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239561088:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.510827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510838:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.510856:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000764024fd reply state 00000000a027a928 transno 4294968364 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316938d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510868:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316938d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510874:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc0:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:0.0:1789395114.510877:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395114.510880:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395114.510886:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510895:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.510904:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc0:0x0] 00000004:00010000:0.0:1789395114.510909:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000764024fd reply state 00000000a027a928 transno 4294968364 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169386 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510917:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169386 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510924:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17a:0x0].0x0 (ffff89a4fbb8e100) 00010000:00010000:0.0:1789395114.510926:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395114.510928:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1789395114.510933:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17a:0x0]: returning size 4096 00000004:00080000:0.0:1789395114.510940:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395114.510947:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510954:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510961:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af316936a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169371 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510983:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395114.510987:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395114.510991:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169378 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316937f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.510998:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169378 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316937f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.511665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17516:x1876316231659520:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 15219us (15384us total) trans 4294968364 rc 0/0 00000100:00100000:0.0:1789395114.511674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23248 00000100:00100000:0.0:1789395114.553890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.579009:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.579050:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231660032 00000100:00100000:0.0:1789395114.579061:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231660032 00000100:00100000:0.0:1789395114.579118:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23250 00000100:00100000:0.0:1789395114.579129:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17518:x1876316231660032:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395114.579149:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.579170:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31693a2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021059f2 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579231:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af31693a9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579245:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af31693a9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579255:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af31693a9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579558:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31693b0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x3caee148 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579569:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316937f lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169378 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579577:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31693b0 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.579610:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316937f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169378 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.579627:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239561344:0@lo:104: 00000100:00100000:0.0:1789395114.579672:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.579723:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.580459:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239561472 00000100:00100000:1.0:1789395114.580465:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239561472 00010000:00010000:1.0:1789395114.580485:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316937f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169378 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.580518:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:1.0:1789395114.580524:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3637:x1876316239561472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.580534:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789395114.612619:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239562112 00000100:00100000:0.0:1789395114.612625:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239562112 00000100:00100000:0.0:1789395114.612831:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1789395114.612840:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239562112:12345-0@lo:104: 00010000:00010000:0.0:1789395114.612869:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.612928:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395114.612935:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239562112:12345-0@lo:104: Request processed in 97us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.612942:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00010000:00010000:1.0:1789395114.614082:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395114.614103:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.614114:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395114.614121:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395114.614130:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.614173:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.614180:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395114.614201:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.614209:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af3169394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316939b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.614230:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395114.614231:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395114.614233:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395114.614246:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239562240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395114.614294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.614360:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239562112:0@lo:104: 00010000:00010000:1.0:1789395114.614379:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.621633:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.621643:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395114.621695:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xc0:0x0]: returning size 4096 00000004:00200000:0.0:1789395114.621700:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395114.621741:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de200/0xff35729af31693da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a07 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.621756:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a07 expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.621764:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff89a4d0654500) 00010000:00010000:0.0:1789395114.621766:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395114.621769:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de000, rc 0) 00000100:00100000:0.0:1789395114.621820:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17518:x1876316231660416:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 9801us (9943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.621827:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23253 00000100:00100000:1.0:1789395114.621911:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239562240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395114.625844:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239562496:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395114.628752:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231660800 00000100:00100000:0.0:1789395114.628833:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231660800 00000100:00100000:0.0:1789395114.628984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23254 00000100:00100000:0.0:1789395114.628993:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17518:x1876316231660800:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395114.629041:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.629061:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af31693c5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x17a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059f9 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.629077:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17a:0x0].0x0 (ffff89a4fbb8e100) 00010000:00010000:0.0:1789395114.629081:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395114.629141:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015c00/0xff35729af31693e8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.629150:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015c00/0xff35729af31693e8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.629159:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015c00/0xff35729af31693e8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.629180:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239562624:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395114.629231:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.629267:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.629675:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239562624 00000100:00100000:1.0:1789395114.629690:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239562624 00000100:00100000:1.0:1789395114.629762:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:1.0:1789395114.629773:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:6513:x1876316239562624:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.629794:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.629823:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af31693ef lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31693e8 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.629857:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af31693ef lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31693e8 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.629874:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af31693ef lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31693e8 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.629883:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4d0654f00) 00010000:00010000:1.0:1789395114.629886:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.629890:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417a00, rc 0) 00000100:00100000:1.0:1789395114.629979:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6513:x1876316239562624:12345-0@lo:101:mdt00_002.0 Request processed in 207us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.629991:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:1.0:1789395114.630817:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239562752 00000100:00100000:1.0:1789395114.630827:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239562752 00000020:00080000:0.0:1789395114.630877:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 364 committed batchid 363 00000100:00100000:1.0:1789395114.630882:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:1.0:1789395114.630896:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6513:x1876316239562752:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.630910:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.630932:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31693fd lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31693f6 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395114.630949:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 363 00010000:00010000:1.0:1789395114.630959:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31693fd lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31693f6 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.630974:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31693fd lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31693f6 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.630990:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x3caee148 (ffff89a4d0654000) 00010000:00010000:1.0:1789395114.630993:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.630995:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417000, rc 0) 00000100:00100000:1.0:1789395114.631049:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239562752:12345-0@lo:101:mdt00_002.0 Request processed in 156us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.631055:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:0.0:1789395114.632619:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239562752:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.632644:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af31693f6 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31693fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.632662:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af31693f6 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31693fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.632682:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1789395114.632730:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239562880:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.632782:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.632809:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.633531:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239562880 00000100:00100000:1.0:1789395114.633550:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239562880 00000100:00100000:1.0:1789395114.633660:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:1.0:1789395114.633674:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239562880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.633980:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239562880:12345-0@lo:1000:mdt00_002.0 Request processed in 309us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.633989:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:1.0:1789395114.634775:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239563008 00000100:00100000:1.0:1789395114.634783:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239563008 00000100:00100000:1.0:1789395114.634838:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:1.0:1789395114.634849:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239563008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.634994:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239563008:12345-0@lo:1000:mdt00_002.0 Request processed in 146us (570us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395114.635002:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:1.0:1789395114.635055:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239563008:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789395114.635187:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af3169404 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635199:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af3169404 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635217:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af3169404 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.635238:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239563136:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.635279:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.635302:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.635316:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239563136 00000100:00100000:1.0:1789395114.635321:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239563136 00000100:00100000:1.0:1789395114.635344:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:1.0:1789395114.635352:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6513:x1876316239563136:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.635373:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.635421:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af316940b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169404 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635452:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af316940b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169404 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635470:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af316940b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169404 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635479:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17a:0x0].0x0 (ffff89a4d0654c00) 00010000:00010000:1.0:1789395114.635482:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395114.635488:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417c00, rc 0) 00000100:00100000:1.0:1789395114.635522:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239563136:12345-0@lo:101:mdt00_002.0 Request processed in 171us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.635536:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:1.0:1789395114.635570:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239563136:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.635589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af3169404 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316940b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635602:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af3169404 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316940b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635633:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169412 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635643:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169412 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635652:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169412 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635681:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169419 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.635695:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af31693d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a00 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.637814:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169419 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.637946:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af31693d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a00 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.637980:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af31693d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a00 expref: 10 pid: 6511 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.637998:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239563264:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395114.638105:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.645907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.645959:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231660928 00000100:00100000:1.0:1789395114.645971:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231660928 00010000:00010000:1.0:1789395114.646029:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af31693d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a00 expref: 11 pid: 6511 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.646079:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1483 00000100:00100000:1.0:1789395114.646146:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d0224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231660928:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395114.646170:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.646179:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af31693d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a00 expref: 11 pid: 6511 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.646197:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af31693d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a00 expref: 11 pid: 6511 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.646228:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc0:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:1.0:1789395114.646236:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169419 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.646247:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169419 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.646257:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169419 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.646282:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395114.646346:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d0224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231660928:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 256us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.646355:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1483 00000100:00100000:1.0:1789395114.648193:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239563392 00000100:00100000:1.0:1789395114.648205:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239563392 00000100:00100000:1.0:1789395114.648288:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1789395114.648301:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239563392:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.648324:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.648349:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169427 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169420 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.648409:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a07 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.648422:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169427 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169420 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.648460:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a07 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.648477:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31693e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a07 expref: 13 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.648492:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239563520:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395114.648594:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.657362:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca143480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239563392:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.657432:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.657449:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.663597:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239563648 00000100:00100000:0.0:1789395114.663602:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239563648 00000100:00100000:0.0:1789395114.663641:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1789395114.663651:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239563648:12345-0@lo:105: 00010000:00010000:0.0:1789395114.663663:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.663673:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.663682:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.663690:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.663698:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.663706:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af3169420 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169427 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.663749:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3df400) 00000100:00100000:0.0:1789395114.663805:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239563648:12345-0@lo:105: Request processed in 155us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.663813:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1789395114.664941:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239563776 00000100:00100000:1.0:1789395114.664953:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239563776 00000100:00100000:1.0:1789395114.665019:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:1.0:1789395114.665032:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239563776:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1789395114.671563:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239563776:12345-0@lo:403:mdt00_002.0 Request processed in 6518us (6674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.671584:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00010000:00010000:0.0:1789395114.677686:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395114.714008:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.726697:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.729055:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239564544 00000100:00100000:1.0:1789395114.729068:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239564544 00000100:00100000:1.0:1789395114.729129:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1789395114.729139:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239564544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.732802:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239564544:12345-0@lo:1000:mdt00_002.0 Request processed in 3657us (5728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.732816:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1789395114.734442:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239564672 00000100:00100000:1.0:1789395114.734455:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239564672 00000100:00100000:1.0:1789395114.734518:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:1.0:1789395114.734528:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239564672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.734656:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239564672:12345-0@lo:1000:mdt00_002.0 Request processed in 128us (1508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395114.734663:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:1.0:1789395114.734710:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239564672:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789395114.734779:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.734789:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.734798:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.734816:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239564800:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.734849:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.734881:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.734894:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239564800 00000100:00100000:1.0:1789395114.734898:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239564800 00000100:00100000:1.0:1789395114.734937:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:1.0:1789395114.734944:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239564800:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.734953:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.734968:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169458 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169451 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.734993:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169363 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021059eb expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.735004:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169458 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169451 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.735026:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169363 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059eb expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.735039:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169363 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021059eb expref: 9 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.735050:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8435:1876316239564928:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395114.735112:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349840 going to sleep for 11 seconds 00010000:00010000:1.0:1789395114.739451:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395114.741823:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8435:1876316239564928:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395114.741868:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169458 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169451 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.741881:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1bd00) 00010000:00010000:1.0:1789395114.741884:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.741888:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169458 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169451 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.741897:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417400, rc 0) 00000100:00100000:1.0:1789395114.741968:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239564800:12345-0@lo:101:mdt00_002.0 Request processed in 7024us (7118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395114.741978:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:1.0:1789395114.742029:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239564800:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.742048:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169458 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.742058:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169458 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.751577:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565184 00000100:00100000:0.0:1789395114.751593:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565184 00000100:00100000:0.0:1789395114.751656:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1789395114.751669:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239565184:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.751690:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.751718:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169466 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316945f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.751750:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169466 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316945f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.751765:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169466 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316945f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.751774:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xeb6b201b (ffff89a4c875de00) 00010000:00010000:0.0:1789395114.751777:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.751781:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:0.0:1789395114.751858:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565184:12345-0@lo:101:mdt00_002.0 Request processed in 192us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.751866:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1789395114.751924:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565184:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.751943:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316945f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169466 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.751954:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316945f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169466 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.751977:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1789395114.752026:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.752064:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.752098:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.752116:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565312 00000100:00100000:0.0:1789395114.752119:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565312 00000100:00100000:0.0:1789395114.752145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1789395114.752151:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.753780:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565312:12345-0@lo:1000:mdt00_002.0 Request processed in 1622us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.753792:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1789395114.753863:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.753941:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.753979:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.753998:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.754016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565440 00000100:00100000:0.0:1789395114.754022:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565440 00000100:00100000:0.0:1789395114.754060:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1789395114.754069:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.754167:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565440:12345-0@lo:1000:mdt00_002.0 Request processed in 100us (189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395114.755284:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1789395114.755343:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756241:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565568:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756304:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.756331:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.756358:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565568 00000100:00100000:0.0:1789395114.756363:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565568 00000100:00100000:0.0:1789395114.756433:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1789395114.756442:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756650:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565568:12345-0@lo:1000:mdt00_002.0 Request processed in 208us (344us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395114.756658:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1789395114.756689:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565568:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756744:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565696:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756764:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.756775:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.756785:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565696 00000100:00100000:0.0:1789395114.756788:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565696 00000100:00100000:0.0:1789395114.756805:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:0.0:1789395114.756810:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756864:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565696:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.756870:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:0.0:1789395114.756892:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565696:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756923:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565824:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.756944:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.756955:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.756963:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565824 00000100:00100000:0.0:1789395114.756966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565824 00000100:00100000:0.0:1789395114.756981:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1789395114.756986:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.757032:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565824:12345-0@lo:1000:mdt00_002.0 Request processed in 45us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.757038:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1789395114.757058:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565824:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.757087:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565952:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.757118:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.757129:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.757138:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239565952 00000100:00100000:0.0:1789395114.757140:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239565952 00000100:00100000:0.0:1789395114.757157:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:0.0:1789395114.757162:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.758317:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239565952:12345-0@lo:1000:mdt00_002.0 Request processed in 1151us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.758327:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:0.0:1789395114.758371:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239565952:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1789395114.761911:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].371, 2168 off567720 00000040:00080000:0.0:1789395114.762001:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].368, 2368 off616632 00000004:00080000:0.0:1789395114.762012:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca35c300 with version 701 00000100:00100000:0.0:1789395114.762627:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239566208 00000100:00100000:0.0:1789395114.762635:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239566208 00000100:00100000:0.0:1789395114.762694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:0.0:1789395114.762703:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239566208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395114.764703:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239566208:12345-0@lo:1000:osp_up1-0.0 Request processed in 1993us (2339us total) trans 4294968368 rc 0/0 00000100:00100000:0.0:1789395114.764717:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:0.0:1789395114.764819:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239566208:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1789395114.764945:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316946d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.764959:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316946d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.764971:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316946d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.764988:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169474 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.764995:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169474 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.765002:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169474 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.765033:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.765040:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.765049:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.765066:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239566336:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395114.765110:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.765132:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.765148:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239566336 00000100:00100000:0.0:1789395114.765153:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239566336 00000100:00100000:0.0:1789395114.766285:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:0.0:1789395114.766296:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6513:x1876316239566336:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.766316:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.766333:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169482 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316947b expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766358:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169482 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316947b expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766370:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169482 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316947b expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766397:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:0.0:1789395114.766401:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.766405:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014600, rc 0) 00000100:00100000:0.0:1789395114.766455:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6513:x1876316239566336:12345-0@lo:101:mdt00_002.0 Request processed in 160us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.766462:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:0.0:1789395114.766642:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239566336:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.766659:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169482 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766670:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169482 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.766691:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce673ccf reply state 00000000c34a8fc5 transno 4294983402 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169474 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766702:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766707:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc3:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:0.0:1789395114.766709:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395114.766712:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395114.766717:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169482 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766724:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015400/0xff35729af316947b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169482 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395114.766739:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc3:0x0] 00000004:00010000:0.0:1789395114.766744:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce673ccf reply state 00000000c34a8fc5 transno 4294983402 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316946d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766751:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316946d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766757:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150a:0x0].0x0 (ffff89a4c875d500) 00010000:00010000:0.0:1789395114.766759:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395114.766761:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1789395114.766767:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x150a:0x0]: returning size 4096 00000004:00080000:0.0:1789395114.766775:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395114.766785:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169458 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766792:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169458 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766800:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416400/0xff35729af3169451 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169458 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766816:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395114.766820:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395114.766825:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316945f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169466 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.766832:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316945f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169466 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.766924:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17524:x1876316231661568:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 40045us (40240us total) trans 4294983402 rc 0/0 00000100:00100000:0.0:1789395114.766935:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23257 00000100:00100000:0.0:1789395114.768166:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239566464 00000100:00100000:0.0:1789395114.768186:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239566464 00000100:00100000:0.0:1789395114.768247:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1789395114.768257:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239566464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.768270:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.768291:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169458 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169451 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.768305:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1bd00) 00010000:00010000:0.0:1789395114.768315:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.768368:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3638:x1876316239566464:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.768376:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1789395114.798277:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.798423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231662080 00000100:00100000:0.0:1789395114.798431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231662080 00000100:00100000:0.0:1789395114.798477:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23259 00000100:00100000:0.0:1789395114.798487:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17530:x1876316231662080:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395114.798507:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.798528:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169489 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a1c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798590:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169490 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798605:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169490 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798617:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169490 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798629:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169497 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798638:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169466 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316945f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798646:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169497 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.798678:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169466 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316945f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.798704:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239566592:0@lo:104: 00000100:00100000:0.0:1789395114.798744:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.798786:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.799055:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239566592:0@lo:104: 00010000:00010000:1.0:1789395114.799086:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169497 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.803791:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239566848 00000100:00100000:0.0:1789395114.803799:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239566848 00000100:00100000:0.0:1789395114.803844:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1789395114.803853:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3636:x1876316239566848:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1789395114.803866:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.803882:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af31693fd lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3caee148 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31693f6 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.803899:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x3caee148 (ffff89a4d0654000) 00010000:00010000:0.0:1789395114.803906:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.803951:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1876316239566848:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 99us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.803959:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000020:00080000:0.0:1789395114.803979:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 365 committed batchid 364 00000004:00080000:0.0:1789395114.804074:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35ccc0 with version 700 00000020:00080000:0.0:1789395114.804098:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 364 cancel update log [0x200000401:0x3:0x0].365: rc = 0 00000020:00080000:0.0:1789395114.804142:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 364 cancel update log [0x240000400:0x3:0x0].365: rc = 0 00000020:00080000:0.0:1789395114.804151:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 364 00010000:00010000:0.0:1789395114.804198:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169466 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316945f expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.804209:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xeb6b201b (ffff89a4c875de00) 00010000:00010000:0.0:1789395114.804212:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169497 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.804221:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169497 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.804229:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169497 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.804254:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.804288:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876316239566720:12345-0@lo:103:ldlm_bl.0 Request processed in 4785us (5045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.804295:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1789395114.804381:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239567104 00000100:00100000:0.0:1789395114.804404:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239567104 00000100:00100000:0.0:1789395114.804430:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:0.0:1789395114.804437:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7455:x1876316239567104:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395114.804560:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239567104:12345-0@lo:1000:osp_up0-1.0 Request processed in 123us (214us total) trans 4294983403 rc 0/0 00000100:00100000:0.0:1789395114.804567:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:0.0:1789395114.804578:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239567232 00000100:00100000:0.0:1789395114.804582:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239567232 00000100:00100000:0.0:1789395114.804594:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:0.0:1789395114.804599:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239567232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395114.804648:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239567232:12345-0@lo:1000:mdt00_001.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.804655:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:0.0:1789395114.804713:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239567104:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395114.811608:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.819848:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231662336 00000100:00100000:0.0:1789395114.819857:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231662336 00000100:00100000:0.0:1789395114.819916:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23261 00000100:00100000:0.0:1789395114.819926:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17530:x1876316231662336:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395114.819946:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.819965:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af31694b3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a2a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.820021:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.820040:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.820051:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395114.820104:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc3:0x0]: returning size 4096 00000004:00200000:0.0:1789395114.820109:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395114.820144:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af31694b3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a2a expref: 19 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.820159:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a2a expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.820168:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc3:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:0.0:1789395114.820170:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395114.820174:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015200, rc 0) 00000100:00100000:0.0:1789395114.820265:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17530:x1876316231662336:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 340us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.820272:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23261 00000100:00100000:0.0:1789395114.829356:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239567488 00000100:00100000:0.0:1789395114.829361:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239567488 00010000:00010000:0.0:1789395114.829400:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169482 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316947b expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.829425:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1789395114.829432:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239567488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.829443:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1789395114.832866:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 365 batchid updated 00000020:00080000:0.0:1789395114.833030:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 365 00000004:00080000:0.0:1789395114.833102:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35c840 with version 701 00000020:00080000:0.0:1789395114.833122:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 365 cancel update log [0x200000401:0x3:0x0].366: rc = 0 00000004:00080000:1.0:1789395114.833283:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 701 rpc_version 701 00000020:00100000:1.0:1789395114.833325:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395114.833335:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a40380 x1876316239567744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1789395114.833698:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 365 cancel update log [0x240000400:0x3:0x0].366: rc = 0 00000020:00080000:0.0:1789395114.833709:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 365 00000100:00100000:1.0:1789395114.833896:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239567744:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1789395114.834030:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.834144:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.834286:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.834319:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000004:00200000:0.0:1789395114.834355:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xc3:0x0]: returning size 4096 00000004:00200000:0.0:1789395114.834361:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395114.834446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af31694c1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a31 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.834464:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a31 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.834470:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:0.0:1789395114.834473:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395114.834475:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344c00, rc 0) 00000100:00100000:1.0:1789395114.834701:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239567744 00000100:00100000:1.0:1789395114.834708:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239567744 00000100:00100000:1.0:1789395114.834743:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:1.0:1789395114.834749:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239567744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.834850:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239567744:12345-0@lo:1000:osp_up0-1.0 Request processed in 101us (566us total) trans 4294983404 rc 0/0 00000100:00100000:1.0:1789395114.834855:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:0.0:1789395114.835149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17530:x1876316231662464:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 7006us (7160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.835156:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23262 00000100:00100000:0.0:1789395114.844189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231662848 00000100:00100000:0.0:1789395114.844198:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231662848 00000100:00100000:0.0:1789395114.844303:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23263 00000100:00100000:0.0:1789395114.844312:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17530:x1876316231662848:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395114.844361:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.844592:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af31694ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x150a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a23 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.844610:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150a:0x0].0x0 (ffff89a4c875d500) 00010000:00010000:0.0:1789395114.844616:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395114.844900:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.844970:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.844981:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.845003:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239567872:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.845041:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.845168:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239567872 00000100:00100000:0.0:1789395114.845173:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239567872 00000100:00100000:0.0:1789395114.845204:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:0.0:1789395114.845210:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6513:x1876316239567872:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.845219:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.845233:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31694d6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31694cf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.845255:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31694d6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31694cf expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.845267:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31694d6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31694cf expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.845274:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395114.845277:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.845279:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:1.0:1789395114.845872:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.846328:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239567872:12345-0@lo:101:mdt00_002.0 Request processed in 1116us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.846337:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:1.0:1789395114.846652:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968368 gen 2 00000004:00080000:1.0:1789395114.846659:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968363 committed transno 4294968368 00000020:00080000:1.0:1789395114.846664:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca1cc3c0 refcount 2 committed 0 result 0 batchid 370 00000020:00080000:1.0:1789395114.846668:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009c5e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cccc0 00000020:00080000:1.0:1789395114.846672:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].367 00000020:00080000:1.0:1789395114.846675:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009c5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82d2e00 00000020:00080000:1.0:1789395114.846678:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].370 00000004:00080000:1.0:1789395114.846704:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968365 committed transno 4294968368 00000004:00080000:1.0:1789395114.846715:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968366 committed transno 4294968368 00000004:00080000:1.0:1789395114.846741:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968368 committed transno 4294968368 00000100:00100000:1.0:1789395114.846760:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239567872:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.846779:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.846791:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.846806:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395114.846835:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.846843:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.846852:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.846866:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239568000:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.846900:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.846950:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.847018:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239568000 00000100:00100000:0.0:1789395114.847024:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239568000 00000100:00100000:0.0:1789395114.847058:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:0.0:1789395114.847066:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239568000:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.847078:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.847101:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31694e4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31694dd expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.847121:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31694e4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31694dd expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.847131:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31694e4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31694dd expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.847140:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xeb6b201b (ffff89a4c875d000) 00010000:00010000:0.0:1789395114.847142:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.847145:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014a00, rc 0) 00000100:00100000:0.0:1789395114.847208:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239568000:12345-0@lo:101:mdt00_002.0 Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.847213:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1789395114.847252:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239568000:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.847262:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31694e4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.847270:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31694e4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.847281:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395114.847307:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239568128:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.847329:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.847409:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.847652:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239568128 00000100:00100000:0.0:1789395114.847656:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239568128 00000100:00100000:0.0:1789395114.847679:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:0.0:1789395114.847685:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239568128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.847746:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239568128:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.847753:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:0.0:1789395114.847927:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239568256 00000100:00100000:0.0:1789395114.847931:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239568256 00000100:00100000:0.0:1789395114.847956:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:0.0:1789395114.847961:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239568256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.848040:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239568256:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (169us total) trans 0 rc 1/1 00000100:00100000:0.0:1789395114.848046:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:0.0:1789395114.848868:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239568384 00000100:00100000:0.0:1789395114.848874:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239568384 00000100:00100000:0.0:1789395114.848911:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:0.0:1789395114.848918:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6513:x1876316239568384:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395114.848928:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.848943:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af31694f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31694eb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.848963:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af31694f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31694eb expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.848975:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af31694f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31694eb expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.848983:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150a:0x0].0x0 (ffff89a4c875d200) 00010000:00010000:0.0:1789395114.848986:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395114.848988:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:0.0:1789395114.849172:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6513:x1876316239568384:12345-0@lo:101:mdt00_002.0 Request processed in 253us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.849178:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:1.0:1789395114.854312:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239568512:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395114.854349:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.857649:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231662976 00000100:00100000:0.0:1789395114.857660:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231662976 00010000:00010000:0.0:1789395114.857698:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a2a expref: 18 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.857737:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1488 00000100:00100000:0.0:1789395114.857745:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231662976:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.857762:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.857769:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a2a expref: 18 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.857781:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a2a expref: 18 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.857801:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af31694ba lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a2a expref: 18 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.857816:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc3:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:0.0:1789395114.857820:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.857829:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.857836:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.857855:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.857911:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231662976:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 166us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.857918:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1488 00010000:00010000:1.0:1789395114.858072:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.858081:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.858131:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.858138:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.858147:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.858162:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239568640:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395114.858202:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.858224:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.862100:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231663104 00000100:00100000:0.0:1789395114.862111:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231663104 00010000:00010000:0.0:1789395114.862160:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a31 expref: 7 pid: 6512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.862203:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1489 00000100:00100000:0.0:1789395114.862213:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231663104:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.862229:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.862235:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a31 expref: 7 pid: 6512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.863486:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239568640:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.863511:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.863524:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.867464:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a31 expref: 7 pid: 6512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.867500:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31694c8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a31 expref: 7 pid: 6512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.867521:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:0.0:1789395114.867527:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af316950e lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169507 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.867539:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af316950e lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169507 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.867547:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af316950e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169507 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.867776:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af316950e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169507 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.867793:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239568896:0@lo:105: 00000100:00100000:1.0:1789395114.867856:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.867900:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.867957:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239568896 00000100:00100000:0.0:1789395114.867964:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239568896 00000100:00100000:0.0:1789395114.868902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1789395114.868918:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239568896:12345-0@lo:105: 00010000:00010000:0.0:1789395114.868931:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.868942:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.868951:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.868959:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.868967:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.868976:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.869001:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca417e00) 00000100:00100000:0.0:1789395114.869681:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239568896:12345-0@lo:105: Request processed in 766us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.869691:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00010000:00010000:1.0:1789395114.869780:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.869788:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.870802:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239569024:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1789395114.870856:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.870888:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.873688:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239569024:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1789395114.874592:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].372, 664 off568384 00000040:00080000:1.0:1789395114.874740:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].369, 744 off617376 00000004:00080000:1.0:1789395114.874746:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca349b40 with version 702 00000004:00080000:0.0:1789395114.874778:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 702 rpc_version 702 00000020:00100000:0.0:1789395114.874809:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395114.874817:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a501d04700 x1876316239569280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00200000:1.0:1789395114.876138:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x150a:0x0]: returning size 4096 00010000:00010000:1.0:1789395114.876159:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876168:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876176:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876181:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395114.876186:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876194:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876209:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc3:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:1.0:1789395114.876212:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395114.876216:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876220:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af3169500 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876231:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876236:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876247:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876264:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395114.876274:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc3:0x0] 00010000:00010000:1.0:1789395114.876281:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876287:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876293:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876297:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395114.876298:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395114.876300:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876304:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876306:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876311:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395114.876314:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150a:0x0].0x0 (ffff89a4c875d500) 00010000:00010000:1.0:1789395114.876317:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395114.876320:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876325:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af31694f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876334:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876349:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876372:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395114.876381:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395114.876420:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876420:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876428:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.876429:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876435:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876452:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1789395114.876457:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395114.876461:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31694e4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876466:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.876468:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417800/0xff35729af31694dd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31694e4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876474:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.876492:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876498:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca417e00/0xff35729af3169507 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316950e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876515:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395114.876518:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876524:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de200 already unused, calling callback (ffffffffc1969ee0) 00000100:00100000:1.0:1789395114.876525:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17530:x1876316231662848:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 32213us (32392us total) trans 4294983405 rc 0/0 00010000:00010000:0.0:1789395114.876527:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.876533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23263 00000004:00010000:0.0:1789395114.876539:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876555:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876561:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.876567:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 1/0,0 mode: --/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876573:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af31694eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31694f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876585:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395114.876589:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876595:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395114.876598:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395114.876605:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876619:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876624:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395114.876645:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876653:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416a00/0xff35729af31694cf lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31694d6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876665:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.876667:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395114.876668:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395114.876747:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239569408 00000100:00100000:0.0:1789395114.876752:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239569408 00000100:00100000:0.0:1789395114.876782:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239569536 00000100:00100000:0.0:1789395114.876785:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239569536 00000100:00100000:0.0:1789395114.876799:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239569664 00000100:00100000:0.0:1789395114.876801:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239569664 00000100:00100000:0.0:1789395114.876812:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1789395114.876819:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239569408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.876829:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.876843:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af316950e lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169507 expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876853:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:0.0:1789395114.876861:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.876889:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3638:x1876316239569408:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.876900:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1789395114.876912:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1789395114.876917:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239569664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.876925:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.876934:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31694d6 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31694cf expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.876942:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395114.876947:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.877066:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1876316239569664:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.877072:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1789395114.889928:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231663232 00000100:00100000:0.0:1789395114.889938:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231663232 00000100:00100000:0.0:1789395114.890009:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23264 00000100:00100000:0.0:1789395114.890020:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17531:x1876316231663232:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395114.890043:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395114.890076:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169515 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a38 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890151:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890176:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890196:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890212:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890220:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890232:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890275:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890282:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890289:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890296:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890302:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395114.890306:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890323:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890335:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:0.0:1789395114.890345:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.890351:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890357:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316951c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890379:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890442:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890450:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890456:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395114.890460:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890467:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890476:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xc1169e19 (ffff89a4c875da00) 00010000:00010000:0.0:1789395114.890479:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.890482:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890489:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169523 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890520:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169515 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a38 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890531:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:0.0:1789395114.890533:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395114.890537:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169515 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a38 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.890551:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:0.0:1789395114.890609:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17531:x1876316231663232:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 591us (787us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395114.890617:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23264 00000100:00100000:0.0:1789395114.898911:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395114.911693:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231663616 00000100:00100000:1.0:1789395114.911708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231663616 00000100:00100000:1.0:1789395114.911773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23266 00000100:00100000:1.0:1789395114.911784:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17531:x1876316231663616:12345-192.168.203.54@tcp:36:lfs.0 00000100:00100000:1.0:1789395114.911952:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239569792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.912018:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.912060:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.912267:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239569792 00000100:00100000:0.0:1789395114.912272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239569792 00000100:00100000:0.0:1789395114.912587:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1789395114.912596:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239569792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.912682:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239569792:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.912690:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1789395114.913128:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239569920 00000100:00100000:0.0:1789395114.913133:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239569920 00000100:00100000:0.0:1789395114.913165:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1789395114.913171:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6513:x1876316239569920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.913446:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239570048 00000100:00100000:1.0:1789395114.913452:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239570048 00000100:00100000:1.0:1789395114.913630:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1789395114.913638:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c1b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239570048:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.913647:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395114.913661:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169538 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.913687:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.913696:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169538 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.913719:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.913731:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 16 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.913741:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8435:1876316239570176:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395114.913813:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.914269:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239569920:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395114.914278:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1789395114.917513:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231663744 00000100:00100000:0.0:1789395114.917522:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231663744 00010000:00010000:0.0:1789395114.917564:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 17 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.917609:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1490 00000100:00100000:0.0:1789395114.917624:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231663744:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.917642:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.917648:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 17 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.917662:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 17 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.917686:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316944a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a15 expref: 17 pid: 10512 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.917701:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:0.0:1789395114.917707:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169538 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.917718:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169538 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.917726:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169538 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.917756:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169538 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395114.917769:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239570304:0@lo:105: 00000100:00100000:0.0:1789395114.917811:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395114.917850:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789395114.918332:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af3169538 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316953f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.918341:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af3169538 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316953f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.918362:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395114.918423:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417c00/0xff35729af3169546 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.918431:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417c00/0xff35729af3169546 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.918440:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417c00/0xff35729af3169546 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.918454:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570432:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395114.918627:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239570304:0@lo:105: 00010000:00010000:0.0:1789395114.918641:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.918685:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231663744:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1063us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.918693:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1490 00000100:00100000:1.0:1789395114.920151:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.920197:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.921833:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570432:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395114.921853:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417c00/0xff35729af3169546 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316954d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.921864:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417c00/0xff35729af3169546 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316954d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395114.921885:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1789395114.922248:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.922289:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.922373:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.922939:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.922980:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.923004:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.923028:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.923563:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.923703:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.923730:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.923798:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.924182:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.924229:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.924251:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.924529:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.924964:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239570944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.925007:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239571072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.925031:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.925097:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395114.925436:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239571072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.925475:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239571200:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395114.925499:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395114.928560:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395114.928738:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239571200 00000100:00100000:0.0:1789395114.928747:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239571200 00000100:00100000:0.0:1789395114.928842:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:0.0:1789395114.928853:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239571200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395114.929037:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239571200:12345-0@lo:1000:mdt00_002.0 Request processed in 185us (3536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.929044:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:1.0:1789395114.929122:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239571200:0@lo:1000:mdt00_002.0 00000040:00080000:1.0:1789395114.930301:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].369, 2168 off560176 00000040:00080000:1.0:1789395114.930428:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].368, 2368 off611440 00000004:00080000:1.0:1789395114.930435:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c9b9ccc0 with version 702 00000100:00100000:1.0:1789395114.930900:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239571456 00000100:00100000:1.0:1789395114.930908:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239571456 00000100:00100000:1.0:1789395114.930957:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:1.0:1789395114.930966:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239571456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395114.931804:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7455:x1876316239571456:12345-0@lo:1000:osp_up0-1.0 Request processed in 836us (1040us total) trans 4294983406 rc 0/0 00000100:00100000:1.0:1789395114.931813:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1789395114.937342:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239571712 00000100:00100000:0.0:1789395114.937353:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239571712 00000100:00100000:0.0:1789395114.937430:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1789395114.937441:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3637:x1876316239571712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395114.937456:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395114.937477:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316953f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169538 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395114.937493:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:0.0:1789395114.937503:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395114.938728:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3637:x1876316239571712:12345-0@lo:103:ldlm_bl.0 Request processed in 1283us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395114.938738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1789395114.966350:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231664000 00000100:00100000:0.0:1789395114.966360:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231664000 00000100:00100000:0.0:1789395114.966454:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23267 00000100:00100000:0.0:1789395114.966465:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17532:x1876316231664000:12345-192.168.203.54@tcp:36:mkdir.0 00000100:00100000:0.0:1789395114.966619:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17532:x1876316231664000:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 155us (347us total) trans 0 rc -17/-17 00000100:00100000:0.0:1789395114.966627:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23267 00000100:00100000:0.0:1789395114.989271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395114.991337:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239571840:0@lo:104: 00010000:00010000:0.0:1789395114.991356:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395114.999896:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239572096 00000100:00100000:1.0:1789395114.999903:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239572096 00000100:00100000:1.0:1789395114.999949:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1789395114.999958:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3639:x1876316239572096:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1789395114.999969:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395114.999986:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31694e4 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xeb6b201b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31694dd expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395114.999995:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xeb6b201b (ffff89a4c875d000) 00010000:00010000:1.0:1789395115.003508:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.003603:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239572096:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 3633us (3837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.003614:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1789395115.003674:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239572096:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1789395115.006027:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239572352 00000100:00100000:0.0:1789395115.006037:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239572352 00000100:00100000:0.0:1789395115.006110:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:0.0:1789395115.006120:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239572352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.006331:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239572352:12345-0@lo:1000:osp_up1-0.0 Request processed in 212us (2341us total) trans 4294968371 rc 0/0 00000100:00100000:0.0:1789395115.006338:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00010000:00010000:1.0:1789395115.007017:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.007030:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.007153:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239572480:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395115.007316:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.007338:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4df47cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.008236:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239572480:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789395115.008289:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169585 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008304:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169585 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008314:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169585 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395115.008336:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169585 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008349:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008356:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008362:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008368:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008374:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.008378:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008411:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008422:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b200) 00010000:00010000:1.0:1789395115.008425:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.008430:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008436:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344c00/0xff35729af3169577 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008447:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008453:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008458:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008463:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.008466:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008471:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008477:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xc1169e19 (ffff89a3c9b1b900) 00010000:00010000:1.0:1789395115.008480:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.008483:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008492:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316957e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008527:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af3169570 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a46 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008542:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169585 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a46 expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.008549:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a4d0654700) 00010000:00010000:1.0:1789395115.010634:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395115.010645:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416e00, rc 0) 00000100:00100000:1.0:1789395115.011237:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17533:x1876316231664128:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 20659us (21456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.011259:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23268 00000100:00100000:1.0:1789395115.019163:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231664256 00000100:00100000:1.0:1789395115.019172:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231664256 00000100:00100000:1.0:1789395115.019274:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23269 00000100:00100000:1.0:1789395115.019285:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17533:x1876316231664256:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.019308:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.019327:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316958c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a4d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.019416:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169593 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.019429:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169593 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.019443:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169593 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395115.019537:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17c:0x0]: returning size 4096 00000004:00200000:1.0:1789395115.019542:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395115.019578:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316958c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a4d expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.019608:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169593 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a4d expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.019618:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a3c9b1b300) 00010000:00010000:1.0:1789395115.019622:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395115.019626:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417200, rc 0) 00000100:00100000:1.0:1789395115.019678:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17533:x1876316231664256:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 396us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.019686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23269 00000100:00080000:0.0:1789395115.019971:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395115.026215:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231664384 00000100:00100000:0.0:1789395115.026225:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231664384 00000100:00100000:0.0:1789395115.026324:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23270 00000100:00100000:0.0:1789395115.026335:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17533:x1876316231664384:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395115.026355:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.026374:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316959a lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a54 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.026447:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.026461:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.026472:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.026516:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xc1:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.026521:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.026554:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316959a lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 12 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.026569:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 11 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.026578:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc1:0x0].0x0 (ffff89a3c9b1b100) 00010000:00010000:0.0:1789395115.026580:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.026584:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:0.0:1789395115.026712:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17533:x1876316231664384:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 378us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.026720:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23270 00000100:00100000:0.0:1789395115.032746:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.033471:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231664512 00000100:00100000:1.0:1789395115.033482:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231664512 00000100:00100000:1.0:1789395115.033542:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23271 00000100:00100000:1.0:1789395115.033552:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17533:x1876316231664512:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.033573:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.033594:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31695a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a5b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.033654:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.033673:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169562 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.033682:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.033716:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169562 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.033731:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239572608:0@lo:104: 00000100:00100000:1.0:1789395115.034301:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.034345:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06aa80 going to sleep for 11 seconds 00000100:00080000:1.0:1789395115.034362:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395115.034375:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239572608 00000100:00100000:1.0:1789395115.034380:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239572608 00000100:00100000:1.0:1789395115.034437:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789395115.034445:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7813:x1876316239572608:12345-0@lo:104: 00010000:00010000:1.0:1789395115.034458:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.034511:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395115.034518:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7813:x1876316239572608:12345-0@lo:104: Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.034524:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00010000:00010000:1.0:1789395115.034546:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395115.034552:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.034565:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395115.034570:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395115.034580:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.034608:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.034615:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395115.034636:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.034643:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169562 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169569 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.034661:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395115.034663:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395115.034665:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395115.034677:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239572736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395115.034707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.034744:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239572736 00000100:00100000:1.0:1789395115.034748:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239572736 00010000:00010000:1.0:1789395115.034764:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169569 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169562 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.034789:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1789395115.034798:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876316239572736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.034808:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395115.035333:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239572608:0@lo:104: 00010000:00010000:1.0:1789395115.035352:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789395115.037064:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 371 batchid updated 00000020:00080000:1.0:1789395115.037103:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 371 00000004:00080000:1.0:1789395115.037158:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca06aa80 with version 704 00000020:00080000:1.0:1789395115.037170:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 371 cancel update log [0x240000401:0x3:0x0].368: rc = 0 00000020:00080000:1.0:1789395115.037251:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 371 cancel update log [0x200000400:0x3:0x0].371: rc = 0 00000020:00080000:1.0:1789395115.037259:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 371 00010000:00010000:1.0:1789395115.037312:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169562 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037328:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:1.0:1789395115.037333:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037342:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037350:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037374:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.037463:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239572736:12345-0@lo:103:ldlm_bl.0 Request processed in 2666us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.037473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1789395115.037526:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239572736:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1789395115.037549:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 704 rpc_version 704 00000020:00100000:1.0:1789395115.037583:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.037590:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c904fb80 x1876316239572992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.037609:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239572992:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395115.037645:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.037671:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a240 going to sleep for 11 seconds 00010000:00010000:1.0:1789395115.037685:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037693:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395115.037743:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xc1:0x0]: returning size 4096 00000004:00200000:1.0:1789395115.037748:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395115.037789:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af31695a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a5b expref: 16 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037803:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a5b expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.037810:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:1.0:1789395115.037813:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395115.037815:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417600, rc 0) 00000100:00100000:1.0:1789395115.038055:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17533:x1876316231664512:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 4503us (5316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.038062:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23271 00000100:00100000:1.0:1789395115.040430:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239572992:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.046739:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.046777:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.046806:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231664896 00000100:00100000:0.0:1789395115.046816:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231664896 00000100:00100000:0.0:1789395115.046869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23272 00000100:00100000:1.0:1789395115.047079:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231664640 00000100:00100000:1.0:1789395115.047083:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231664640 00000100:00100000:1.0:1789395115.047177:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1257 00000100:00100000:1.0:1789395115.047187:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2397:x1876316231664640:12345-192.168.203.54@tcp:103:rmdir.0 00000100:00100000:0.0:1789395115.047280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17533:x1876316231664896:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:1.0:1789395115.047293:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.047326:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.047340:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af3169593 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a4d expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.047357:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a3c9b1b300) 00010000:00010000:0.0:1789395115.047363:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395115.047366:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169585 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a46 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.047378:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a4d0654700) 00010000:00010000:0.0:1789395115.047429:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.047438:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.047448:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.047479:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573120:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395115.047487:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.047561:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2397:x1876316231664640:12345-192.168.203.54@tcp:103:rmdir.0 Request processed in 377us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.047569:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1257 00000100:00100000:0.0:1789395115.048501:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.048538:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.050596:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573248:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395115.050614:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344800/0xff35729af31695c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31695cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.050625:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344800/0xff35729af31695c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31695cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395115.050642:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1789395115.050680:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395115.050711:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.050737:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.051300:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239573376 00000100:00100000:0.0:1789395115.051306:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239573376 00000100:00100000:0.0:1789395115.051345:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:0.0:1789395115.051358:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239573376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395115.051462:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239573376:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.051524:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395115.051570:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573504:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395115.051596:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.051618:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.052296:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00100000:1.0:1789395115.052735:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573504:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789395115.052808:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.052816:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.052834:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.052848:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573632:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395115.052876:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.052894:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.052896:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239573632 00000100:00100000:0.0:1789395115.052901:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239573632 00000100:00100000:0.0:1789395115.052934:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1789395115.052941:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239573632:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395115.052952:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.052968:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695d9 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31695d2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.052991:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695d9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31695d2 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.053005:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695d9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31695d2 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.053013:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:0.0:1789395115.053015:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395115.053019:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015600, rc 0) 00000100:00100000:0.0:1789395115.053056:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6512:x1876316239573632:12345-0@lo:101:mdt00_001.0 Request processed in 115us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.053061:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1789395115.053115:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573632:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395115.053128:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31695d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053137:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31695d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053159:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053168:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053179:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053206:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053218:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 10 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053226:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053252:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 10 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.053265:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 10 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.053275:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239573760:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395115.053344:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.056604:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239573760:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395115.056631:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.059912:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231665024 00000100:00100000:0.0:1789395115.059922:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231665024 00010000:00010000:0.0:1789395115.059964:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 11 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.060008:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1493 00000100:00100000:0.0:1789395115.060018:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231665024:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.060041:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.060049:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 11 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.060069:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 11 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.060101:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af31695a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a54 expref: 11 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.060114:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc1:0x0].0x0 (ffff89a3c9b1b100) 00010000:00010000:0.0:1789395115.060119:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.060128:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.060136:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.060168:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395115.060245:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231665024:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 221us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.060254:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1493 00000100:00100000:0.0:1789395115.061241:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239573888 00000100:00100000:0.0:1789395115.061247:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239573888 00000100:00100000:0.0:1789395115.061299:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1789395115.061307:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6512:x1876316239573888:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395115.061322:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.061336:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31695f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af31695ee expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.061363:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a5b expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.061373:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31695f5 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31695ee expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.061415:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a5b expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.061427:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a5b expref: 13 pid: 7813 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.061438:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239574016:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395115.061496:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00010000:00010000:1.0:1789395115.076582:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af31695af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a5b expref: 13 pid: 7813 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.076598:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239574016:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395115.076618:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31695f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31695ee expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.076628:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:1.0:1789395115.076631:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395115.076633:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:1.0:1789395115.076675:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6512:x1876316239573888:12345-0@lo:101:mdt00_001.0 Request processed in 15369us (15485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.076683:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:1.0:1789395115.076720:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239573888:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395115.076735:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df200/0xff35729af31695ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31695f5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.077646:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239574272:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395115.077697:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.077732:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.079593:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239574272 00000100:00100000:1.0:1789395115.079608:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239574272 00000100:00100000:1.0:1789395115.079678:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:1.0:1789395115.079689:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6512:x1876316239574272:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395115.082058:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6512:x1876316239574272:12345-0@lo:403:mdt00_001.0 Request processed in 2363us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.082071:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000004:00080000:1.0:1789395115.087978:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 703 rpc_version 703 00000020:00100000:1.0:1789395115.088022:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.088032:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a16a00 x1876316239574528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2064/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.088060:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a16a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239574528:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395115.088137:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.089131:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.089260:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239574528 00000100:00100000:0.0:1789395115.089268:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239574528 00000100:00100000:0.0:1789395115.089440:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1789395115.089451:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7455:x1876316239574528:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.090167:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239574528:12345-0@lo:1000:osp_up0-1.0 Request processed in 715us (2026us total) trans 4294983407 rc 0/0 00000100:00100000:0.0:1789395115.090177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000004:00200000:0.0:1789395115.091419:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17c:0x0]: returning size 4096 00010000:00010000:0.0:1789395115.091443:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091453:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091462:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091468:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.091473:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091481:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091496:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc1:0x0].0x0 (ffff89a3c9b1b100) 00010000:00010000:0.0:1789395115.091499:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395115.091505:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091511:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af31695e7 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091523:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df200/0xff35729af31695ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31695f5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091531:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df200/0xff35729af31695ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31695f5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091538:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df200/0xff35729af31695ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31695f5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091561:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395115.091569:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc1:0x0] 00010000:00010000:0.0:1789395115.091576:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091583:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091588:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091592:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.091595:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091600:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091608:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a3c9b1b300) 00010000:00010000:0.0:1789395115.091611:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.091614:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091620:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31695e0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091630:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31695d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091637:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31695d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091644:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416c00/0xff35729af31695d2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31695d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091663:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1789395115.091674:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395115.091679:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091686:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091692:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091711:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1789395115.091715:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395115.091719:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344800/0xff35729af31695c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31695cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091727:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344800/0xff35729af31695c4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af31695cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.091805:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17533:x1876316231664896:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 44527us (45026us total) trans 4294968373 rc 0/0 00000100:00100000:0.0:1789395115.091814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23272 00010000:00010000:0.0:1789395115.091910:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395115.091916:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091923:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395115.091927:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.091935:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091952:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091957:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395115.091962:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091969:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014a00/0xff35729af31695b6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31695bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.091979:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.091981:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.091982:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.091988:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395115.092005:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239574656 00000100:00100000:0.0:1789395115.092010:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239574656 00000100:00100000:0.0:1789395115.092045:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1789395115.092054:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3637:x1876316239574656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.092067:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.092081:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31695f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31695ee expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.092105:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:0.0:1789395115.092112:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395115.093039:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3637:x1876316239574656:12345-0@lo:103:ldlm_bl.0 Request processed in 982us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.093049:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1789395115.093070:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239574784 00000100:00100000:0.0:1789395115.093076:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239574784 00000100:00100000:0.0:1789395115.093121:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239574912 00000100:00100000:0.0:1789395115.093125:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239574912 00000100:00100000:0.0:1789395115.093141:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1789395115.093148:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239574784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.093157:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.093172:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695d9 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x17c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31695d2 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.093184:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17c:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:0.0:1789395115.093270:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.093347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1789395115.093357:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3638:x1876316239574912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.093366:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.093378:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af31695bd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31695b6 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.093380:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3638:x1876316239574784:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.093401:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00010000:00010000:1.0:1789395115.093407:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1bc00) 00010000:00010000:1.0:1789395115.093414:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395115.093438:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239574784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395115.093755:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3638:x1876316239574912:12345-0@lo:103:ldlm_bl.0 Request processed in 399us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.093762:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1789395115.095289:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239574912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395115.124205:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231665280 00000100:00100000:0.0:1789395115.124221:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231665280 00000100:00100000:0.0:1789395115.124295:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23273 00000100:00100000:0.0:1789395115.124306:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17534:x1876316231665280:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395115.124327:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.124351:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695fc lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a62 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124517:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124598:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124611:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124626:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124637:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124643:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124688:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124696:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124701:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124708:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124714:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.124718:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124726:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124736:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:0.0:1789395115.124740:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.124743:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124750:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169603 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124763:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124769:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124774:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124779:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.124781:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124786:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124793:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8f0f038c (ffff89a4c875d300) 00010000:00010000:0.0:1789395115.124795:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.124799:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124804:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316960a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124834:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695fc lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a62 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124844:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:0.0:1789395115.124846:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.124851:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af31695fc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a62 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.124861:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015600, rc 0) 00000100:00100000:0.0:1789395115.124931:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17534:x1876316231665280:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 627us (860us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395115.124938:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23273 00000100:00100000:1.0:1789395115.128700:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.138787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231665536 00000100:00100000:0.0:1789395115.138801:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231665536 00000100:00100000:0.0:1789395115.138889:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23275 00000100:00100000:0.0:1789395115.138900:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17534:x1876316231665536:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395115.138921:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.138946:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169626 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a70 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.139004:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316962d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.139026:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316962d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.139037:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316962d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.139095:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.139100:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.139135:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169626 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a70 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.139153:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316962d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a70 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.139161:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:0.0:1789395115.139164:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.139167:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014a00, rc 0) 00000100:00100000:0.0:1789395115.139234:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17534:x1876316231665536:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 335us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.139246:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23275 00000100:00100000:1.0:1789395115.162359:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231665792 00000100:00100000:1.0:1789395115.162374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231665792 00000100:00100000:1.0:1789395115.162487:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23276 00000100:00100000:1.0:1789395115.162497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17534:x1876316231665792:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395115.162554:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.162579:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af316962d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a70 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.162601:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:1.0:1789395115.162612:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395115.162672:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af3169634 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.162684:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af3169634 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.162693:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af3169634 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.162706:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316963b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.162714:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316963b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.162720:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316963b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395115.165707:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 705 rpc_version 705 00000020:00100000:1.0:1789395115.165744:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.165754:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a17800 x1876316239575168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.165887:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239575168:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395115.165954:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.166098:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.166133:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239575168 00000100:00100000:0.0:1789395115.166141:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239575168 00000100:00100000:0.0:1789395115.166184:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:0.0:1789395115.166192:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7874:x1876316239575168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.166647:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239575168:12345-0@lo:1000:osp_up1-0.0 Request processed in 455us (693us total) trans 4294968374 rc 0/0 00000100:00100000:0.0:1789395115.166653:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1789395115.166718:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239575168:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.167127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239575296 00000100:00100000:0.0:1789395115.167132:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239575296 00000100:00100000:0.0:1789395115.167169:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:0.0:1789395115.167177:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239575296:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395115.167188:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.167205:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169650 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.167226:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169650 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.167240:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169650 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.167248:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:0.0:1789395115.167251:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.167254:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015600, rc 0) 00000100:00100000:0.0:1789395115.167293:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6513:x1876316239575296:12345-0@lo:101:mdt00_002.0 Request processed in 116us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.167300:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:0.0:1789395115.214322:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.224744:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.224812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231666304 00000100:00100000:1.0:1789395115.224822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231666304 00000100:00100000:1.0:1789395115.224881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23279 00000100:00100000:1.0:1789395115.224893:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17536:x1876316231666304:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.224924:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.224946:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af316967a lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a7e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.225004:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.225019:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.225030:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395115.225074:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc4:0x0]: returning size 4096 00000004:00200000:1.0:1789395115.225079:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395115.225126:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af316967a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a7e expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.225141:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a7e expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.225150:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc4:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:1.0:1789395115.225154:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395115.225157:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416600, rc 0) 00000100:00100000:1.0:1789395115.225214:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17536:x1876316231666304:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 324us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.225221:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23279 00000100:00100000:0.0:1789395115.232028:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.232130:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231666432 00000100:00100000:1.0:1789395115.232141:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231666432 00000100:00100000:1.0:1789395115.232199:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23280 00000100:00100000:1.0:1789395115.232209:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17536:x1876316231666432:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.232236:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.232257:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af3169688 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a85 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232315:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232329:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169650 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232337:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 4/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232380:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169650 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.232416:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239575424:0@lo:104: 00000100:00100000:1.0:1789395115.232463:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.232506:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789395115.232783:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395115.232790:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af3169650 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232799:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395115.232804:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af3169650 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395115.232813:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af3169650 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232843:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af3169650 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232850:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395115.232883:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af3169650 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232890:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af3169650 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169657 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.232906:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395115.232908:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395115.232910:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395115.232936:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239575424:0@lo:104: 00010000:00010000:1.0:1789395115.232952:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.233024:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395115.233036:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239575552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395115.233067:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.233710:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239575552 00000100:00100000:1.0:1789395115.233717:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239575552 00010000:00010000:1.0:1789395115.233740:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169650 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.233775:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1789395115.233783:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3637:x1876316239575552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.233795:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395115.236398:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395115.236424:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239575680:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1789395115.236490:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.236531:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239575680 00000100:00100000:1.0:1789395115.236536:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239575680 00000100:00100000:1.0:1789395115.236580:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1789395115.236599:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1876316239575680:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1789395115.236612:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.236628:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af31695cb lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xc1169e19 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31695c4 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.236644:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xc1169e19 (ffff89a3c9b1be00) 00010000:00010000:1.0:1789395115.236652:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.236696:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1876316239575680:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 109us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.236703:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1789395115.237295:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239575680:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:0.0:1789395115.237341:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 704 rpc_version 704 00000020:00100000:0.0:1789395115.237363:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395115.237371:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c8258380 x1876316239575936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395115.237408:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239575936:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.237457:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.237480:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789395115.237543:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169657 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169650 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.237557:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:1.0:1789395115.237563:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.237572:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.237586:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.237620:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.238154:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239575552:12345-0@lo:103:ldlm_bl.0 Request processed in 4370us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.238163:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00010000:00010000:1.0:1789395115.238219:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.238228:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.238656:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239575936:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1789395115.238789:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xc4:0x0]: returning size 4096 00000004:00200000:1.0:1789395115.238796:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395115.238849:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af3169688 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a85 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.238868:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a85 expref: 8 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.238875:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:1.0:1789395115.238877:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395115.238880:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416c00, rc 0) 00000100:00100000:1.0:1789395115.239115:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17536:x1876316231666432:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 6906us (7093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.239124:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23280 00000100:00100000:0.0:1789395115.247923:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.256918:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.256988:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231666816 00000100:00100000:1.0:1789395115.257000:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231666816 00010000:00010000:1.0:1789395115.257037:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a7e expref: 17 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.257077:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1496 00000100:00100000:1.0:1789395115.257096:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231666816:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.257714:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.257725:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a7e expref: 17 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.257741:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a7e expref: 17 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.257764:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169681 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a7e expref: 17 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.257779:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc4:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:1.0:1789395115.257785:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.257795:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.257802:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.257834:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.257900:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231666816:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 814us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.257909:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1496 00010000:00010000:0.0:1789395115.257941:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.257951:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.258010:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af31696b2 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.258018:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af31696b2 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.258027:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af31696b2 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.258043:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239576192:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395115.258096:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.258125:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000020:00080000:1.0:1789395115.267201:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 372 committed batchid 371 00000020:00080000:1.0:1789395115.267273:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 371 00000100:00100000:0.0:1789395115.270480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231666944 00000100:00100000:0.0:1789395115.270491:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231666944 00010000:00010000:0.0:1789395115.270531:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a85 expref: 8 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.270791:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1497 00000100:00100000:0.0:1789395115.270804:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231666944:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.270819:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.270827:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a85 expref: 8 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.270842:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a85 expref: 8 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.270865:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316968f lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a85 expref: 8 pid: 10512 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.271180:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:0.0:1789395115.271188:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af31696b9 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31696b2 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.271200:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af31696b9 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af31696b2 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.271209:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af31696b9 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af31696b2 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.271245:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af31696b9 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31696b2 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.271260:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239576448:0@lo:105: 00000100:00100000:0.0:1789395115.271311:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.271357:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.273314:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239576448:0@lo:105: 00010000:00010000:1.0:1789395115.273328:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.273444:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231666944:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 2641us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.273453:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1497 00000100:00100000:1.0:1789395115.279064:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239576576 00000100:00100000:1.0:1789395115.279078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239576576 00000100:00100000:1.0:1789395115.279154:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1789395115.279165:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6512:x1876316239576576:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395115.280697:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6512:x1876316239576576:12345-0@lo:403:mdt00_001.0 Request processed in 1529us (3832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.280708:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00100000:0.0:1789395115.280823:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239576576:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1789395115.281765:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].374, 664 off571216 00000040:00080000:0.0:1789395115.281936:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].371, 744 off620488 00000004:00080000:0.0:1789395115.281942:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca35c3c0 with version 706 00000004:00080000:1.0:1789395115.283093:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 706 rpc_version 706 00000020:00100000:1.0:1789395115.283130:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.283141:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a14e00 x1876316239576832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.283163:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239576832:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395115.283222:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.283290:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.283337:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239576832 00000100:00100000:0.0:1789395115.283345:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239576832 00000100:00100000:0.0:1789395115.283442:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1789395115.283451:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239576832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.283808:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239576832:12345-0@lo:1000:osp_up1-0.0 Request processed in 358us (585us total) trans 4294968375 rc 0/0 00000100:00100000:0.0:1789395115.283817:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:1.0:1789395115.283922:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239576832:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1789395115.283969:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x150c:0x0]: returning size 4096 00010000:00010000:0.0:1789395115.283989:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.283999:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284006:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284012:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.284017:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284025:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284043:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc4:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:0.0:1789395115.284046:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395115.284050:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284056:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31696ab lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284070:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af31696b2 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31696b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284078:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af31696b2 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31696b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284096:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af31696b2 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af31696b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284119:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395115.284129:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc4:0x0] 00010000:00010000:0.0:1789395115.284136:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284142:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284147:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284153:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.284156:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284163:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150c:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:0.0:1789395115.284173:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395115.284176:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284182:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af31696a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284196:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284202:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284209:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284215:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284220:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.284223:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284228:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284234:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c7b89200) 00010000:00010000:0.0:1789395115.284236:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.284239:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284245:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169696 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.284261:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000466bf786 reply state 00000000ee003f86 transno 4294983410 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316969d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284273:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316969d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8f0f038c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.284281:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8f0f038c (ffff89a4c3ab8000) 00010000:00010000:0.0:1789395115.284284:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395115.284286:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395115.284342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17536:x1876316231666688:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 36294us (36426us total) trans 4294983410 rc 0/0 00000100:00100000:0.0:1789395115.284350:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23281 00000100:00100000:1.0:1789395115.284860:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239576960 00000100:00100000:1.0:1789395115.284867:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239576960 00000100:00100000:1.0:1789395115.284905:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1789395115.284913:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3639:x1876316239576960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.284923:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.284940:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af31696b9 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af31696b2 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.284952:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff89a4c875d300) 00010000:00010000:1.0:1789395115.284960:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.284994:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239576960:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.285000:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1789395115.355273:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231667072 00000100:00100000:1.0:1789395115.355282:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231667072 00000100:00100000:1.0:1789395115.355342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23282 00000100:00100000:1.0:1789395115.355351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17537:x1876316231667072:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395115.355370:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.355408:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31696c0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105a8c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355485:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355499:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355511:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355526:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355533:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355539:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355579:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355586:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355592:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355598:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355603:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.355608:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355615:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355626:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1ba00) 00010000:00010000:1.0:1789395115.355629:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.355634:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355641:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696c7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355653:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355659:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355664:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355670:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.355672:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355678:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355685:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb75d5c1a (ffff89a4c3ab8b00) 00010000:00010000:1.0:1789395115.355688:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.355691:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355696:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696ce lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355729:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31696c0 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a8c expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355739:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1ba00) 00010000:00010000:1.0:1789395115.355741:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.355745:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af31696c0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a8c expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.355753:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416800, rc 0) 00000100:00100000:1.0:1789395115.355814:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17537:x1876316231667072:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 464us (647us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395115.355821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23282 00000100:00100000:1.0:1789395115.361173:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.386672:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.386931:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231667712 00000100:00100000:1.0:1789395115.386941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231667712 00000100:00100000:1.0:1789395115.387003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23285 00000100:00100000:1.0:1789395115.387013:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:17540:x1876316231667712:12345-192.168.203.54@tcp:36:mkdir.0 00010000:00010000:1.0:1789395115.387137:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.387154:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.387166:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.387178:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696f8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.387185:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696f8 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.387191:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696f8 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387814:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af31696ff lrc: 3/0,1 mode: --/PW res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387826:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af31696ff lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387834:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af31696ff lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.387848:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf2be0e5 reply state 00000000d59a7598 transno 4294968376 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af31696ff lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387864:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af31696ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387871:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:0.0:1789395115.387874:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395115.387877:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789395115.387882:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00010000:00010000:0.0:1789395115.387890:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387898:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387903:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.387910:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.388246:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.388251:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.388260:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.388272:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8b00) 00010000:00010000:0.0:1789395115.388274:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.388278:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.388289:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af31696f1 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.388306:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf2be0e5 reply state 00000000d59a7598 transno 4294968376 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696f8 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.388315:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af31696f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.388321:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb75d5c1a (ffff89a4c3ab8a00) 00010000:00010000:0.0:1789395115.388324:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395115.388327:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789395115.388427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17540:x1876316231667712:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 1413us (1762us total) trans 4294968376 rc 0/0 00000100:00100000:0.0:1789395115.388435:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23285 00000100:00100000:1.0:1789395115.414742:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.437315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231668096 00000100:00100000:0.0:1789395115.437325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231668096 00000100:00100000:0.0:1789395115.438316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23287 00000100:00100000:0.0:1789395115.438330:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17543:x1876316231668096:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395115.438411:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.438443:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af316971b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105a9a expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438463:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:0.0:1789395115.438468:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395115.438492:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438507:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438515:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438526:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169729 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438533:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169729 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438539:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169729 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438621:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438635:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438641:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.438842:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00010000:00010000:0.0:1789395115.438857:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438864:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438870:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438877:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.438882:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438889:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438897:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:0.0:1789395115.438900:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395115.438903:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438908:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169730 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438923:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438930:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438937:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438942:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438946:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.438949:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438959:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438967:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875d900) 00010000:00010000:0.0:1789395115.438969:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.438971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.438977:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af3169722 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.438991:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d9d5dab reply state 00000000630de8a9 transno 4294968377 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169729 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.439001:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169729 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xb75d5c1a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.439006:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb75d5c1a (ffff89a4c3ab8a00) 00010000:00010000:0.0:1789395115.439009:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395115.439011:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395115.439099:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17543:x1876316231668096:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 771us (1902us total) trans 4294968377 rc 0/0 00000100:00100000:0.0:1789395115.439106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23287 00000100:00100000:0.0:1789395115.463150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.472853:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231668352 00000100:00100000:0.0:1789395115.472864:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231668352 00000100:00100000:0.0:1789395115.472948:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23289 00000100:00100000:0.0:1789395115.472958:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17549:x1876316231668352:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395115.472980:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.473002:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af316974c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105aa8 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.473057:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169753 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.473081:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169753 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.473100:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169753 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.473142:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.473146:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.473181:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af316974c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105aa8 expref: 12 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.473196:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169753 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105aa8 expref: 11 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.473204:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875d900) 00010000:00010000:0.0:1789395115.473208:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.473211:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014400, rc 0) 00000100:00100000:0.0:1789395115.473265:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17549:x1876316231668352:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 308us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.473272:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23289 00000100:00100000:0.0:1789395115.481380:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000004:00080000:1.0:1789395115.489202:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 707 rpc_version 707 00000020:00100000:1.0:1789395115.489253:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.489265:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a14000 x1876316239577216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.489286:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239577216:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395115.489355:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.489433:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.489523:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239577216 00000100:00100000:0.0:1789395115.489532:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239577216 00000100:00100000:0.0:1789395115.489589:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1789395115.489599:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239577216:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.490202:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239577216:12345-0@lo:1000:osp_up1-0.0 Request processed in 603us (845us total) trans 4294968378 rc 0/0 00000100:00100000:0.0:1789395115.490212:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:1.0:1789395115.493244:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239577216:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1789395115.493680:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169768 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x150e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493696:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493707:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493727:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316976f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493734:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316976f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493740:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316976f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493774:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493782:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.493792:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.493820:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239577344:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395115.493878:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.493926:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.493996:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239577344 00000100:00100000:1.0:1789395115.494004:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239577344 00000100:00100000:1.0:1789395115.494052:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1789395115.494072:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:6512:x1876316239577344:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395115.494098:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.494114:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169776 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494135:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169776 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494146:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169776 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494155:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc5:0x0].0x0 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395115.494158:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.494161:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417a00, rc 0) 00000100:00100000:1.0:1789395115.494199:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6512:x1876316239577344:12345-0@lo:101:mdt00_001.0 Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.494205:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1789395115.494234:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239577344:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395115.494247:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494256:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395115.494277:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014928363 reply state 000000007f51d612 transno 4294983411 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316976f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494303:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316976f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494309:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc5:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:1.0:1789395115.494311:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395115.494314:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395115.494319:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494327:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395115.494337:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc5:0x0] 00000004:00010000:1.0:1789395115.494343:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014928363 reply state 000000007f51d612 transno 4294983411 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494351:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169768 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x150e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494356:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150e:0x0].0x0 (ffff89a4c875d800) 00010000:00010000:1.0:1789395115.494359:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395115.494361:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1789395115.494364:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x150e:0x0]: returning size 4096 00010000:00010000:1.0:1789395115.494373:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494379:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494403:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494409:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494415:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.494420:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494428:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494438:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:1.0:1789395115.494440:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.494444:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316975a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395115.494467:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014928363 reply state 000000007f51d612 transno 4294983411 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169761 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494475:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169761 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.494481:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x62d06ae6 (ffff89a4c7b89800) 00010000:00010000:1.0:1789395115.494484:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395115.494486:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1789395115.494545:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17549:x1876316231668608:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 12704us (13174us total) trans 4294983411 rc 0/0 00000100:00100000:1.0:1789395115.494565:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23290 00000100:00100000:0.0:1789395115.527104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231668864 00000100:00100000:0.0:1789395115.527114:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231668864 00000100:00100000:0.0:1789395115.527173:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23291 00000100:00100000:0.0:1789395115.527184:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17550:x1876316231668864:12345-192.168.203.54@tcp:36:mkdir.0 00000100:00100000:0.0:1789395115.527360:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17550:x1876316231668864:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 178us (391us total) trans 0 rc -17/-17 00000100:00100000:0.0:1789395115.527371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23291 00000100:00100000:1.0:1789395115.541279:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231668992 00000100:00100000:1.0:1789395115.541289:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231668992 00000100:00100000:1.0:1789395115.541347:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23292 00000100:00100000:1.0:1789395115.541358:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17551:x1876316231668992:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.541378:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.541420:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af3169784 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105aaf expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541484:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541499:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541510:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541521:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541528:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541535:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541626:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x150e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541639:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x150e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541647:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x150e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395115.541724:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x150e:0x0]: returning size 4096 00000004:00200000:1.0:1789395115.541729:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1789395115.541749:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x150e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541762:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541768:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541774:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541780:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541785:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.541789:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541797:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541808:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:1.0:1789395115.541811:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.541815:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541822:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316978b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541832:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541838:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541844:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541849:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.541852:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541858:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541865:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x62d06ae6 (ffff89a4c7b89800) 00010000:00010000:1.0:1789395115.541868:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.541872:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541878:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af3169792 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x62d06ae6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541901:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af3169784 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105aaf expref: 21 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541922:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x150e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105aaf expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.541929:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150e:0x0].0x0 (ffff89a4c875d800) 00010000:00010000:1.0:1789395115.541932:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395115.541934:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416400, rc 0) 00000100:00100000:1.0:1789395115.541984:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17551:x1876316231668992:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 629us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.541992:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23292 00000100:00100000:0.0:1789395115.552234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231669120 00000100:00100000:0.0:1789395115.552246:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231669120 00000100:00100000:0.0:1789395115.552297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23293 00000100:00100000:0.0:1789395115.552307:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17551:x1876316231669120:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395115.552327:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.552346:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31697a0 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ab6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.552419:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31697a7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.552434:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31697a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.552445:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31697a7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.552493:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc5:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.552498:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.552532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af31697a0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ab6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.552545:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31697a7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ab6 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.552553:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc5:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395115.552557:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.552560:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:0.0:1789395115.552625:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17551:x1876316231669120:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 318us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.552632:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23293 00000100:00100000:1.0:1789395115.555697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231669248 00000100:00100000:1.0:1789395115.555707:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231669248 00000100:00100000:1.0:1789395115.555769:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23294 00000100:00100000:1.0:1789395115.555778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17551:x1876316231669248:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.555794:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.555810:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af31697ae lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105abd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.555866:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.555879:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169776 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.555887:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.555919:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169776 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.555934:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239577472:0@lo:104: 00000100:00100000:1.0:1789395115.555983:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.556063:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ae40 going to sleep for 11 seconds 00010000:00010000:0.0:1789395115.556249:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395115.556255:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.556263:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395115.556268:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.556276:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.556301:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.556307:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395115.556335:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.556348:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015600/0xff35729af3169776 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316977d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.556365:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.556367:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.556368:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395115.556416:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395115.556426:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239577600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395115.556455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.556483:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239577600 00000100:00100000:1.0:1789395115.556487:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239577600 00010000:00010000:1.0:1789395115.556504:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169776 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.556526:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1789395115.556532:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3638:x1876316239577600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.556541:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1789395115.560325:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968378 is committed 00000001:00080000:1.0:1789395115.560356:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968377 is committed 00000020:00080000:1.0:1789395115.560366:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 367 batchid updated 00000020:00080000:0.0:1789395115.560418:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 367 00000004:00080000:0.0:1789395115.560475:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35c6c0 with version 705 00010000:00010000:1.0:1789395115.560480:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af316977d lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169776 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395115.560486:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 367 cancel update log [0x200000401:0x3:0x0].368: rc = 0 00010000:00010000:1.0:1789395115.560495:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc5:0x0].0x0 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395115.560499:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.560507:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.560518:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.560539:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1789395115.560566:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 367 cancel update log [0x240000400:0x3:0x0].369: rc = 0 00000020:00080000:0.0:1789395115.560574:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 367 00000004:00080000:0.0:1789395115.560583:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 705 rpc_version 705 00000020:00100000:0.0:1789395115.560611:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.560615:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239577600:12345-0@lo:103:ldlm_bl.0 Request processed in 4081us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.560618:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4cbfe7480 x1876316239577856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.560623:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1789395115.560638:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239577856:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395115.560676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239577600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395115.560677:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.560697:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.560702:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239577856 00000100:00100000:1.0:1789395115.560708:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239577856 00000100:00100000:1.0:1789395115.560756:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:1.0:1789395115.560764:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239577856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395115.560873:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239577856:12345-0@lo:1000:osp_up0-1.0 Request processed in 109us (195us total) trans 4294983412 rc 0/0 00000100:00100000:1.0:1789395115.560881:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:0.0:1789395115.561052:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239577856:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.589928:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231669760 00000100:00100000:0.0:1789395115.589937:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231669760 00010000:00010000:0.0:1789395115.589973:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105abd expref: 8 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.590009:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1500 00000100:00100000:0.0:1789395115.590018:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231669760:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.590032:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.590040:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105abd expref: 8 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.590052:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af31697b5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105abd expref: 8 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.590072:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc5:0x0].0x0 (ffff89a4c3ab8200) 00010000:00010000:0.0:1789395115.590079:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31697df lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af31697d8 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.590104:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31697df lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af31697d8 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.590113:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31697df lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af31697d8 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.590144:0:8441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af31697df lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31697d8 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.590158:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8441:1876316239578368:0@lo:105: 00000100:00100000:0.0:1789395115.590199:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.590239:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.590790:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8441:1876316239578368:0@lo:105: 00010000:00010000:1.0:1789395115.590802:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.590841:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231669760:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 824us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.590848:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1500 00000100:00100000:0.0:1789395115.590910:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968378 gen 2 00000004:00080000:0.0:1789395115.590915:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968375 committed transno 4294968378 00000004:00080000:0.0:1789395115.590928:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968378 committed transno 4294968378 00000100:00100000:0.0:1789395115.590963:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239578112:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395115.590979:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.591813:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239578496:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1789395115.592298:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.592366:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.600158:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239578496 00000100:00100000:1.0:1789395115.600172:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239578496 00000100:00100000:1.0:1789395115.600255:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1789395115.600265:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6511:x1876316239578496:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1789395115.606437:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6511:x1876316239578496:12345-0@lo:403:mdt00_000.0 Request processed in 6165us (14130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.606452:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1789395115.606514:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239578496:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1789395115.607639:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].376, 664 off574048 00000040:00080000:0.0:1789395115.607790:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].374, 744 off625704 00000004:00080000:0.0:1789395115.607796:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca35c3c0 with version 708 00000004:00080000:1.0:1789395115.608349:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 708 rpc_version 708 00000020:00100000:1.0:1789395115.608405:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395115.608416:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a14000 x1876316239578752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395115.608441:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239578752:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395115.608500:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.608535:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.609321:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239578752:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1789395115.610004:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395115.610009:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.610016:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395115.610020:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.610028:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.610122:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.610133:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789395115.610182:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239578880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395115.610224:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395115.610280:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.610290:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af31697d8 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af31697df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.610306:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.610308:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.610310:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395115.610918:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239578880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395115.635021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231669888 00000100:00100000:0.0:1789395115.635032:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231669888 00000100:00100000:0.0:1789395115.635152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23296 00000100:00100000:0.0:1789395115.635164:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17552:x1876316231669888:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395115.635185:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.635204:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af31697e6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ac4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635270:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635284:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635296:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635309:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635317:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635323:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635366:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635374:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635381:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635435:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635441:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.635445:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635452:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635464:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875d900) 00010000:00010000:0.0:1789395115.635467:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.635472:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635479:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af31697ed lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635493:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635499:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635504:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635509:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.635511:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635517:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635525:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x82528618 (ffff89a4c875df00) 00010000:00010000:0.0:1789395115.635528:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.635531:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af31697f4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635577:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af31697e6 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ac4 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635588:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875d900) 00010000:00010000:0.0:1789395115.635590:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.635595:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af31697e6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ac4 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.635604:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:0.0:1789395115.635657:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17552:x1876316231669888:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 495us (760us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395115.635665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23296 00000100:00100000:0.0:1789395115.642585:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231670016 00000100:00100000:0.0:1789395115.642595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231670016 00000100:00100000:0.0:1789395115.642653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23297 00000100:00100000:0.0:1789395115.642663:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17552:x1876316231670016:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395115.642689:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.642713:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31697fb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105acb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.642778:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169802 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.642792:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169802 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.642804:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169802 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.642849:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.642854:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.642887:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af31697fb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105acb expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.642904:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af3169802 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105acb expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.642912:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c875df00) 00010000:00010000:0.0:1789395115.642915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.642918:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:0.0:1789395115.642979:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17552:x1876316231670016:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 317us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.642986:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23297 00000100:00100000:0.0:1789395115.656153:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.656223:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231670272 00000100:00100000:1.0:1789395115.656233:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231670272 00000100:00100000:1.0:1789395115.656290:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23298 00000100:00100000:1.0:1789395115.656301:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17552:x1876316231670272:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395115.656356:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.656381:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169753 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105aa8 expref: 7 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.656433:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c875d900) 00010000:00010000:1.0:1789395115.656445:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395115.656520:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169809 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.656533:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169809 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.656543:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169809 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.656567:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x82528618 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.656576:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.656582:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395115.657885:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].371, 2168 off563008 00000040:00080000:1.0:1789395115.657963:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].370, 2368 off614552 00000004:00080000:1.0:1789395115.657969:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca06a180 with version 706 00000004:00080000:0.0:1789395115.658055:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 706 rpc_version 706 00000020:00100000:0.0:1789395115.658101:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395115.658112:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4cbfe7100 x1876316239579136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395115.658136:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239579136:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.658205:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.658271:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395115.658640:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239579136 00000100:00100000:1.0:1789395115.658648:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239579136 00000100:00100000:1.0:1789395115.658697:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:1.0:1789395115.658706:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239579136:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395115.659167:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7455:x1876316239579136:12345-0@lo:1000:osp_up0-1.0 Request processed in 461us (960us total) trans 4294983414 rc 0/0 00000100:00100000:1.0:1789395115.659175:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1789395115.659422:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239579136:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395115.660307:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660324:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660335:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660352:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660359:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660366:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660419:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660426:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.660435:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.660454:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239579264:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1789395115.660509:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395115.660667:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.714124:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.714261:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231670528 00000100:00100000:1.0:1789395115.714272:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231670528 00000100:00100000:1.0:1789395115.714334:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23299 00000100:00100000:1.0:1789395115.714345:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17553:x1876316231670528:12345-192.168.203.54@tcp:36:mkdir.0 00000100:00100000:1.0:1789395115.714562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17553:x1876316231670528:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 218us (446us total) trans 0 rc -17/-17 00000100:00100000:1.0:1789395115.714570:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23299 00000100:00100000:1.0:1789395115.740168:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231670656 00000100:00100000:1.0:1789395115.740180:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231670656 00000100:00100000:1.0:1789395115.740257:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23300 00000100:00100000:1.0:1789395115.740269:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17554:x1876316231670656:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395115.740289:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.740312:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169833 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ad2 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740376:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740418:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740430:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740443:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740450:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740456:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740535:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af3169848 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740545:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af3169848 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740563:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af3169848 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395115.740638:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17f:0x0]: returning size 4096 00000004:00200000:1.0:1789395115.740643:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1789395115.740662:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af3169848 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740674:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740680:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740686:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740693:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740704:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.740709:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740717:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740729:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395115.740733:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.740737:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740744:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416000/0xff35729af316983a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740756:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740762:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740768:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740773:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395115.740776:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740782:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740790:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x82528618 (ffff89a4c7eb6000) 00010000:00010000:1.0:1789395115.740793:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395115.740796:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740802:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169841 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740832:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169833 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ad2 expref: 10 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740853:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af3169848 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ad2 expref: 9 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.740861:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17f:0x0].0x0 (ffff89a4c7eb6e00) 00010000:00010000:1.0:1789395115.740863:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395115.740865:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417c00, rc 0) 00000100:00100000:1.0:1789395115.740930:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17554:x1876316231670656:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 664us (7080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.740942:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23300 00000100:00100000:0.0:1789395115.747065:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231670784 00000100:00100000:0.0:1789395115.747076:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231670784 00000100:00100000:0.0:1789395115.747152:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23301 00000100:00100000:0.0:1789395115.747162:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17554:x1876316231670784:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395115.747183:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.747204:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316984f lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ad9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.747262:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af3169856 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.747278:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af3169856 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.747289:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af3169856 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.747340:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xc3:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.747345:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.747380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316984f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ad9 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.748269:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af3169856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ad9 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.748278:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc3:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:0.0:1789395115.748282:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.748285:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014a00, rc 0) 00000100:00100000:0.0:1789395115.748349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17554:x1876316231670784:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 1188us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.748356:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23301 00000100:00100000:0.0:1789395115.756480:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231670912 00000100:00100000:0.0:1789395115.756490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231670912 00000100:00100000:0.0:1789395115.756567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23302 00000100:00100000:0.0:1789395115.756577:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17554:x1876316231670912:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395115.756596:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.756616:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316985d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ae0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.756686:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.756700:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316982c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169825 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.756709:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.756742:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316982c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169825 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.756757:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239579392:0@lo:104: 00000100:00100000:0.0:1789395115.756803:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.756847:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.756869:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239579392 00000100:00100000:0.0:1789395115.756872:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239579392 00000100:00100000:0.0:1789395115.756900:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1789395115.756907:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239579392:12345-0@lo:104: 00010000:00010000:0.0:1789395115.756920:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.756967:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395115.756973:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239579392:12345-0@lo:104: Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.756979:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00010000:00010000:0.0:1789395115.757003:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395115.757009:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.757018:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395115.757023:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.757032:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.757057:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.757063:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395115.757093:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.757101:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316982c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.757118:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.757120:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.757122:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395115.757133:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239579520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395115.757162:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.757196:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239579520 00000100:00100000:0.0:1789395115.757200:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239579520 00010000:00010000:0.0:1789395115.757216:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316982c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169825 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.757239:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1789395115.757245:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3637:x1876316239579520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.757255:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789395115.758048:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239579392:0@lo:104: 00010000:00010000:0.0:1789395115.758066:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395115.763794:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983414 is committed 00000001:00080000:1.0:1789395115.763829:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983413 is committed 00000020:00080000:1.0:1789395115.763841:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c9b9c780 refcount 2 committed 0 result 0 batchid 375 00000020:00080000:1.0:1789395115.763846:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9cb40 00000020:00080000:1.0:1789395115.763850:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].373 00000020:00080000:1.0:1789395115.763853:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c922f400 00000020:00080000:1.0:1789395115.763856:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].375 00000020:00080000:1.0:1789395115.763868:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca35c540 refcount 2 committed 0 result 0 batchid 374 00000020:00080000:1.0:1789395115.763871:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca35c3c0 00000020:00080000:1.0:1789395115.763874:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].371 00000020:00080000:1.0:1789395115.763876:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82d2200 00000020:00080000:1.0:1789395115.763878:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].374 00000020:00080000:1.0:1789395115.763883:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 372 batchid updated 00000020:00080000:1.0:1789395115.763891:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca06a0c0 refcount 2 committed 0 result 0 batchid 373 00000020:00080000:1.0:1789395115.763893:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca06a3c0 00000020:00080000:1.0:1789395115.763895:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].370 00000020:00080000:1.0:1789395115.763897:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7bb5200 00000020:00080000:1.0:1789395115.763900:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].373 00000020:00080000:1.0:1789395115.763922:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 375 committed batchid 372 00000004:00080000:1.0:1789395115.764044:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca06a480 with version 709 00000020:00080000:1.0:1789395115.764052:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 372 cancel update log [0x240000401:0x3:0x0].369: rc = 0 00000020:00080000:1.0:1789395115.764104:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 372 cancel update log [0x200000400:0x3:0x0].372: rc = 0 00000020:00080000:1.0:1789395115.764110:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 372 00010000:00010000:1.0:1789395115.765660:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316982c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169825 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.765677:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:1.0:1789395115.765682:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.765690:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.765697:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.765724:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.765798:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239579520:12345-0@lo:103:ldlm_bl.0 Request processed in 8551us (8634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.765807:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000004:00080000:0.0:1789395115.765948:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 709 rpc_version 709 00000020:00100000:0.0:1789395115.765981:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395115.765989:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4cbfe5180 x1876316239579776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395115.766007:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239579776:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.766046:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.767665:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.767714:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239579520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395115.769051:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239579776 00000100:00100000:1.0:1789395115.769062:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239579776 00000100:00100000:0.0:1789395115.770128:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239579776:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.772750:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.781134:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:1.0:1789395115.784836:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af3169856 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ad9 expref: 9 pid: 6511 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.784860:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239579904:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395115.784885:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af3169880 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.785304:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239580032 00000100:00100000:1.0:1789395115.785310:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239580032 00000100:00100000:1.0:1789395115.785422:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:1.0:1789395115.785431:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f7837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7813:x1876316239580032:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395115.785447:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395115.785461:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316988e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169887 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.785486:0:17997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ae0 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.785495:0:17997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316988e lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169887 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.785518:0:17997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ae0 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.785532:0:17997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ae0 expref: 14 pid: 6513 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.785543:0:17997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:17997:1876316239580160:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395115.785610:0:17997:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.790212:0:7813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983414 gen 2 00000004:00080000:0.0:1789395115.790219:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983407 committed transno 4294983414 00000020:00080000:0.0:1789395115.790224:0:7813:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca31b600 refcount 2 committed 0 result 0 batchid 368 00000020:00080000:0.0:1789395115.790228:0:7813:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca31b9c0 00000020:00080000:0.0:1789395115.790232:0:7813:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].369 00000020:00080000:0.0:1789395115.790235:0:7813:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c83c3200 00000020:00080000:0.0:1789395115.790238:0:7813:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].370 00000004:00080000:0.0:1789395115.790265:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983409 committed transno 4294983414 00000004:00080000:0.0:1789395115.790278:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983412 committed transno 4294983414 00000004:00080000:0.0:1789395115.790285:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983414 committed transno 4294983414 00000100:00100000:0.0:1789395115.790299:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239580032:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789395115.790319:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.790330:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395115.793179:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395115.798998:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239580416 00000100:00100000:1.0:1789395115.799005:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239580416 00000100:00100000:1.0:1789395115.799119:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:1.0:1789395115.799128:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7813:x1876316239580416:12345-0@lo:403:mdt00_003.0 00000004:00080000:0.0:1789395115.807330:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 707 rpc_version 707 00000020:00100000:0.0:1789395115.807361:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395115.807370:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4cbfe7100 x1876316239580672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395115.807413:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239580672:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.807483:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.807510:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.813146:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239580672:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1789395115.816034:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395115.816042:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.816049:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344c00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395115.816053:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.816061:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.816108:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.816115:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395115.816275:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.816284:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169887 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316988e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.816299:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.816300:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.816302:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395115.817684:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239580800 00000100:00100000:1.0:1789395115.817695:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239580800 00000100:00100000:1.0:1789395115.817748:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1789395115.817758:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3638:x1876316239580800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395115.817773:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395115.817794:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316988e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169887 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395115.817809:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:1.0:1789395115.817819:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395115.822862:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239580800:12345-0@lo:103:ldlm_bl.0 Request processed in 5095us (6629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395115.822877:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1789395115.855916:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000004:00080000:0.0:1789395115.878874:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 710 rpc_version 710 00000020:00100000:0.0:1789395115.878906:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395115.878913:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4cbfe6a00 x1876316239581056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395115.878930:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239581056:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.878985:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.879033:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.879869:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239581056:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395115.912158:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.941839:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.968755:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231672448 00000100:00100000:0.0:1789395115.968765:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231672448 00000100:00100000:0.0:1789395115.968856:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23309 00000100:00100000:0.0:1789395115.968876:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17557:x1876316231672448:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395115.968897:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395115.968919:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31698fe lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105afc expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.968974:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af3169905 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.968988:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af3169905 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.969000:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af3169905 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395115.969047:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc6:0x0]: returning size 4096 00000004:00200000:0.0:1789395115.969052:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395115.969097:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af31698fe lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105afc expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.969115:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af3169905 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105afc expref: 17 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.969123:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc6:0x0].0x0 (ffff89a4c7b89f00) 00010000:00010000:0.0:1789395115.969126:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395115.969129:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015a00, rc 0) 00000100:00100000:0.0:1789395115.969209:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17557:x1876316231672448:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 343us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.969216:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23309 00000100:00100000:0.0:1789395115.981140:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395115.981631:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789395115.981643:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239581312 00000100:00100000:0.0:1789395115.981647:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239581312 00000100:00100000:0.0:1789395115.981682:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1789395115.981689:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c7428850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239581312:12345-0@lo:104: 00010000:00010000:0.0:1789395115.981702:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.981759:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395115.981765:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c7428850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239581312:12345-0@lo:104: Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.981771:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00010000:00010000:0.0:1789395115.981808:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395115.981814:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.981821:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395115.981826:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395115.981834:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.981859:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.981864:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395115.981891:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.981904:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af31698d4 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af31698db expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.981923:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.981925:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395115.981927:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395115.981950:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239581440 00000100:00100000:0.0:1789395115.981954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239581440 00010000:00010000:0.0:1789395115.981972:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31698db lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af31698d4 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395115.982000:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1789395115.982008:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239581440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395115.982018:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395115.986049:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986060:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986067:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986073:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.986088:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986097:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986118:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x82528618 (ffff89a4c7eb6000) 00010000:00010000:0.0:1789395115.986121:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.986125:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986359:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169810 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986375:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986406:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986414:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986420:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.986423:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986430:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986440:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17f:0x0].0x0 (ffff89a4c7eb6e00) 00010000:00010000:0.0:1789395115.986444:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.986447:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986454:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417000/0xff35729af3169817 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986475:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986481:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986486:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986490:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.986502:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986508:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986514:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc3:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:0.0:1789395115.986516:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.986519:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986525:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af316981e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986540:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986546:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986552:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986558:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395115.986561:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986576:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986583:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x82528618 (ffff89a4c7eb6000) 00010000:00010000:0.0:1789395115.986585:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395115.986588:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986593:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de600/0xff35729af3169872 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x82528618 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986663:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af31698db lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af31698d4 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986673:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff89a3ca2fbb00) 00010000:00010000:0.0:1789395115.986862:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169913 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986873:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169913 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986881:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169913 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395115.986942:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395115.987025:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239581440:12345-0@lo:103:ldlm_bl.0 Request processed in 5017us (5088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395115.987036:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000004:00080000:0.0:1789395115.987075:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 708 rpc_version 708 00000020:00100000:0.0:1789395115.987125:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395115.987142:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4cbfe5500 x1876316239581696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395115.987180:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239581696:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.987220:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395115.987254:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395115.987290:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239581696 00000100:00100000:0.0:1789395115.987296:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239581696 00000100:00100000:0.0:1789395115.987334:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1789395115.987341:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7455:x1876316239581696:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395115.987509:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239581696:12345-0@lo:1000:osp_up0-1.0 Request processed in 167us (289us total) trans 4294983417 rc 0/0 00000100:00100000:0.0:1789395115.987515:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1789395115.987555:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239581696:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395116.007723:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.023345:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.025025:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239581952 00000100:00100000:1.0:1789395116.025032:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239581952 00000100:00100000:1.0:1789395116.025100:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:1.0:1789395116.025110:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6513:x1876316239581952:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395116.025130:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.025146:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316993d lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169936 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.025353:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169913 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b03 expref: 7 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.025365:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316993d lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169936 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.043097:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.044627:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968383 gen 2 00000004:00080000:0.0:1789395116.044633:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968379 committed transno 4294968383 00000020:00080000:0.0:1789395116.044639:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca35c600 refcount 2 committed 0 result 0 batchid 376 00000020:00080000:0.0:1789395116.044643:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca35c3c0 00000020:00080000:0.0:1789395116.044646:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].374 00000020:00080000:0.0:1789395116.044649:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82d3600 00000020:00080000:0.0:1789395116.044653:0:6513:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].376 00000004:00080000:0.0:1789395116.044670:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968381 committed transno 4294968383 00000004:00080000:0.0:1789395116.044680:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968383 committed transno 4294968383 00000100:00100000:0.0:1789395116.044695:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239581952:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395116.044708:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.044718:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789395116.044789:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 376 committed batchid 372 00000020:00080000:1.0:1789395116.044840:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 372 00000100:00100000:1.0:1789395116.045997:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239582208 00000100:00100000:1.0:1789395116.046004:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239582208 00000100:00100000:1.0:1789395116.046043:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1789395116.046051:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8441:x1876316239582208:12345-0@lo:105: 00010000:00010000:1.0:1789395116.046062:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.046071:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.046092:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.046100:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.046107:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.046116:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.046138:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3c9345200) 00000100:00100000:1.0:1789395116.046177:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8441:x1876316239582208:12345-0@lo:105: Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.046184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00010000:00010000:0.0:1789395116.046257:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.046267:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345200/0xff35729af3169936 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316993d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.048143:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac41880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239582336:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395116.048206:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.048236:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.048262:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239582336 00000100:00100000:0.0:1789395116.048268:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239582336 00000100:00100000:0.0:1789395116.048308:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1789395116.048316:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239582336:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395116.056736:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239582336:12345-0@lo:403:mdt00_002.0 Request processed in 8409us (8519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.056752:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000040:00080000:1.0:1789395116.073242:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].378, 664 off576880 00000040:00080000:1.0:1789395116.073444:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].376, 744 off628816 00000004:00080000:1.0:1789395116.073453:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca06ab40 with version 711 00000004:00080000:0.0:1789395116.077093:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 711 rpc_version 711 00000020:00100000:0.0:1789395116.077135:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395116.077145:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3cac42d80 x1876316239582592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1704/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395116.077169:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac42d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239582592:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395116.077231:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.077267:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.082048:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239582720 00000100:00100000:0.0:1789395116.082116:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239582720 00000100:00100000:0.0:1789395116.082170:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1789395116.082179:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1876316239582720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395116.082193:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395116.082211:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316993d lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169936 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.082224:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff89a3ca2fbb00) 00010000:00010000:0.0:1789395116.082233:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395116.082312:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239582720:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.082318:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1789395116.123033:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.129691:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.142930:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231673600 00000100:00100000:1.0:1789395116.142941:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231673600 00000100:00100000:1.0:1789395116.142999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23314 00000100:00100000:1.0:1789395116.143010:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17558:x1876316231673600:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395116.143065:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395116.143101:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dec00/0xff35729af31698b1 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105aee expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.143118:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:1.0:1789395116.143127:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395116.143192:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.143205:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.143214:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.143226:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.143233:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.143239:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:02000000:1.0:1789395116.143761:0:6513:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:1.0:1789395116.143777:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca06a480 with version 0 00000020:00080000:1.0:1789395116.143782:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca06ac00 refcount 3 committed 0 result -5 batchid 372 00000020:00080000:1.0:1789395116.143786:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -5 sub_th ffff89a3ca06a480 00000020:00080000:1.0:1789395116.143790:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120d00 obd lustre-MDT0001-osd committed 1 started 0 stopped 1 result 0 sub_th ffff89a3c91c0800 00010000:00010000:1.0:1789395116.144144:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144153:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144160:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144167:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144173:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.144177:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144184:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144194:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395116.144196:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.144200:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144205:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169967 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144220:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144225:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144230:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144235:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.144238:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144244:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144251:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xed2251f3 (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395116.144253:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.144256:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.144263:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316996e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.144814:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:17558:x1876316231673600:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 1803us (2293us total) trans 0 rc -5/-5 00000100:00100000:1.0:1789395116.144822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23314 00000100:00100000:0.0:1789395116.212191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.212295:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231673984 00000100:00100000:1.0:1789395116.212304:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231673984 00000100:00100000:1.0:1789395116.212373:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23316 00000100:00100000:1.0:1789395116.212397:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17561:x1876316231673984:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395116.212420:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.212443:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316998a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b18 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212876:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212891:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212903:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212914:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212922:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212929:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.212999:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af316999f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x182:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213008:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af316999f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213014:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af316999f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395116.213055:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x182:0x0]: returning size 4096 00000004:00200000:1.0:1789395116.213059:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395116.213087:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af316999f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213104:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213110:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213116:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213123:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213128:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.213132:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213140:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213152:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395116.213156:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.213160:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213166:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169991 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213178:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213183:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213189:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213194:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.213196:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213201:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213208:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xed2251f3 (ffff89a3c9b1be00) 00010000:00010000:1.0:1789395116.213210:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.213213:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213219:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169998 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213244:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316998a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b18 expref: 10 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213262:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af316999f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b18 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.213270:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff89a3c9b1bd00) 00010000:00010000:1.0:1789395116.213273:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395116.213276:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416800, rc 0) 00000100:00100000:1.0:1789395116.213327:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17561:x1876316231673984:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 945us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.213336:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23316 00000100:00100000:0.0:1789395116.234104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231674240 00000100:00100000:0.0:1789395116.234114:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231674240 00000100:00100000:0.0:1789395116.234170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23317 00000100:00100000:0.0:1789395116.234180:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17561:x1876316231674240:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395116.234231:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395116.234258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416800/0xff35729af316999f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b18 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234275:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff89a3c9b1bd00) 00010000:00010000:0.0:1789395116.234281:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395116.234307:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234320:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234329:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234341:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af31699ad lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234349:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af31699ad lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234355:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af31699ad lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234459:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x182:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234468:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234475:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395116.234662:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x182:0x0]: returning size 4096 00010000:00010000:0.0:1789395116.234677:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234684:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234691:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234697:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.234701:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234708:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234716:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff89a3c9b1bd00) 00010000:00010000:0.0:1789395116.234719:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395116.234723:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234729:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af31699b4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234743:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234749:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234754:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234761:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234766:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.234769:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234775:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234781:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1da00) 00010000:00010000:0.0:1789395116.234783:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395116.234785:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234791:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af31699a6 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.234803:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053e6f3bc reply state 000000004fbab869 transno 4294968386 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af31699ad lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234813:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af31699ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xed2251f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.234818:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xed2251f3 (ffff89a3c9b1be00) 00010000:00010000:0.0:1789395116.234820:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.234822:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395116.234888:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17561:x1876316231674240:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 708us (875us total) trans 4294968386 rc 0/0 00000100:00100000:0.0:1789395116.234896:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23317 00000100:00100000:1.0:1789395116.294768:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231674368 00000100:00100000:1.0:1789395116.294780:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231674368 00000100:00100000:1.0:1789395116.294845:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23318 00000100:00100000:1.0:1789395116.294856:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17566:x1876316231674368:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395116.294877:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.294898:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699bb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b1f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.294962:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.294977:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.294988:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295001:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295008:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295014:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295065:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295084:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295090:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295096:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295102:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.295106:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295113:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295124:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b200) 00010000:00010000:1.0:1789395116.295127:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.295132:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295138:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af31699c2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295151:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295157:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295163:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295168:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.295171:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295175:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295182:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x63ac40ed (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395116.295184:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.295186:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295191:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699c9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295221:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699bb lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b1f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295231:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c9b1b200) 00010000:00010000:1.0:1789395116.295234:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.295237:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699bb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b1f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.295245:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416600, rc 0) 00000100:00100000:1.0:1789395116.295305:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17566:x1876316231674368:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 451us (1010us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395116.295312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23318 00000100:00100000:1.0:1789395116.304261:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.313579:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.315907:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239582976 00000100:00100000:1.0:1789395116.315916:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239582976 00000100:00100000:1.0:1789395116.315966:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:1.0:1789395116.315978:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239582976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395116.316874:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239582976:12345-0@lo:1000:osp_up1-0.0 Request processed in 835us (970us total) trans 4294968387 rc 0/0 00000100:00100000:1.0:1789395116.316886:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00010000:00010000:1.0:1789395116.317211:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317226:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317235:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317252:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317258:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317264:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317293:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317301:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.317314:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.317329:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239583104:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1789395116.317362:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.318506:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395116.318533:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239583104:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395116.318563:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.318581:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395116.318931:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa9a8c8 reply state 0000000059cdaebc transno 4294983419 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.318947:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.318954:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395116.318957:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395116.318960:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395116.318966:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.318973:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395116.318988:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc7:0x0] 00000004:00010000:1.0:1789395116.318995:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa9a8c8 reply state 0000000059cdaebc transno 4294983419 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319002:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319009:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1512:0x0].0x0 (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395116.319011:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395116.319014:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1789395116.319018:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1512:0x0]: returning size 4096 00010000:00010000:1.0:1789395116.319027:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319033:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319039:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319045:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319050:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.319054:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319061:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319070:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb500) 00010000:00010000:1.0:1789395116.319073:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.319087:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319093:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df800/0xff35729af31699de lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395116.319111:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa9a8c8 reply state 0000000059cdaebc transno 4294983419 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319120:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.319126:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x63ac40ed (ffff89a3ca2fb900) 00010000:00010000:1.0:1789395116.319128:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395116.319131:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1789395116.319210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17566:x1876316231674752:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 5463us (5643us total) trans 4294983419 rc 0/0 00000100:00100000:1.0:1789395116.319219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23320 00000100:00100000:0.0:1789395116.373126:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.412245:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.422901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231675264 00000100:00100000:1.0:1789395116.422914:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231675264 00000100:00100000:1.0:1789395116.423012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23323 00000100:00100000:1.0:1789395116.423024:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17572:x1876316231675264:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395116.423046:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.423068:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169a24 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.423141:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af3169a2b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.423161:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af3169a2b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.423171:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af3169a2b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395116.423222:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc7:0x0]: returning size 4096 00000004:00200000:1.0:1789395116.423227:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395116.423266:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169a24 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b34 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.423282:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af3169a2b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b34 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.423291:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395116.423294:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395116.423299:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416000, rc 0) 00000100:00100000:1.0:1789395116.423369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17572:x1876316231675264:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 347us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.423376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23323 00000100:00100000:0.0:1789395116.440780:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231675392 00000100:00100000:0.0:1789395116.440795:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231675392 00000100:00100000:0.0:1789395116.440882:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23324 00000100:00100000:0.0:1789395116.440892:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17572:x1876316231675392:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395116.440913:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395116.440933:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169a32 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b3b expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.440991:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169a39 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441007:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af3169a01 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af31699fa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441017:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169a39 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441054:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af3169a01 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af31699fa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.441070:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239583232:0@lo:104: 00000100:00100000:0.0:1789395116.441140:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.441187:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.441209:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239583232 00000100:00100000:0.0:1789395116.441213:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239583232 00000100:00100000:0.0:1789395116.441250:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1789395116.441257:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239583232:12345-0@lo:104: 00010000:00010000:0.0:1789395116.441269:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441317:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395116.441324:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239583232:12345-0@lo:104: Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.441331:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00010000:00010000:0.0:1789395116.441354:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395116.441360:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441368:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395116.441374:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.441400:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441426:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441432:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395116.441452:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441460:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416200/0xff35729af31699fa lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.441479:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395116.441481:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395116.441482:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395116.441495:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239583360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395116.441524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.441570:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239583232:0@lo:104: 00010000:00010000:0.0:1789395116.441588:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169a39 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395116.456444:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968387 is committed 00000001:00080000:0.0:1789395116.456469:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968386 is committed 00000020:00080000:0.0:1789395116.456479:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 370 batchid updated 00000020:00080000:1.0:1789395116.457074:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 370 00000004:00080000:1.0:1789395116.457149:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c9b9c3c0 with version 709 00000020:00080000:1.0:1789395116.457161:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 370 cancel update log [0x200000401:0x3:0x0].370: rc = 0 00000020:00080000:1.0:1789395116.457243:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 370 cancel update log [0x240000400:0x3:0x0].371: rc = 0 00000020:00080000:1.0:1789395116.457251:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 370 00000004:00080000:1.0:1789395116.457259:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 709 rpc_version 709 00000020:00100000:1.0:1789395116.457293:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395116.457304:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a15880 x1876316239583616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395116.457326:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239583616:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395116.457414:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.457444:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395116.460298:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239583616 00000100:00100000:1.0:1789395116.460307:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239583616 00000100:00100000:1.0:1789395116.460374:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:1.0:1789395116.460408:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239583616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395116.460792:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239583360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395116.461375:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239583616:12345-0@lo:1000:osp_up0-1.0 Request processed in 990us (3958us total) trans 4294983420 rc 0/0 00000100:00100000:1.0:1789395116.461411:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1789395116.470231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.477867:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.491892:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.491962:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231675904 00000100:00100000:1.0:1789395116.491972:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231675904 00010000:00010000:1.0:1789395116.492012:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169a39 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b3b expref: 8 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.492058:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1509 00000100:00100000:1.0:1789395116.492072:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231675904:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395116.492097:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395116.492106:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169a39 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b3b expref: 8 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.492119:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169a39 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b3b expref: 8 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.492141:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc7:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:1.0:1789395116.492148:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af3169a63 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169a5c expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.492159:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af3169a63 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169a5c expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.492167:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af3169a63 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169a5c expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.492202:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af3169a63 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169a5c expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.492216:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239584128:0@lo:105: 00000100:00100000:1.0:1789395116.492262:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.492294:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395116.494131:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968387 gen 2 00000004:00080000:1.0:1789395116.494137:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968384 committed transno 4294968387 00000004:00080000:1.0:1789395116.494153:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968387 committed transno 4294968387 00000100:00100000:1.0:1789395116.494167:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239583872:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395116.494184:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.496535:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239584256:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1789395116.499329:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.499374:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.499526:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239584256 00000100:00100000:0.0:1789395116.499535:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239584256 00000100:00100000:0.0:1789395116.499599:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1789395116.499609:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239584256:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1789395116.503846:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6513:x1876316239584256:12345-0@lo:403:mdt00_002.0 Request processed in 4230us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.503860:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000004:00080000:0.0:1789395116.506676:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 713 rpc_version 713 00000020:00100000:0.0:1789395116.506709:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395116.506719:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3cac40a80 x1876316239584512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395116.506741:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239584512:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395116.506809:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.506835:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395116.507604:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239584512:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1789395116.509410:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395116.509417:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.509424:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395116.509429:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395116.509436:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.509467:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.509474:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395116.509495:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.509502:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169a5c lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169a63 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.509517:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395116.509519:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395116.509520:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395116.540317:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.540379:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231676032 00000100:00100000:1.0:1789395116.540413:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231676032 00000100:00100000:1.0:1789395116.540482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23326 00000100:00100000:1.0:1789395116.540493:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17573:x1876316231676032:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395116.540512:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.540530:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169a6a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540596:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540610:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540620:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540633:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540640:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540646:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540685:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540692:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540697:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540704:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540710:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.540714:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540722:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540733:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1b900) 00010000:00010000:1.0:1789395116.540736:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.540740:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540747:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169a71 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540761:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540767:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540772:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540777:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.540780:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540786:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540798:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xd1c5f96a (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395116.540800:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.540803:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540809:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169a78 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540838:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169a6a lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b42 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540857:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c9b1b900) 00010000:00010000:1.0:1789395116.540860:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.540863:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416a00/0xff35729af3169a6a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b42 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.540872:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416a00, rc 0) 00000100:00100000:1.0:1789395116.540926:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17573:x1876316231676032:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 435us (618us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395116.540933:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23326 00000100:00100000:0.0:1789395116.549796:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231676160 00000100:00100000:0.0:1789395116.549806:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231676160 00000100:00100000:0.0:1789395116.549875:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23327 00000100:00100000:0.0:1789395116.549887:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17573:x1876316231676160:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395116.549915:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395116.549937:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af3169a7f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b49 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.549999:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169a86 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.550013:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169a86 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.550025:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169a86 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395116.550073:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1789395116.550089:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395116.550126:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af3169a7f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b49 expref: 23 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.550143:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169a86 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b49 expref: 22 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.550151:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1da00) 00010000:00010000:0.0:1789395116.550154:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395116.550158:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014200, rc 0) 00000100:00100000:0.0:1789395116.550219:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17573:x1876316231676160:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 334us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.550226:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23327 00000100:00100000:0.0:1789395116.566037:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.578550:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239584896:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395116.579295:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239585024 00000100:00100000:1.0:1789395116.579302:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239585024 00000100:00100000:1.0:1789395116.579345:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1789395116.579353:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6513:x1876316239585024:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395116.579371:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.579414:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169ab0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169aa9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.579436:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169aa9 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.579448:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169aa9 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.579466:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395116.579469:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.579473:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416a00, rc 0) 00000100:00100000:1.0:1789395116.579512:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6513:x1876316239585024:12345-0@lo:101:mdt00_002.0 Request processed in 159us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.579518:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1789395116.597961:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231676544 00000100:00100000:0.0:1789395116.597972:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231676544 00000100:00100000:0.0:1789395116.598033:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 429 00000100:00100000:0.0:1789395116.598044:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231676544:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395116.598126:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231676544:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.598133:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 429 00000100:00100000:0.0:1789395116.598167:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231676800 00000100:00100000:0.0:1789395116.598171:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231676800 00000100:00100000:0.0:1789395116.598213:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231676672 00000100:00100000:0.0:1789395116.598216:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231676672 00000100:00100000:0.0:1789395116.598236:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 376 00000100:00100000:0.0:1789395116.598242:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231676800:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395116.598272:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231676800:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.598278:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 376 00000100:00100000:0.0:1789395116.598290:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 377 00000100:00100000:0.0:1789395116.598296:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231676672:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395116.598318:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231676672:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 22us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.598324:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 377 00000100:00080000:0.0:1789395116.601594:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789395116.601605:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789395116.641936:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.642010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231677184 00000100:00100000:1.0:1789395116.642020:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231677184 00000100:00100000:1.0:1789395116.642229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23330 00000100:00100000:1.0:1789395116.642240:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17575:x1876316231677184:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395116.642261:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.642285:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ab7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b50 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642350:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642363:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642375:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642422:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642432:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642438:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642528:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169acc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642536:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169acc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x183:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642543:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169acc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x183:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395116.642628:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x183:0x0]: returning size 4096 00000004:00200000:1.0:1789395116.642633:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1789395116.642655:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169acc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x183:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642668:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642674:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642681:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642691:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642696:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.642701:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642708:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642719:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395116.642723:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.642727:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642734:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169abe lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642748:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642754:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642761:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642766:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.642769:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642778:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642785:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xd1c5f96a (ffff89a3ca363400) 00010000:00010000:1.0:1789395116.642787:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.642789:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642794:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417a00/0xff35729af3169ac5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642830:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ab7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b50 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642847:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af3169acc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x183:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b50 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.642854:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x183:0x0].0x0 (ffff89a3ca363a00) 00010000:00010000:1.0:1789395116.642856:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395116.642858:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416400, rc 0) 00000100:00100000:1.0:1789395116.642924:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17575:x1876316231677184:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 685us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.642931:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23330 00000100:00100000:1.0:1789395116.658133:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:1.0:1789395116.682362:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682380:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682414:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682420:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682424:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682432:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682448:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xda636067 (ffff89a4c7b89300) 00010000:00010000:1.0:1789395116.682460:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682464:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682471:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af31698bf lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682487:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682494:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682499:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682505:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682508:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682518:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682526:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff89a4c7b89100) 00010000:00010000:1.0:1789395116.682528:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682531:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682536:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af31698c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682677:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682684:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682689:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682694:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682697:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682702:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682710:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc6:0x0].0x0 (ffff89a4c7b89f00) 00010000:00010000:1.0:1789395116.682712:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682715:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682724:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af31698cd lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682742:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682748:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682753:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682757:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682759:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682765:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682772:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xda636067 (ffff89a4c7b89300) 00010000:00010000:1.0:1789395116.682774:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682777:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682782:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af3169921 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xda636067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682795:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682801:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682807:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682811:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682814:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682819:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682826:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x63ac40ed (ffff89a3ca2fb900) 00010000:00010000:1.0:1789395116.682828:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682831:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682837:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af31699e5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682847:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682852:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682858:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682863:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682866:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682876:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682883:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1512:0x0].0x0 (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395116.682885:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682888:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682894:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af31699ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682906:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682913:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682918:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682922:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682925:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682930:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682937:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395116.682940:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.682943:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682953:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af31699f3 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682966:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682972:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682977:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682982:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395116.682984:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682989:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.682996:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x63ac40ed (ffff89a3ca2fb900) 00010000:00010000:1.0:1789395116.682998:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395116.683001:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.683005:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169a47 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x63ac40ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.693196:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.697975:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239586432:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395116.698007:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.700245:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.707640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.707667:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231677952 00000100:00100000:1.0:1789395116.707675:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231677952 00010000:00010000:1.0:1789395116.707710:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345200/0xff35729af3169ae8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b5e expref: 15 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.707741:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1512 00000100:00100000:1.0:1789395116.707750:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231677952:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395116.707764:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395116.707771:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345200/0xff35729af3169ae8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b5e expref: 15 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.707782:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345200/0xff35729af3169ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b5e expref: 15 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.707802:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395116.707809:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169b12 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169b0b expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.707820:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169b12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169b0b expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.707829:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169b12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169b0b expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.707870:0:8441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169b12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169b0b expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.707883:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239586816:0@lo:105: 00000100:00100000:1.0:1789395116.707923:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.707953:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395116.707968:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239586816 00000100:00100000:1.0:1789395116.707971:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239586816 00000100:00100000:1.0:1789395116.707996:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1789395116.708002:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239586816:12345-0@lo:105: 00010000:00010000:1.0:1789395116.708013:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.708023:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.708032:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.708039:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.708047:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.708055:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.708068:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3de600) 00000100:00100000:1.0:1789395116.708107:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239586816:12345-0@lo:105: Request processed in 105us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.708114:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1789395116.708149:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239586816:0@lo:105: 00010000:00010000:1.0:1789395116.708164:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395116.708196:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231677952:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 447us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.708203:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1512 00010000:00010000:0.0:1789395116.708481:0:17997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345200/0xff35729af3169ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b5e expref: 14 pid: 10512 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.708499:0:17997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:17997:1876316239586688:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395116.708518:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169b12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169b0b expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.708527:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:0.0:1789395116.708530:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395116.708532:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:0.0:1789395116.708587:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239586560:12345-0@lo:101:mdt00_000.0 Request processed in 7355us (7446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.708594:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:1.0:1789395116.709004:0:6511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983422 gen 2 00000004:00080000:1.0:1789395116.709010:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983415 committed transno 4294983422 00000020:00080000:1.0:1789395116.709016:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca1ccc00 refcount 2 committed 0 result 0 batchid 371 00000020:00080000:1.0:1789395116.709021:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ec00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cc000 00000020:00080000:1.0:1789395116.709024:0:6511:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].371 00000020:00080000:1.0:1789395116.709027:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c922f800 00000020:00080000:1.0:1789395116.709030:0:6511:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].372 00000004:00080000:1.0:1789395116.709050:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983417 committed transno 4294983422 00000004:00080000:1.0:1789395116.709058:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983420 committed transno 4294983422 00000004:00080000:1.0:1789395116.709069:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983422 committed transno 4294983422 00000100:00100000:1.0:1789395116.709094:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239586560:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395116.709110:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395116.709624:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 372 committed batchid 370 00000020:00080000:0.0:1789395116.709680:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 370 00000100:00100000:1.0:1789395116.710049:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239586944:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1789395116.710117:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.710150:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.710561:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239586944 00000100:00100000:0.0:1789395116.710570:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239586944 00000100:00100000:0.0:1789395116.710620:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:0.0:1789395116.710629:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239586944:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1789395116.712355:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239586944:12345-0@lo:403:mdt00_000.0 Request processed in 1719us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.712367:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:0.0:1789395116.712455:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239586944:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1789395116.713421:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].374, 952 off566792 00000040:00080000:0.0:1789395116.713602:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].373, 1032 off618696 00000004:00080000:0.0:1789395116.713608:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35c9c0 with version 711 00000004:00080000:0.0:1789395116.713634:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 711 rpc_version 711 00000020:00100000:0.0:1789395116.713662:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395116.713671:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3cac42300 x1876316239587200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395116.713691:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac42300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239587200:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395116.713739:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.713762:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.713783:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239587200 00000100:00100000:0.0:1789395116.713789:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239587200 00000100:00100000:0.0:1789395116.713832:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:0.0:1789395116.713840:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f7835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7455:x1876316239587200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395116.720877:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f7835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239587200:12345-0@lo:1000:osp_up0-1.0 Request processed in 7029us (7128us total) trans 4294983423 rc 0/0 00000100:00100000:0.0:1789395116.720892:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:0.0:1789395116.721058:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac42300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239587200:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1789395116.721103:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x183:0x0]: returning size 4096 00010000:00010000:0.0:1789395116.721127:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721137:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721144:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721150:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.721154:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721163:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721181:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc5:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:0.0:1789395116.721184:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395116.721190:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721197:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169b04 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721214:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721222:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721229:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af3169b0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169b12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721253:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395116.721261:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc5:0x0] 00010000:00010000:0.0:1789395116.721268:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721274:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721279:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721289:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.721292:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721298:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721306:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x183:0x0].0x0 (ffff89a3ca363a00) 00010000:00010000:0.0:1789395116.721308:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395116.721311:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721316:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169afd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721331:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721337:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721343:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721349:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721354:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.721356:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721366:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721373:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:0.0:1789395116.721375:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395116.721378:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721400:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169aef lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.721417:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d4104b3 reply state 00000000575c22c7 transno 4294968394 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169af6 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721430:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169af6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xd1c5f96a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.721437:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xd1c5f96a (ffff89a3ca363400) 00010000:00010000:0.0:1789395116.721439:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.721442:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395116.724722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17575:x1876316231677696:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 31264us (31525us total) trans 4294968394 rc 0/0 00000100:00100000:0.0:1789395116.724732:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23333 00000100:00100000:1.0:1789395116.754163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.761051:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231678208 00000100:00100000:1.0:1789395116.761060:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231678208 00000100:00100000:1.0:1789395116.761143:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23335 00000100:00100000:1.0:1789395116.761152:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17576:x1876316231678208:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395116.761179:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395116.761206:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169b2e lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b6c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.761263:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169b35 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.761277:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169b35 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.761287:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169b35 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395116.761333:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1789395116.761338:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395116.761374:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169b2e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b6c expref: 12 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.761629:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169b35 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b6c expref: 11 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.761639:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395116.761643:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395116.761646:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417600, rc 0) 00000100:00100000:1.0:1789395116.761758:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17576:x1876316231678208:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 607us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.761766:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23335 00000100:00100000:0.0:1789395116.772492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.772593:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231678464 00000100:00100000:1.0:1789395116.772604:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231678464 00000100:00100000:1.0:1789395116.772662:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23336 00000100:00100000:1.0:1789395116.772673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17576:x1876316231678464:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395116.772729:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395116.772753:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169a86 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b49 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.773087:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1da00) 00010000:00010000:1.0:1789395116.773099:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395116.773160:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.773173:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.773183:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.773264:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.773272:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.773279:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395116.774988:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].381, 2168 off581880 00000040:00080000:1.0:1789395116.775064:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].379, 2368 off634296 00000004:00080000:1.0:1789395116.775071:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c9b9c6c0 with version 718 00010000:00010000:0.0:1789395116.779151:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779168:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779184:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779203:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779210:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779217:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779252:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779259:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779269:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.779288:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239587712:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395116.779327:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.779364:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.779897:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239587712:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395116.779910:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779919:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.779944:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051eb1e41 reply state 00000000103697bb transno 4294983424 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779957:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779964:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395116.779966:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.779970:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395116.779975:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.779984:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395116.779994:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc8:0x0] 00000004:00010000:0.0:1789395116.780001:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051eb1e41 reply state 00000000103697bb transno 4294983424 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780009:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780016:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:0.0:1789395116.780019:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.780021:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1789395116.780026:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1514:0x0]: returning size 4096 00010000:00010000:0.0:1789395116.780035:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780042:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780049:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780057:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780064:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.780068:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780090:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780101:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c7eb6a00) 00010000:00010000:0.0:1789395116.780103:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395116.780107:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780114:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af3169b3c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.780129:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051eb1e41 reply state 00000000103697bb transno 4294983424 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780138:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.780145:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x49ac0f22 (ffff89a4c7eb6d00) 00010000:00010000:0.0:1789395116.780148:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.780150:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1789395116.780221:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17576:x1876316231678464:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 7549us (7737us total) trans 4294983424 rc 0/0 00000100:00100000:0.0:1789395116.780229:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23336 00000100:00100000:0.0:1789395116.810963:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.848174:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.848268:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231678976 00000100:00100000:0.0:1789395116.848277:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231678976 00000100:00100000:0.0:1789395116.848347:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23339 00000100:00100000:0.0:1789395116.848358:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17578:x1876316231678976:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395116.848378:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395116.848431:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af3169b82 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.848505:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.848519:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.848530:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395116.848575:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc8:0x0]: returning size 4096 00000004:00200000:0.0:1789395116.848581:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395116.848615:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af3169b82 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b7a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.848632:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b7a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.848640:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395116.848644:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395116.848647:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:0.0:1789395116.848698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17578:x1876316231678976:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 342us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.848706:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23339 00000100:00100000:0.0:1789395116.857647:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.858599:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239587840 00000100:00100000:0.0:1789395116.858604:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239587840 00000100:00100000:0.0:1789395116.858643:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1789395116.858651:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239587840:12345-0@lo:104: 00010000:00010000:0.0:1789395116.858664:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.858721:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395116.858727:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239587840:12345-0@lo:104: Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.858734:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00010000:00010000:1.0:1789395116.858894:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395116.858902:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.858910:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395116.858917:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395116.858926:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.858953:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.858960:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395116.858987:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.858995:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015e00/0xff35729af3169b58 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169b5f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.859014:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395116.859015:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395116.859017:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395116.859066:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239587968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395116.859107:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.859196:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239587968 00000100:00100000:1.0:1789395116.859201:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239587968 00010000:00010000:1.0:1789395116.859220:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af3169b5f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169b58 expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.859879:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1789395116.859893:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3637:x1876316239587968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395116.859906:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789395116.864944:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968395 is committed 00000001:00080000:0.0:1789395116.864974:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968394 is committed 00000020:00080000:0.0:1789395116.864985:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 372 batchid updated 00000020:00080000:0.0:1789395116.865004:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca1cc6c0 refcount 2 committed 0 result 0 batchid 373 00000020:00080000:0.0:1789395116.865010:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ed00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cca80 00000020:00080000:0.0:1789395116.865013:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].372 00000020:00080000:0.0:1789395116.865016:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c8bbac00 00000020:00080000:0.0:1789395116.865019:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].373 00000020:00080000:0.0:1789395116.865041:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 373 committed batchid 372 00000004:00080000:0.0:1789395116.865165:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35c300 with version 712 00000020:00080000:0.0:1789395116.865175:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 371 cancel update log [0x200000401:0x3:0x0].371: rc = 0 00000020:00080000:0.0:1789395116.865216:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 371 cancel update log [0x240000400:0x3:0x0].372: rc = 0 00000020:00080000:0.0:1789395116.865226:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 372 00010000:00010000:0.0:1789395116.865291:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af3169b5f lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169b58 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.865459:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:0.0:1789395116.865465:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.865476:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.865484:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.865509:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395116.865594:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239587968:12345-0@lo:103:ldlm_bl.0 Request processed in 5703us (6485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.865604:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000004:00080000:0.0:1789395116.865634:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 712 rpc_version 712 00000020:00100000:0.0:1789395116.865664:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395116.865673:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3cac41500 x1876316239588224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395116.865694:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac41500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239588224:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395116.865736:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.865766:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.865804:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239587968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395116.882601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395116.894783:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.895087:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231679488 00000100:00100000:0.0:1789395116.895099:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231679488 00010000:00010000:0.0:1789395116.895141:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b7a expref: 17 pid: 6511 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.895183:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1514 00000100:00100000:0.0:1789395116.895194:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231679488:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395116.895212:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395116.895218:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b7a expref: 17 pid: 6511 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.895231:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b7a expref: 17 pid: 6511 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.895251:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af3169b89 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b7a expref: 17 pid: 6511 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.895266:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395116.895271:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.895280:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.895287:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.895322:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395116.895380:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231679488:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 187us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.895411:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1514 00010000:00010000:1.0:1789395116.895488:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.895496:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.895556:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.895565:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395116.895575:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.895595:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239588480:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395116.895641:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.895675:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.895875:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239588480 00000100:00100000:0.0:1789395116.895880:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239588480 00000100:00100000:0.0:1789395116.896173:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1789395116.896182:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6512:x1876316239588480:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395116.896197:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395116.896211:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169bba expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.896233:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b81 expref: 7 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.896242:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.896265:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b81 expref: 7 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.896277:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b81 expref: 7 pid: 7813 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.896289:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8436:1876316239588608:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395116.896337:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.907646:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8436:1876316239588608:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395116.907651:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b81 expref: 8 pid: 7813 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.907677:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169b97 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b81 expref: 8 pid: 7813 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.907684:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.907693:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:3.0:1789395116.907698:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.907709:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.907718:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.907732:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:0.0:1789395116.907735:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395116.907738:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015400, rc 0) 00010000:00010000:3.0:1789395116.907755:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395116.907769:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6496:1876316239588736:0@lo:105: 00000100:00100000:3.0:1789395116.907805:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.907825:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6512:x1876316239588480:12345-0@lo:101:mdt00_001.0 Request processed in 11644us (12183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395116.907833:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:3.0:1789395116.907840:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395116.908184:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca143480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6496:1876316239588736:0@lo:105: 00010000:00010000:3.0:1789395116.908195:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395116.908227:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968395 gen 2 00000004:00080000:1.0:1789395116.908233:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968388 committed transno 4294968395 00000020:00080000:1.0:1789395116.908239:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca1ccd80 refcount 2 committed 0 result 0 batchid 380 00000100:00100000:3.0:1789395116.908240:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231679616:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 730us (943us total) trans 0 rc 0/0 00000020:00080000:1.0:1789395116.908243:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ef00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cc480 00000020:00080000:1.0:1789395116.908246:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].378 00000100:00100000:3.0:1789395116.908247:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1515 00000020:00080000:1.0:1789395116.908249:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c8bbb800 00000020:00080000:1.0:1789395116.908251:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].380 00000020:00080000:0.0:1789395116.908284:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 380 committed batchid 376 00000020:00080000:0.0:1789395116.908351:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 376 00000004:00080000:1.0:1789395116.908843:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968390 committed transno 4294968395 00000004:00080000:1.0:1789395116.908870:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968391 committed transno 4294968395 00000004:00080000:1.0:1789395116.908877:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968392 committed transno 4294968395 00000004:00080000:1.0:1789395116.908899:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968393 committed transno 4294968395 00000004:00080000:1.0:1789395116.908909:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968395 committed transno 4294968395 00000100:00100000:1.0:1789395116.908926:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239588480:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395116.908944:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169bc1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395116.909649:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239588864:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395116.909707:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395116.909739:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395116.911770:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239588864 00000100:00100000:3.0:1789395116.911786:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239588864 00000100:00100000:3.0:1789395116.911987:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:3.0:1789395116.911999:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6512:x1876316239588864:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1789395116.914351:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6512:x1876316239588864:12345-0@lo:403:mdt00_001.0 Request processed in 2346us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395116.914366:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1789395116.914637:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a15880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239588864:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1789395116.915814:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].382, 664 off582544 00000040:00080000:1.0:1789395116.916056:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].380, 744 off635040 00000004:00080000:1.0:1789395116.916063:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c9b9c780 with version 719 00000100:00100000:0.0:1789395116.916658:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239589120 00000100:00100000:0.0:1789395116.916667:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239589120 00000100:00100000:0.0:1789395116.916754:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:0.0:1789395116.916763:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239589120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395116.917129:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239589120:12345-0@lo:1000:osp_up1-0.0 Request processed in 366us (842us total) trans 4294968396 rc 0/0 00000100:00100000:0.0:1789395116.917138:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1789395116.917216:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239589120:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1789395116.917307:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1514:0x0]: returning size 4096 00010000:00010000:3.0:1789395116.917330:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917340:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917347:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917353:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395116.917357:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917365:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917380:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:3.0:1789395116.917406:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395116.917411:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917418:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169bb3 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917434:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169bc1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917444:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169bc1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917461:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af3169bba lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169bc1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917484:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395116.917492:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc8:0x0] 00010000:00010000:3.0:1789395116.917499:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917505:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917511:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917517:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395116.917520:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917526:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917533:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:3.0:1789395116.917536:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395116.917539:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917545:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af3169bac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917561:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917567:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917573:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917578:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917583:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395116.917587:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917594:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917601:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363400) 00010000:00010000:3.0:1789395116.917604:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395116.917607:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917613:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169b9e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395116.917629:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048c1a48c reply state 00000000345736f8 transno 4294983426 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917642:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.917649:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x49ac0f22 (ffff89a4c7eb6d00) 00010000:00010000:3.0:1789395116.917652:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395116.917654:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395116.917717:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17578:x1876316231679360:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 34904us (35125us total) trans 4294983426 rc 0/0 00000100:00100000:3.0:1789395116.917724:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23341 00000100:00100000:0.0:1789395116.918274:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239589248 00000100:00100000:0.0:1789395116.918281:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239589248 00000100:00100000:0.0:1789395116.918354:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1789395116.918363:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1876316239589248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395116.918374:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395116.918422:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169bc1 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169bba expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.918435:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:0.0:1789395116.918442:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395116.918667:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239589248:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395116.918676:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1789395116.918791:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239589248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395116.938714:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395116.938794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231679744 00000100:00100000:3.0:1789395116.938805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231679744 00000100:00100000:3.0:1789395116.938983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23342 00000100:00100000:3.0:1789395116.938995:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17579:x1876316231679744:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395116.939016:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395116.939036:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169bc8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b88 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939116:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939130:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939141:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939155:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939162:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939168:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939214:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939221:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939227:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939233:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939238:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395116.939241:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939249:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939259:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:3.0:1789395116.939262:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395116.939266:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939272:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169bcf lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939285:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939291:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939297:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939301:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395116.939304:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939309:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939316:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x917910c6 (ffff89a3ca363400) 00010000:00010000:3.0:1789395116.939319:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395116.939322:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169bd6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939360:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169bc8 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b88 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939369:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:3.0:1789395116.939371:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395116.939375:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169bc8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b88 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.939428:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345e00, rc 0) 00000100:00100000:3.0:1789395116.939488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17579:x1876316231679744:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 495us (784us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395116.939494:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23342 00000100:00100000:1.0:1789395116.945735:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395116.945902:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231679872 00000100:00100000:3.0:1789395116.945913:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231679872 00000100:00100000:3.0:1789395116.945978:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23343 00000100:00100000:3.0:1789395116.945989:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17579:x1876316231679872:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395116.946017:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395116.946039:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169bdd lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b8f expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.946114:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.946129:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.946140:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395116.946196:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1789395116.946202:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395116.946241:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169bdd lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 19 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.946264:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.946274:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363400) 00010000:00010000:3.0:1789395116.946278:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395116.946283:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345000, rc 0) 00000100:00100000:3.0:1789395116.946531:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17579:x1876316231679872:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 542us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395116.946546:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23343 00000100:00100000:3.0:1789395116.954652:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395116.955973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231680128 00000100:00100000:0.0:1789395116.955985:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231680128 00000100:00100000:0.0:1789395116.956052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23344 00000100:00100000:0.0:1789395116.956064:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17579:x1876316231680128:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:0.0:1789395116.956132:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395116.956160:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169b35 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b6c expref: 7 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.956179:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:0.0:1789395116.956190:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395116.956254:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.956266:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.956274:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.956287:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.956294:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.956300:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395116.957377:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].375, 2168 off568960 00000040:00080000:0.0:1789395116.957482:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].374, 2368 off621064 00000004:00080000:0.0:1789395116.957488:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c7a3ae40 with version 713 00000004:00080000:3.0:1789395116.958427:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 713 rpc_version 713 00000020:00100000:3.0:1789395116.958482:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395116.958492:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca142a00 x1876316239589504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395116.958836:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239589504:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395116.959052:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395116.959121:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395116.959189:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239589504 00000100:00100000:0.0:1789395116.959196:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239589504 00000100:00100000:0.0:1789395116.959252:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1789395116.959261:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239589504:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395116.959737:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239589504:12345-0@lo:1000:osp_up0-1.0 Request processed in 476us (684us total) trans 4294983427 rc 0/0 00000100:00100000:0.0:1789395116.959746:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:3.0:1789395116.959854:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239589504:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1789395116.960316:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x185:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960332:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960343:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960359:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960366:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960372:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960791:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960800:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.960808:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395116.960826:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239589632:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395116.960865:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395116.960904:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395116.960970:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239589632 00000100:00100000:3.0:1789395116.960975:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239589632 00000100:00100000:3.0:1789395116.961013:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:3.0:1789395116.961020:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6512:x1876316239589632:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395116.961035:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395116.961050:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169c07 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.961080:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169c07 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.961095:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169c07 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395116.961108:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:3.0:1789395116.961111:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395116.961114:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345e00, rc 0) 00000100:00100000:3.0:1789395116.961144:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6512:x1876316239589632:12345-0@lo:101:mdt00_001.0 Request processed in 124us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395116.961150:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:0.0:1789395116.961218:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239589632:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395116.961231:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961241:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.961260:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000521b80f4 reply state 00000000916e41fa transno 4294968397 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961271:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961277:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395116.961280:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.961283:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395116.961288:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961296:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395116.961306:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc6:0x0] 00000004:00010000:0.0:1789395116.961311:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000521b80f4 reply state 00000000916e41fa transno 4294968397 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961323:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961328:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff89a3c8b1dc00) 00010000:00010000:0.0:1789395116.961331:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.961332:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1789395116.961336:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x185:0x0]: returning size 4096 00010000:00010000:0.0:1789395116.961344:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961350:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961356:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961362:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961367:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395116.961371:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961379:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961616:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d900) 00010000:00010000:0.0:1789395116.961619:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395116.961623:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961633:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169beb lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395116.961651:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000521b80f4 reply state 00000000916e41fa transno 4294968397 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961659:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395116.961665:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x917910c6 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395116.961667:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395116.961669:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1789395116.961775:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17579:x1876316231680128:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 5713us (7132us total) trans 4294968397 rc 0/0 00000100:00100000:0.0:1789395116.961782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23344 00000100:00100000:0.0:1789395116.986994:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395116.990177:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231680384 00000100:00100000:3.0:1789395116.990190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231680384 00000100:00100000:3.0:1789395116.990250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23345 00000100:00100000:3.0:1789395116.990261:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17580:x1876316231680384:12345-192.168.203.54@tcp:36:mkdir.0 00000100:00100000:3.0:1789395116.990470:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17580:x1876316231680384:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 209us (3484us total) trans 0 rc -17/-17 00000100:00100000:3.0:1789395116.990478:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23345 00000100:00100000:1.0:1789395117.024610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.025689:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231680512 00000100:00100000:3.0:1789395117.025700:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231680512 00000100:00100000:3.0:1789395117.025773:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23346 00000100:00100000:3.0:1789395117.025784:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17581:x1876316231680512:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.025804:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.025825:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169c15 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b96 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026203:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169c1c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026218:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169c1c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026235:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169c1c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026248:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169c23 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026256:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169c23 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026263:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169c23 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026333:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af3169c2a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x185:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026342:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af3169c2a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x185:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.026348:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af3169c2a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x185:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.037927:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231680640 00000100:00100000:3.0:1789395117.037937:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231680640 00000100:00100000:3.0:1789395117.037999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23347 00000100:00100000:3.0:1789395117.038010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17581:x1876316231680640:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.038030:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.038050:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169c31 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105b9d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.038124:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.038140:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.038151:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395117.038198:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xc6:0x0]: returning size 4096 00000004:00200000:3.0:1789395117.038203:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395117.038238:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169c31 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.038255:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.038264:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395117.038267:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395117.038271:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344e00, rc 0) 00000100:00100000:3.0:1789395117.038333:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17581:x1876316231680640:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 325us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.038349:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23347 00000100:00100000:1.0:1789395117.043969:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.044036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231680768 00000100:00100000:3.0:1789395117.044045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231680768 00000100:00100000:3.0:1789395117.044122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23348 00000100:00100000:3.0:1789395117.044133:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17581:x1876316231680768:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.044154:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.044174:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169c3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ba4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044238:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044252:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169c07 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044261:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044293:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169c07 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.044308:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239589760:0@lo:104: 00000100:00100000:3.0:1789395117.044367:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.044427:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.044444:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239589760 00000100:00100000:3.0:1789395117.044448:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239589760 00000100:00100000:3.0:1789395117.044473:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1789395117.044479:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239589760:12345-0@lo:104: 00010000:00010000:3.0:1789395117.044490:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044532:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395117.044537:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239589760:12345-0@lo:104: Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.044544:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00010000:00010000:3.0:1789395117.044568:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395117.044573:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044582:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395117.044587:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.044597:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044629:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044635:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395117.044653:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044660:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169c07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169c0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.044676:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.044678:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.044680:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.044691:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239589888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.044720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.044755:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239589888 00000100:00100000:3.0:1789395117.044759:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239589888 00010000:00010000:3.0:1789395117.044780:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169c07 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.044799:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1789395117.044805:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3639:x1876316239589888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.044815:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789395117.045247:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239589760:0@lo:104: 00010000:00010000:3.0:1789395117.045266:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789395117.045664:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789395117.047968:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983427 is committed 00000001:00080000:3.0:1789395117.051437:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983426 is committed 00000020:00080000:3.0:1789395117.051456:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 380 batchid updated 00000020:00080000:3.0:1789395117.051465:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c9b9cb40 refcount 2 committed 0 result 0 batchid 381 00000020:00080000:3.0:1789395117.051470:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9c6c0 00000020:00080000:3.0:1789395117.051473:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].379 00000020:00080000:3.0:1789395117.051476:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0e00 00000020:00080000:3.0:1789395117.051479:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].381 00000020:00080000:3.0:1789395117.051503:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 379 batchid updated 00000020:00080000:3.0:1789395117.051525:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 381 committed batchid 380 00000004:00080000:3.0:1789395117.051640:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34fd80 with version 720 00000020:00080000:3.0:1789395117.051657:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 377 cancel update log [0x240000401:0x3:0x0].375: rc = 0 00000020:00080000:3.0:1789395117.051698:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 377 cancel update log [0x200000400:0x3:0x0].377: rc = 0 00000004:00080000:3.0:1789395117.051719:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34f600 with version 721 00000020:00080000:3.0:1789395117.051721:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 378 cancel update log [0x240000401:0x3:0x0].376: rc = 0 00000020:00080000:3.0:1789395117.051739:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 378 cancel update log [0x200000400:0x3:0x0].378: rc = 0 00000004:00080000:3.0:1789395117.051762:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34ff00 with version 722 00000020:00080000:3.0:1789395117.051764:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 379 cancel update log [0x240000401:0x3:0x0].377: rc = 0 00000020:00080000:3.0:1789395117.051781:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 379 cancel update log [0x200000400:0x3:0x0].379: rc = 0 00000004:00080000:3.0:1789395117.051798:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34f240 with version 723 00000020:00080000:3.0:1789395117.051801:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 380 cancel update log [0x240000401:0x3:0x0].378: rc = 0 00000020:00080000:3.0:1789395117.051819:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 380 cancel update log [0x200000400:0x3:0x0].380: rc = 0 00000020:00080000:3.0:1789395117.051824:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 380 00010000:00010000:3.0:1789395117.051883:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169c0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169c07 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.051899:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:3.0:1789395117.051904:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.051914:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.051921:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.051945:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.052017:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239589888:12345-0@lo:103:ldlm_bl.0 Request processed in 7210us (7294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.052027:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1789395117.052137:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239589888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.052163:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.052170:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395117.052219:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xc6:0x0]: returning size 4096 00000004:00200000:3.0:1789395117.052224:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395117.052264:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169c3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.052279:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.052285:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:3.0:1789395117.052289:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395117.052291:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344200, rc 0) 00000100:00100000:3.0:1789395117.052336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17581:x1876316231680768:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 8205us (8374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.052343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23348 00010000:00010000:1.0:1789395117.053016:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053027:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053034:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053040:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.053044:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053051:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053063:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x49ac0f22 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395117.053066:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.053069:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053086:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169b43 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053097:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053104:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053109:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053114:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.053116:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053126:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053134:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:1.0:1789395117.053136:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.053139:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053144:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169b4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053160:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053165:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053171:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053175:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.053177:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053183:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053190:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395117.053193:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.053195:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053204:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169b51 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053218:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053223:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053229:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053233:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.053236:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053242:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053249:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x49ac0f22 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395117.053251:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.053254:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.053260:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344600/0xff35729af3169ba5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x49ac0f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395117.053281:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 720 rpc_version 720 00000020:00100000:1.0:1789395117.053309:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.053318:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c825b480 x1876316239590144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.053483:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590144:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.053535:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.053633:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.053710:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239590144 00000100:00100000:3.0:1789395117.053718:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239590144 00000100:00100000:3.0:1789395117.053771:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1789395117.053780:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7874:x1876316239590144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.053922:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239590144:12345-0@lo:1000:osp_up1-0.0 Request processed in 142us (386us total) trans 4294968398 rc 0/0 00000100:00100000:3.0:1789395117.053931:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:1.0:1789395117.054014:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590144:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1789395117.054024:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 721 rpc_version 721 00000020:00100000:1.0:1789395117.054036:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.054042:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c904ca80 x1876316239590400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.054055:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590400:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.054093:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.054113:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.054151:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239590400 00000100:00100000:3.0:1789395117.054156:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239590400 00000100:00100000:3.0:1789395117.054190:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1789395117.054197:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239590400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.054268:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7874:x1876316239590400:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (174us total) trans 4294968399 rc 0/0 00000100:00100000:3.0:1789395117.054274:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:1.0:1789395117.054337:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590400:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1789395117.054864:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 722 rpc_version 722 00000020:00100000:1.0:1789395117.054879:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.054885:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c904c700 x1876316239590656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.054898:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590656:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.054925:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.054948:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.054962:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239590656 00000100:00100000:1.0:1789395117.054966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239590656 00000100:00100000:1.0:1789395117.054994:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:1.0:1789395117.055000:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7874:x1876316239590656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.055097:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239590656:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (170us total) trans 4294968400 rc 0/0 00000100:00100000:1.0:1789395117.055104:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:1.0:1789395117.055136:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590656:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1789395117.055142:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 723 rpc_version 723 00000020:00100000:1.0:1789395117.055153:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.055157:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c904df80 x1876316239590912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.055168:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590912:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.055192:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.055204:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.055215:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239590912 00000100:00100000:1.0:1789395117.055218:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239590912 00000100:00100000:1.0:1789395117.055236:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1789395117.055241:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239590912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.055308:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239590912:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (115us total) trans 4294968401 rc 0/0 00000100:00100000:1.0:1789395117.055315:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1789395117.057628:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239590912:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.064482:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.064646:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231681024 00000100:00100000:0.0:1789395117.064655:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231681024 00000100:00100000:0.0:1789395117.064700:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23349 00000100:00100000:0.0:1789395117.064710:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17581:x1876316231681024:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395117.064763:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.064788:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344000/0xff35729af3169c2a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x185:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b96 expref: 10 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064804:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff89a3c8b1dc00) 00010000:00010000:0.0:1789395117.064809:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395117.064834:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064847:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064856:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064865:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064872:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064879:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064971:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x185:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064978:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.064985:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.065002:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.065011:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.065018:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.065049:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.065062:0:7813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 9 pid: 6512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.065085:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239591040:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395117.065161:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.067365:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239591040:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395117.067507:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.070558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.071414:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231681152 00000100:00100000:0.0:1789395117.071432:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231681152 00010000:00010000:0.0:1789395117.071472:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 10 pid: 6512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.071519:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1517 00000100:00100000:0.0:1789395117.071530:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231681152:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.071545:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.071552:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 10 pid: 6512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071566:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 10 pid: 6512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071592:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169c38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b9d expref: 10 pid: 6512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071607:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395117.071613:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071623:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071630:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071657:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.071708:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231681152:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 179us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.071716:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1517 00010000:00010000:0.0:1789395117.071743:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071750:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071794:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071801:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.071812:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.071830:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239591168:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1789395117.071884:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.071925:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.072047:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239591168 00000100:00100000:0.0:1789395117.072052:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239591168 00000100:00100000:0.0:1789395117.072091:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1789395117.072099:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7813:x1876316239591168:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789395117.072113:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.072127:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169c69 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.072148:0:17997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.072157:0:17997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169c69 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.072180:0:17997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.072192:0:17997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 14 pid: 6513 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.072207:0:17997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:17997:1876316239591296:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395117.072277:0:17997:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.078047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.078120:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231681280 00000100:00100000:3.0:1789395117.078130:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231681280 00010000:00010000:3.0:1789395117.078167:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 15 pid: 6513 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.078207:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1518 00000100:00100000:3.0:1789395117.078217:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231681280:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.078230:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.078237:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 15 pid: 6513 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.078294:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ba4 expref: 15 pid: 6513 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.078317:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:3.0:1789395117.078323:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169c69 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.078335:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169c69 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.078354:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169c69 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.078790:0:7813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983427 gen 2 00000004:00080000:1.0:1789395117.078795:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983423 committed transno 4294983427 00000020:00080000:1.0:1789395117.078801:0:7813:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca35c3c0 refcount 2 committed 0 result 0 batchid 374 00000020:00080000:1.0:1789395117.078805:0:7813:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca35c9c0 00000020:00080000:1.0:1789395117.078808:0:7813:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].373 00000020:00080000:1.0:1789395117.078810:0:7813:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82f8200 00000020:00080000:1.0:1789395117.078815:0:7813:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].374 00000004:00080000:1.0:1789395117.078842:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983425 committed transno 4294983427 00000004:00080000:1.0:1789395117.078850:0:7813:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983427 committed transno 4294983427 00000100:00100000:1.0:1789395117.078862:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239591168:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395117.078876:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.078886:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.079055:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169c69 expref: 5 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.079069:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6495:1876316239591424:0@lo:105: 00000100:00100000:3.0:1789395117.079111:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.079147:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.079185:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239591424 00000100:00100000:1.0:1789395117.079189:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239591424 00000100:00100000:1.0:1789395117.079221:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1789395117.079227:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1876316239591424:12345-0@lo:105: 00010000:00010000:1.0:1789395117.079237:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.079246:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.079255:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.079263:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.079270:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.079283:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.079306:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca015000) 00000100:00100000:1.0:1789395117.079336:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1876316239591424:12345-0@lo:105: Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.079351:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1789395117.079373:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6495:1876316239591424:0@lo:105: 00010000:00010000:1.0:1789395117.079407:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395117.079440:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231681280:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1224us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.079447:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1518 00000100:00100000:1.0:1789395117.082150:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239591552 00000100:00100000:1.0:1789395117.082163:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239591552 00000100:00100000:1.0:1789395117.082227:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:1.0:1789395117.082239:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7813:x1876316239591552:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1789395117.083968:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7813:x1876316239591552:12345-0@lo:403:mdt00_003.0 Request processed in 1724us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.083981:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:1.0:1789395117.084046:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239591552:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1789395117.085019:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].376, 664 off569624 00000040:00080000:1.0:1789395117.090743:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].375, 744 off621808 00000004:00080000:1.0:1789395117.090760:0:7813:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c9b9cf00 with version 714 00000004:00200000:1.0:1789395117.091740:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x185:0x0]: returning size 4096 00010000:00010000:1.0:1789395117.091761:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091771:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091779:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091784:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.091788:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091795:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091809:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395117.091811:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395117.091815:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091821:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169c62 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091835:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091842:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091850:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015000/0xff35729af3169c69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169c70 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091879:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395117.091888:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc6:0x0] 00010000:00010000:1.0:1789395117.091895:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091901:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091907:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091911:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.091914:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091919:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091927:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff89a3c8b1dc00) 00010000:00010000:1.0:1789395117.091930:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395117.091933:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091938:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169c5b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091954:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091960:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091966:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091971:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091976:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.091979:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091984:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.091992:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d900) 00010000:00010000:1.0:1789395117.091995:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.091997:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.092002:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169c4d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.092018:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bb45220 reply state 00000000c812a4b8 transno 4294968402 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.092031:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.092037:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x917910c6 (ffff89a3c8b1d300) 00010000:00010000:1.0:1789395117.092040:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395117.092042:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395117.092118:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17581:x1876316231681024:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 27407us (27642us total) trans 4294968402 rc 0/0 00000100:00100000:1.0:1789395117.092126:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23349 00000100:00100000:3.0:1789395117.098645:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239591936 00000100:00100000:3.0:1789395117.098657:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239591936 00000100:00100000:3.0:1789395117.098721:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1789395117.098732:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1876316239591936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.098747:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.098770:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169c70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169c69 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.098786:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:3.0:1789395117.098796:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.098910:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1876316239591936:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (6093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.098918:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1789395117.128658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.137172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.144904:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.144975:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231681664 00000100:00100000:1.0:1789395117.144985:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231681664 00000100:00100000:1.0:1789395117.145039:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23352 00000100:00100000:1.0:1789395117.145050:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17582:x1876316231681664:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395117.145084:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.145108:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169ca1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bb9 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.145166:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.145179:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.145190:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395117.145233:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1789395117.145238:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395117.145270:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169ca1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bb9 expref: 12 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.145286:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bb9 expref: 11 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.145295:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395117.145298:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395117.145302:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417600, rc 0) 00000100:00100000:1.0:1789395117.145368:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17582:x1876316231681664:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 320us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.145376:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23352 00000100:00100000:3.0:1789395117.160892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231681920 00000100:00100000:3.0:1789395117.160903:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231681920 00000100:00100000:3.0:1789395117.160964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23353 00000100:00100000:3.0:1789395117.160977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17582:x1876316231681920:12345-192.168.203.54@tcp:36:lfs.0 00000100:00100000:3.0:1789395117.161134:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.161191:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.162618:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.162858:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239592064 00000100:00100000:0.0:1789395117.162867:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239592064 00000100:00100000:0.0:1789395117.162955:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1789395117.162966:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6511:x1876316239592064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.163109:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:6511:x1876316239592064:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.163117:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:3.0:1789395117.163191:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.163268:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592192:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.163311:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.163649:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.163912:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592192:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789395117.163973:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.163986:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.163995:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.164008:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592320:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789395117.164094:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.164145:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.172006:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.172109:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231682048 00000100:00100000:3.0:1789395117.172119:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231682048 00010000:00010000:3.0:1789395117.172162:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bb9 expref: 11 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.172206:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1519 00000100:00100000:3.0:1789395117.172215:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231682048:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.172229:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.172235:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bb9 expref: 11 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.172539:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bb9 expref: 11 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.172568:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169ca8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bb9 expref: 11 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.172580:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:3.0:1789395117.172584:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169cb6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169caf expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.172666:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169cb6 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169caf expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.172676:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169cb6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169caf expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.172706:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169cb6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169caf expref: 10 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.172720:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239592576:0@lo:105: 00000100:00100000:3.0:1789395117.172764:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.172804:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.173137:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239592576:0@lo:105: 00010000:00010000:3.0:1789395117.173150:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.173177:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592320:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789395117.173192:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231682048:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 978us (1195us total) trans 0 rc 0/0 00010000:00010000:0.0:1789395117.173192:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169cb6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.173200:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1519 00000004:00080000:0.0:1789395117.173211:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395117.173243:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.173250:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.173258:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.173271:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592704:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395117.173300:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.173328:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.173372:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239592704 00000100:00100000:3.0:1789395117.173376:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239592704 00000100:00100000:3.0:1789395117.173684:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:3.0:1789395117.173692:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6511:x1876316239592704:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395117.173707:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.173720:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169cc4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169cbd expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.173738:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169cbd expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.173749:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169cbd expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.173756:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff89a4c7b89300) 00010000:00010000:3.0:1789395117.173759:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.173762:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345a00, rc 0) 00000100:00100000:3.0:1789395117.173801:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239592704:12345-0@lo:101:mdt00_000.0 Request processed in 110us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.173807:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1789395117.173857:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592704:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395117.173869:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169cc4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.173877:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169cc4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395117.173890:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395117.173924:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592832:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.173950:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.174268:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.174311:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239592832 00000100:00100000:0.0:1789395117.174316:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239592832 00000100:00100000:0.0:1789395117.174340:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1789395117.174347:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239592832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174458:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239592832:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.174465:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1789395117.174509:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592832:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174564:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592960:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174592:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.174607:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.174619:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239592960 00000100:00100000:0.0:1789395117.174621:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239592960 00000100:00100000:0.0:1789395117.174639:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:0.0:1789395117.174644:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239592960:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174710:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239592960:12345-0@lo:1000:mdt00_000.0 Request processed in 65us (117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395117.174716:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00100000:0.0:1789395117.174742:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239592960:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174818:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593088:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174843:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.174857:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.174867:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593088 00000100:00100000:0.0:1789395117.174871:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593088 00000100:00100000:0.0:1789395117.174887:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1789395117.174892:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.174938:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593088:12345-0@lo:1000:mdt00_000.0 Request processed in 45us (94us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395117.174945:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1789395117.174968:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593088:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175010:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593216:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175031:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.175044:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.175053:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593216 00000100:00100000:0.0:1789395117.175056:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593216 00000100:00100000:0.0:1789395117.175088:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1789395117.175095:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175142:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593216:12345-0@lo:1000:mdt00_000.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.175148:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1789395117.175170:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593216:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175206:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593344:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175228:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.175240:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.175250:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593344 00000100:00100000:0.0:1789395117.175253:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593344 00000100:00100000:0.0:1789395117.175268:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1789395117.175273:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175327:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593344:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.175334:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1789395117.175357:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593344:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175414:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593472:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175435:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.175450:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.175461:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593472 00000100:00100000:0.0:1789395117.175464:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593472 00000100:00100000:0.0:1789395117.175480:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:0.0:1789395117.175485:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.175526:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239593472:12345-0@lo:1000:mdt00_000.0 Request processed in 39us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.175532:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:0.0:1789395117.175554:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239593472:0@lo:1000:mdt00_000.0 00080000:02000000:0.0:1789395117.175713:0:6511:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:0.0:1789395117.175728:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca31b840 with version 0 00000020:00080000:0.0:1789395117.175733:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca31b3c0 refcount 3 committed 0 result -5 batchid 383 00000020:00080000:0.0:1789395117.175737:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -5 sub_th ffff89a3ca31b840 00000020:00080000:0.0:1789395117.175739:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919cd00 obd lustre-MDT0000-osd committed 1 started 0 stopped 1 result 0 sub_th ffff89a3ca3d2000 00000004:00080000:0.0:1789395117.175760:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395117.175768:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169cb6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.175779:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169cb6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.175787:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af3169caf lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169cb6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.175804:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395117.175809:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395117.175813:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169cc4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.175821:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169cc4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.175827:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014c00/0xff35729af3169cbd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169cc4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.175846:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789395117.175903:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17582:x1876316231681920:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 14928us (15095us total) trans 0 rc -5/-5 00000100:00100000:0.0:1789395117.175911:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23353 00000020:00080000:0.0:1789395117.175931:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 380 00000100:00100000:0.0:1789395117.176309:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593600 00000100:00100000:0.0:1789395117.176314:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593600 00000100:00100000:0.0:1789395117.176346:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1789395117.176352:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3636:x1876316239593600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.176363:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.176378:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169cb6 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169caf expref: 12 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.176411:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:0.0:1789395117.176420:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.176516:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239593600:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.176609:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1789395117.176969:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239593728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.177003:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.177085:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593728 00000100:00100000:0.0:1789395117.177091:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593728 00000100:00100000:0.0:1789395117.177128:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1789395117.177135:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3638:x1876316239593728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.177143:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.177155:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169cc4 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169cbd expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.177168:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff89a4c7b89300) 00010000:00010000:0.0:1789395117.177175:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.177203:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239593728:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.177210:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1789395117.177266:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239593728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395117.177316:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395117.210675:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.210708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231682304 00000100:00100000:0.0:1789395117.210718:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231682304 00000100:00100000:0.0:1789395117.210780:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23354 00000100:00100000:0.0:1789395117.210789:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17586:x1876316231682304:12345-192.168.203.54@tcp:36:mkdir.0 00010000:00010000:0.0:1789395117.210899:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.210914:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.210926:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.210938:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.210944:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.210951:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211414:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211424:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211432:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.211448:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f5a557d reply state 0000000071978936 transno 4294968403 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211459:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211466:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395117.211469:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395117.211473:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789395117.211477:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x187:0x0]: returning size 4096 00010000:00010000:0.0:1789395117.211485:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211492:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211497:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211504:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211510:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.211513:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211521:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211530:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:0.0:1789395117.211533:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.211536:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211542:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014c00/0xff35729af3169ccb lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.211557:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f5a557d reply state 0000000071978936 transno 4294968403 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211564:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.211570:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395117.211572:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395117.211574:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789395117.211646:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:17586:x1876316231682304:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 857us (977us total) trans 4294968403 rc 0/0 00000100:00100000:0.0:1789395117.211653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23354 00000100:00100000:0.0:1789395117.243995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.248356:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.248430:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231682688 00000100:00100000:0.0:1789395117.248439:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231682688 00000100:00100000:0.0:1789395117.248499:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23356 00000100:00100000:0.0:1789395117.248509:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17589:x1876316231682688:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395117.248563:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.248587:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af3169cf5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x187:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bc0 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248729:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395117.248734:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395117.248755:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248765:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248772:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248778:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248782:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248786:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248845:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248855:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.248863:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395117.249042:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x187:0x0]: returning size 4096 00010000:00010000:0.0:1789395117.249057:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249064:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249082:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249088:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.249092:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249098:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249104:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395117.249106:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395117.249108:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249112:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d0a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249133:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249140:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249146:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249151:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249156:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.249159:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249164:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249172:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:0.0:1789395117.249175:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.249177:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249187:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169cfc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.249204:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2cbca07 reply state 00000000e0c52164 transno 4294968404 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249214:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.249220:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395117.249222:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395117.249224:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395117.249492:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17589:x1876316231682688:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 877us (1037us total) trans 4294968404 rc 0/0 00000100:00100000:0.0:1789395117.249501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23356 00000100:00100000:0.0:1789395117.271806:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.279299:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231682944 00000100:00100000:0.0:1789395117.279312:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231682944 00000100:00100000:0.0:1789395117.279407:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23358 00000100:00100000:0.0:1789395117.279418:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17594:x1876316231682944:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395117.279443:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.280096:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169d26 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bce expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.280166:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d2d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.280183:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d2d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.280191:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d2d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395117.280227:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1789395117.280231:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395117.280259:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af3169d26 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bce expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.280272:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015c00/0xff35729af3169d2d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bce expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.280278:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:0.0:1789395117.280281:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395117.280284:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015c00, rc 0) 00000100:00100000:0.0:1789395117.280341:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17594:x1876316231682944:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 926us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.280346:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23358 00000100:00100000:1.0:1789395117.290709:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.290807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231683200 00000100:00100000:0.0:1789395117.290817:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231683200 00000100:00100000:0.0:1789395117.290877:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23359 00000100:00100000:0.0:1789395117.290888:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17594:x1876316231683200:12345-192.168.203.54@tcp:36:lfs.0 00000100:00100000:0.0:1789395117.291058:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239593856:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.291123:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.291172:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.291460:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593856 00000100:00100000:1.0:1789395117.291465:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593856 00000100:00100000:1.0:1789395117.291508:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1789395117.291517:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239593856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.291593:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239593856:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.291601:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:0.0:1789395117.291695:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239593856:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.291744:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239593984:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.291846:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.292091:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.292133:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239593984 00000100:00100000:1.0:1789395117.292138:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239593984 00000100:00100000:1.0:1789395117.292729:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1789395117.292740:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239593984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.292977:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239593984:12345-0@lo:1000:mdt00_000.0 Request processed in 239us (1129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395117.292978:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239593984:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.292992:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00010000:00010000:0.0:1789395117.293044:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.293055:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.293065:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.293095:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594112:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395117.293127:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.293185:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.293629:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239594112 00000100:00100000:3.0:1789395117.293636:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239594112 00000100:00100000:3.0:1789395117.293666:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:3.0:1789395117.293683:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6511:x1876316239594112:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395117.293692:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.293707:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169d34 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.293732:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.293743:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.293769:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.293792:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 13 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.293803:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8435:1876316239594240:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395117.293868:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.300187:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8435:1876316239594240:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395117.300225:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.300239:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363400) 00010000:00010000:0.0:1789395117.300241:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.300245:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.300254:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345e00, rc 0) 00000100:00100000:0.0:1789395117.300364:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6511:x1876316239594112:12345-0@lo:101:mdt00_000.0 Request processed in 6682us (7235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.300373:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:3.0:1789395117.301849:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.301880:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231683328 00000100:00100000:3.0:1789395117.301887:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231683328 00010000:00010000:3.0:1789395117.301919:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 14 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.301954:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1520 00000100:00100000:3.0:1789395117.301964:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231683328:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.301977:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.301985:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 14 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.302002:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 14 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.302021:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169be4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105b8f expref: 14 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.302038:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363400) 00010000:00010000:3.0:1789395117.302044:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.302054:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.302064:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.302110:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.302154:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594112:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395117.302174:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302186:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.302247:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239594368:0@lo:105: 00000100:00100000:3.0:1789395117.302290:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.302318:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.302338:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239594368 00000100:00100000:1.0:1789395117.302344:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239594368 00000100:00100000:1.0:1789395117.302376:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1789395117.302457:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:16674:x1876316239594368:12345-0@lo:105: 00010000:00010000:1.0:1789395117.302467:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302478:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302487:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302495:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302508:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302516:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.302548:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca015200) 00000100:00100000:1.0:1789395117.302690:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:16674:x1876316239594368:12345-0@lo:105: Request processed in 235us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.302698:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00010000:00010000:0.0:1789395117.302705:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.302718:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395117.302742:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395117.302775:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.302784:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.302794:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.302810:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594496:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395117.302844:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.302857:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239594368:0@lo:105: 00000100:00100000:0.0:1789395117.302874:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b600 going to sleep for 11 seconds 00010000:00010000:3.0:1789395117.302875:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.302926:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231683328:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 962us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.302937:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1520 00000100:00100000:1.0:1789395117.302998:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239594496 00000100:00100000:1.0:1789395117.303002:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239594496 00000100:00100000:1.0:1789395117.303037:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:1.0:1789395117.303045:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6511:x1876316239594496:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395117.303059:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.303090:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169d42 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.303110:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169d42 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.303122:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d42 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.303130:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x61ea7fc2 (ffff89a4c7eb6b00) 00010000:00010000:1.0:1789395117.303133:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.303137:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417400, rc 0) 00000100:00100000:1.0:1789395117.303177:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594496:12345-0@lo:101:mdt00_000.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.303184:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:3.0:1789395117.303308:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594496:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395117.303324:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.303334:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395117.303780:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1789395117.303817:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594624:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.303849:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.303929:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.303964:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239594624 00000100:00100000:0.0:1789395117.303968:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239594624 00000100:00100000:0.0:1789395117.304029:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1789395117.304037:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395117.304115:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594624:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.304132:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:1.0:1789395117.304155:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594624:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.304200:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594752:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.304236:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.304261:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.304319:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239594752 00000100:00100000:3.0:1789395117.304324:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239594752 00000100:00100000:3.0:1789395117.304352:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1789395117.304358:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.304863:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594752:12345-0@lo:1000:mdt00_000.0 Request processed in 504us (626us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395117.304871:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1789395117.304905:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594752:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.305064:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594880:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.305101:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.305124:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.305250:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239594880 00000100:00100000:3.0:1789395117.305254:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239594880 00000100:00100000:3.0:1789395117.305286:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:3.0:1789395117.305293:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.305935:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239594880:12345-0@lo:1000:mdt00_000.0 Request processed in 641us (832us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395117.305941:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:1.0:1789395117.306015:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239594880:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.306078:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595008:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.306106:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.306159:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.306277:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595008 00000100:00100000:3.0:1789395117.306281:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595008 00000100:00100000:3.0:1789395117.306338:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:3.0:1789395117.306352:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239595008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.306435:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239595008:12345-0@lo:1000:mdt00_000.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.306442:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:1.0:1789395117.306505:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595008:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.306551:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.306572:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.307657:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.307793:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595136 00000100:00100000:3.0:1789395117.307799:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595136 00000100:00100000:3.0:1789395117.307828:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:3.0:1789395117.307835:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239595136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.307909:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239595136:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.307916:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:1.0:1789395117.308038:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.308098:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395117.308655:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.308676:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.308815:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595264 00000100:00100000:3.0:1789395117.308820:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595264 00000100:00100000:3.0:1789395117.308846:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:3.0:1789395117.308853:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239595264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395117.308906:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6511:x1876316239595264:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.308913:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:1.0:1789395117.308980:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595264:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1789395117.312936:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].377, 2168 off571792 00000040:00080000:1.0:1789395117.313033:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].377, 2368 off624960 00000004:00080000:1.0:1789395117.313039:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c9b9c600 with version 715 00000004:00080000:3.0:1789395117.313244:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 715 rpc_version 715 00000020:00100000:3.0:1789395117.313286:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395117.313297:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a41f80 x1876316239595520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395117.313318:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239595520:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395117.313579:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.313709:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.313852:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595520 00000100:00100000:1.0:1789395117.313860:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595520 00000100:00100000:1.0:1789395117.313909:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1789395117.313918:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239595520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395117.316316:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7455:x1876316239595520:12345-0@lo:1000:osp_up0-1.0 Request processed in 2393us (2731us total) trans 4294983429 rc 0/0 00000100:00100000:1.0:1789395117.316329:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1789395117.316511:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239595520:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1789395117.316858:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316873:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316885:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316903:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316911:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316918:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316951:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316958:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.316967:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.316986:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595648:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789395117.317034:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.317062:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.317103:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595648 00000100:00100000:1.0:1789395117.317108:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595648 00000100:00100000:1.0:1789395117.317316:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1789395117.317325:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6511:x1876316239595648:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395117.317351:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.317368:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169d5e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.317407:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169d5e expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.317419:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d5e expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.317428:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395117.317430:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.317434:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416e00, rc 0) 00000100:00100000:1.0:1789395117.317486:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:6511:x1876316239595648:12345-0@lo:101:mdt00_000.0 Request processed in 162us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.317492:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1789395117.317786:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239595648:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395117.317801:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317812:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.317833:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb7be48 reply state 0000000055207543 transno 4294968405 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317845:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317852:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff89a4c7b89100) 00010000:00010000:3.0:1789395117.317854:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395117.317858:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395117.317863:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317871:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395117.317880:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc7:0x0] 00000004:00010000:3.0:1789395117.317885:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb7be48 reply state 0000000055207543 transno 4294968405 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317893:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317900:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff89a4c7b89f00) 00010000:00010000:3.0:1789395117.317902:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395117.317904:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1789395117.317908:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x188:0x0]: returning size 4096 00000004:00080000:3.0:1789395117.317916:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1789395117.317923:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317930:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317937:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317955:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395117.317959:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1789395117.317967:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395117.317973:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.317981:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395117.317986:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.317995:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.318019:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.318026:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395117.318044:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.318057:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015200/0xff35729af3169d34 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169d3b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.318087:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.318089:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.318091:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.318103:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239595776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.318145:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.318563:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595776 00000100:00100000:1.0:1789395117.318569:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595776 00010000:00010000:3.0:1789395117.318673:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.318874:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1789395117.318884:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3639:x1876316239595776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395117.318894:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395117.318909:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169d3b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169d34 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.318923:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363400) 00010000:00010000:1.0:1789395117.318931:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395117.318970:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3639:x1876316239595776:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.318977:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00010000:00010000:3.0:1789395117.319021:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.319057:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239595776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.319160:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17594:x1876316231683200:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 28273us (28459us total) trans 4294968405 rc 0/0 00000100:00100000:3.0:1789395117.319167:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23359 00000100:00100000:0.0:1789395117.352272:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.380317:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.380381:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231683712 00000100:00100000:0.0:1789395117.380416:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231683712 00000100:00100000:0.0:1789395117.380470:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23361 00000100:00100000:0.0:1789395117.380480:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17596:x1876316231683712:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395117.380499:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.380522:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014800/0xff35729af3169d6c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bd5 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380583:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169d73 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380596:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169d73 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380606:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169d73 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380617:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380627:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d42 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380635:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.380666:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169d42 expref: 8 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.380681:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239595904:0@lo:104: 00000100:00100000:0.0:1789395117.380724:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.380770:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.380914:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239595904 00000100:00100000:1.0:1789395117.380919:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239595904 00000100:00100000:1.0:1789395117.380947:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1789395117.380955:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239595904:12345-0@lo:104: 00010000:00010000:1.0:1789395117.380966:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.381025:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395117.381031:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239595904:12345-0@lo:104: Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.381040:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00010000:00010000:1.0:1789395117.381061:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395117.381076:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.381086:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.381091:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.381100:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.381125:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.381131:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.381148:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.381155:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169d42 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169d49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.381173:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.381175:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.381177:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395117.381187:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239596032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.381215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.381287:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596032 00000100:00100000:3.0:1789395117.381301:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596032 00010000:00010000:3.0:1789395117.381319:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169d42 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.381347:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1789395117.381353:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3636:x1876316239596032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.381364:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789395117.382478:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239595904:0@lo:104: 00010000:00010000:0.0:1789395117.382498:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395117.386655:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983429 is committed 00000020:00080000:3.0:1789395117.386680:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 381 batchid updated 00000020:00080000:0.0:1789395117.386723:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 381 00010000:00010000:3.0:1789395117.386767:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417400/0xff35729af3169d49 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169d42 expref: 7 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395117.386780:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca31b240 with version 724 00010000:00010000:3.0:1789395117.386786:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x61ea7fc2 (ffff89a4c7eb6b00) 00010000:00010000:3.0:1789395117.386793:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395117.386797:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 381 cancel update log [0x240000401:0x3:0x0].379: rc = 0 00010000:00010000:3.0:1789395117.386805:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.386814:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.386841:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1789395117.386880:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 381 cancel update log [0x200000400:0x3:0x0].381: rc = 0 00000020:00080000:0.0:1789395117.386890:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 381 00010000:00010000:0.0:1789395117.386903:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.386912:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015600/0xff35729af3169d7a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.387019:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10512:1876316239596160:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395117.387114:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.387152:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.387165:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596160 00000100:00100000:1.0:1789395117.387175:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596160 00000100:00100000:3.0:1789395117.387211:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1876316239596032:12345-0@lo:103:ldlm_bl.0 Request processed in 5856us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.387224:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1789395117.387224:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:1.0:1789395117.387238:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:10512:x1876316239596160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395117.387286:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239596032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.387324:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:10512:x1876316239596160:12345-0@lo:1000:mdt00_004.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.387332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1789395117.387849:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596416 00000100:00100000:0.0:1789395117.387853:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596416 00000100:00100000:0.0:1789395117.387916:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:0.0:1789395117.387926:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239596416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395117.388103:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239596416:12345-0@lo:1000:osp_up1-0.0 Request processed in 178us (565us total) trans 4294968406 rc 0/0 00000100:00100000:0.0:1789395117.388110:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1789395117.388176:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239596416:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.388408:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10512:1876316239596160:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789395117.397508:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.397984:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231683840 00000100:00100000:3.0:1789395117.397994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231683840 00000100:00100000:3.0:1789395117.398133:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23362 00000100:00100000:3.0:1789395117.398145:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17596:x1876316231683840:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.398170:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.398191:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169d88 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.398257:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169d8f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.398271:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169d8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.398281:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169d8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395117.398378:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x188:0x0]: returning size 4096 00000004:00200000:3.0:1789395117.398411:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395117.398451:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169d88 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bdc expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.398472:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169d8f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bdc expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.398481:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff89a4c7b89f00) 00010000:00010000:3.0:1789395117.398484:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395117.398487:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345400, rc 0) 00000100:00100000:3.0:1789395117.398545:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17596:x1876316231683840:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 402us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.398552:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23362 00000100:00100000:3.0:1789395117.404222:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.404304:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231683968 00000100:00100000:0.0:1789395117.404315:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231683968 00000100:00100000:0.0:1789395117.404370:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23363 00000100:00100000:0.0:1789395117.404381:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17596:x1876316231683968:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395117.404438:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.404460:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169d96 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105be3 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.404519:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.404533:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.404544:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395117.404590:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xc7:0x0]: returning size 4096 00000004:00200000:0.0:1789395117.404596:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395117.404631:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169d96 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.404650:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 19 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.404658:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff89a4c7b89100) 00010000:00010000:0.0:1789395117.404660:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395117.404664:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015600, rc 0) 00000100:00100000:0.0:1789395117.404723:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17596:x1876316231683968:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 343us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.404731:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23363 00000100:00100000:3.0:1789395117.413935:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684096 00000100:00100000:3.0:1789395117.413947:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684096 00000100:00100000:3.0:1789395117.414015:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23364 00000100:00100000:3.0:1789395117.414024:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17596:x1876316231684096:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.414044:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.414063:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169da4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bea expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.414134:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.414148:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169d5e expref: 5 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.414156:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.414188:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169d5e expref: 5 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.414202:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239596544:0@lo:104: 00000100:00100000:3.0:1789395117.414268:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.414313:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.414452:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596544 00000100:00100000:1.0:1789395117.414457:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596544 00000100:00100000:1.0:1789395117.414918:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1789395117.414927:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239596544:12345-0@lo:104: 00010000:00010000:1.0:1789395117.414939:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.414998:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395117.415004:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239596544:12345-0@lo:104: Request processed in 80us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.415010:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1789395117.415080:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239596544:0@lo:104: 00010000:00010000:0.0:1789395117.415101:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.419169:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395117.419187:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.419200:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344c00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395117.419207:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.419218:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.419265:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.419273:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395117.419311:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.419320:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344c00/0xff35729af3169d5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169d65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.419343:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.419344:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.419346:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395117.422093:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596672 00000100:00100000:0.0:1789395117.422108:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596672 00010000:00010000:0.0:1789395117.422155:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169d5e expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.422203:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1789395117.422213:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3637:x1876316239596672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.422227:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.424599:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416e00/0xff35729af3169d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169d5e expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.424622:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:0.0:1789395117.424628:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.424643:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.424652:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.424685:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.424765:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239596672:12345-0@lo:103:ldlm_bl.0 Request processed in 2552us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.424775:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00010000:00010000:3.0:1789395117.424849:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.424859:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395117.424908:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xc7:0x0]: returning size 4096 00000004:00200000:3.0:1789395117.424913:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395117.424955:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af3169da4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.424978:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.424986:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:3.0:1789395117.424989:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395117.424991:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345a00, rc 0) 00000100:00100000:3.0:1789395117.425042:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17596:x1876316231684096:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 11019us (13781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.425049:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23364 00000100:00100000:1.0:1789395117.431194:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.431262:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684480 00000100:00100000:0.0:1789395117.431272:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684480 00000100:00100000:0.0:1789395117.431335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23365 00000100:00100000:0.0:1789395117.431346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17596:x1876316231684480:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:0.0:1789395117.431447:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.431471:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345400/0xff35729af3169d8f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bdc expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.431491:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff89a4c7b89f00) 00010000:00010000:0.0:1789395117.431496:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395117.431547:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.431555:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.431565:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.431590:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239596800:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395117.431646:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.431673:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.431754:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596800 00000100:00100000:1.0:1789395117.431759:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596800 00000100:00100000:1.0:1789395117.431793:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:1.0:1789395117.431801:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f7837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:6512:x1876316239596800:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.431811:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.431828:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169db9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169db2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.431857:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169db9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169db2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.431870:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169db9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169db2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.431876:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395117.431879:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.431881:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416a00, rc 0) 00000100:00100000:1.0:1789395117.431926:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f7837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6512:x1876316239596800:12345-0@lo:101:mdt00_001.0 Request processed in 126us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.431933:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1789395117.432135:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983429 gen 2 00000004:00080000:0.0:1789395117.432141:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983428 committed transno 4294983429 00000004:00080000:0.0:1789395117.432174:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983429 committed transno 4294983429 00000100:00100000:0.0:1789395117.432193:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239596800:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395117.432209:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.432219:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395117.432234:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395117.432254:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.432260:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.432267:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.432279:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239596928:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395117.432304:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.432329:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.432531:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239596928 00000100:00100000:1.0:1789395117.432535:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239596928 00000100:00100000:1.0:1789395117.432565:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1789395117.432572:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6512:x1876316239596928:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.432581:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.432594:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169dc7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169dc0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.432610:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169dc0 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.432620:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dc0 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.432633:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x61ea7fc2 (ffff89a4c7eb6100) 00010000:00010000:1.0:1789395117.432636:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.432638:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417c00, rc 0) 00000100:00100000:1.0:1789395117.432672:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239596928:12345-0@lo:101:mdt00_001.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.432679:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1789395117.432706:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239596928:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.432717:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.432726:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395117.432737:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1789395117.432766:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597056:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.432795:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.432809:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.432822:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239597056 00000100:00100000:1.0:1789395117.432825:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239597056 00000100:00100000:1.0:1789395117.432847:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1789395117.432853:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239597056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.432905:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239597056:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.432912:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1789395117.432937:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597056:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.432969:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597184:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.432989:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.433002:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.433012:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239597184 00000100:00100000:1.0:1789395117.433015:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239597184 00000100:00100000:1.0:1789395117.433031:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1789395117.433037:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239597184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.433120:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239597184:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (129us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395117.433127:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1789395117.433150:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597184:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789395117.433185:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.433191:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.433199:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.433209:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597312:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395117.433232:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.433245:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.433255:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239597312 00000100:00100000:1.0:1789395117.433258:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239597312 00000100:00100000:1.0:1789395117.433274:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:1.0:1789395117.433280:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239597312:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.433287:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.433298:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169dd5 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169dce expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.433315:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af3169d81 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bd5 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.433324:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169dd5 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169dce expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.433345:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af3169d81 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bd5 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.433358:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af3169d81 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bd5 expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.433369:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8435:1876316239597440:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395117.433453:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.433953:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.434241:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684224 00000100:00100000:3.0:1789395117.434247:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684224 00010000:00010000:3.0:1789395117.434271:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af3169d81 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bd5 expref: 15 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.434304:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1523 00000100:00100000:3.0:1789395117.434312:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231684224:12345-192.168.203.54@tcp:103:rmdir.0 00010000:00010000:3.0:1789395117.434324:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.434330:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af3169d81 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bd5 expref: 15 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.434341:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af3169d81 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bd5 expref: 15 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.434358:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:3.0:1789395117.434363:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169dd5 lrc: 3/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169dce expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.434373:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169dd5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169dce expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.434381:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169dd5 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169dce expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.434427:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af3169dd5 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dce expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.434438:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239597568:0@lo:105: 00000100:00100000:3.0:1789395117.434473:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.434499:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.435101:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239597568:0@lo:105: 00010000:00010000:3.0:1789395117.435115:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.435154:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231684224:12345-192.168.203.54@tcp:103:rmdir.0 Request processed in 842us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.435161:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1523 00000100:00100000:1.0:1789395117.438860:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597312:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.438879:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.438910:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169ddc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.438922:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169ddc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.438931:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417400/0xff35729af3169ddc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.438952:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.438961:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.438969:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.439000:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.439206:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 18 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.439221:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239597696:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395117.442835:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.450990:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684608 00000100:00100000:3.0:1789395117.450999:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684608 00010000:00010000:3.0:1789395117.451038:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 19 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.451128:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1524 00000100:00100000:3.0:1789395117.451138:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231684608:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.451153:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395117.451159:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239597696:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395117.451160:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 19 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.451181:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 19 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451192:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.451202:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015600/0xff35729af3169d9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105be3 expref: 19 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.451218:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff89a4c7b89100) 00010000:00010000:3.0:1789395117.451223:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.451232:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.451239:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.451271:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.451332:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231684608:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 195us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.451339:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1524 00010000:00010000:1.0:1789395117.451378:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451413:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af3169de3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451458:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451467:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451476:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.451493:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239597824:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395117.451530:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.451554:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.451568:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239597824 00000100:00100000:1.0:1789395117.451572:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239597824 00000100:00100000:1.0:1789395117.451602:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:1.0:1789395117.451608:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6512:x1876316239597824:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.451622:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.451636:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169dea expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451657:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451665:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451687:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.451699:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 13 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.451716:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239597952:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395117.451754:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.457361:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239597952:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395117.457414:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.457427:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395117.457430:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395117.457434:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.457443:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.457451:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417000, rc 0) 00000100:00100000:1.0:1789395117.457513:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:6512:x1876316239597824:12345-0@lo:101:mdt00_001.0 Request processed in 5904us (5982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.457521:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:0.0:1789395117.459421:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684736 00000100:00100000:0.0:1789395117.459430:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684736 00010000:00010000:0.0:1789395117.459463:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.459510:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1525 00000100:00100000:0.0:1789395117.459520:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231684736:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.459544:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.459551:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.459564:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.459585:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bea expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.459601:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:0.0:1789395117.459608:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.459617:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.459625:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.459657:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417000/0xff35729af3169df1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169dea expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.459676:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239598080:0@lo:105: 00000100:00100000:0.0:1789395117.459716:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.459758:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3540 going to sleep for 11 seconds 00010000:00010000:1.0:1789395117.460086:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.460096:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.460762:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239598208:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395117.460807:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.460836:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.463195:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239598080:0@lo:105: 00010000:00010000:0.0:1789395117.463216:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.463269:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231684736:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 3748us (3975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.463278:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1525 00000100:00100000:3.0:1789395117.464496:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239598208:0@lo:403:mdt00_001.0 00000004:00080000:0.0:1789395117.474219:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 716 rpc_version 716 00000020:00100000:0.0:1789395117.474266:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395117.474277:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c988e300 x1876316239598464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395117.474300:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239598464:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395117.474364:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.474424:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.475482:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239598464:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395117.476972:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789395117.476980:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.476987:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.476992:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.477001:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477031:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477038:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.477060:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477079:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417e00/0xff35729af3169dea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169df1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477098:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789395117.477103:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477109:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.477113:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.477132:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477148:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 2/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477154:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.477160:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 1/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477167:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169dce lrc: 0/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169dd5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477331:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395117.477334:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477341:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.477345:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.477352:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477369:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477376:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.477417:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477425:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af3169db2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169db9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.477439:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.477449:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.477450:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395117.477473:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239598592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.477521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.477718:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395117.477725:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239598720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.477749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.477776:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395117.477784:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239598848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.477846:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395117.478287:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395117.480329:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239598720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.480348:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239598592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.480420:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239598848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.480861:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.517132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684864 00000100:00100000:3.0:1789395117.517142:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684864 00000100:00100000:3.0:1789395117.517209:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23366 00000100:00100000:3.0:1789395117.517219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17597:x1876316231684864:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395117.517249:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.517270:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169df8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bf1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517334:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517348:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517359:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517460:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517469:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517477:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517520:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517527:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517544:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517550:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517557:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395117.517561:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517569:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517581:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395117.517584:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.517588:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517816:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169dff lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517833:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517840:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517846:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517852:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395117.517855:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517862:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517874:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x101e480e (ffff89a3ca363200) 00010000:00010000:3.0:1789395117.517877:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.517880:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517886:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e06 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517920:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169df8 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf1 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517930:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395117.517932:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.517935:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345e00/0xff35729af3169df8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf1 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.517944:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345e00, rc 0) 00000100:00100000:3.0:1789395117.518006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17597:x1876316231684864:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 788us (1058us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395117.518014:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23366 00000100:00100000:3.0:1789395117.525517:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.525712:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231684992 00000100:00100000:0.0:1789395117.525722:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231684992 00000100:00100000:0.0:1789395117.525792:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23367 00000100:00100000:0.0:1789395117.525803:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17597:x1876316231684992:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395117.525823:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.525847:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169e0d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bf8 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.525911:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.525924:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.525935:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395117.525981:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1789395117.525985:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395117.526020:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af3169e0d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.526039:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.526048:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395117.526052:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395117.526055:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014c00, rc 0) 00000100:00100000:0.0:1789395117.526206:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17597:x1876316231684992:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 404us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.526213:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23367 00000100:00100000:0.0:1789395117.532433:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.532936:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239598976 00000100:00100000:0.0:1789395117.532939:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239598976 00000100:00100000:0.0:1789395117.532964:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:0.0:1789395117.532969:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6512:x1876316239598976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.533027:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6512:x1876316239598976:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.533033:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:0.0:1789395117.533731:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239599104 00000100:00100000:0.0:1789395117.533736:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239599104 00000100:00100000:0.0:1789395117.534377:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1789395117.534445:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6512:x1876316239599104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.534641:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:6512:x1876316239599104:12345-0@lo:1000:mdt00_001.0 Request processed in 256us (1416us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395117.534650:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:3.0:1789395117.535147:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239599104:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789395117.535415:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.535432:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.535447:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.535463:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239599232:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395117.535498:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.535543:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.539767:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8436:1876316239599360:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395117.539802:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af3169e22 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e1b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.539814:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395117.539817:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.539822:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af3169e22 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e1b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.539831:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfc00, rc 0) 00000100:00100000:3.0:1789395117.539897:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6512:x1876316239599232:12345-0@lo:101:mdt00_001.0 Request processed in 4205us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.539905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1789395117.541025:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.541712:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239599488 00000100:00100000:3.0:1789395117.541717:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239599488 00000100:00100000:3.0:1789395117.541749:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1789395117.541758:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239599488:12345-0@lo:105: 00010000:00010000:3.0:1789395117.541769:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.541778:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.541786:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.541793:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.541800:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.541808:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.541829:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3c9345e00) 00000100:00100000:3.0:1789395117.541868:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239599488:12345-0@lo:105: Request processed in 111us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.541880:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1789395117.541910:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239599488:0@lo:105: 00010000:00010000:3.0:1789395117.541923:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.541960:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231685376:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 472us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.541973:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1526 00000100:00100000:1.0:1789395117.542045:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239599616 00000100:00100000:1.0:1789395117.542050:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239599616 00000100:00100000:1.0:1789395117.542094:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:1.0:1789395117.542102:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:6512:x1876316239599616:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.542118:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.542133:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169e30 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169e29 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.542159:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169e30 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169e29 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.542170:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169e30 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e29 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.542178:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x101e480e (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395117.542181:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.542183:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416e00, rc 0) 00000100:00100000:1.0:1789395117.542224:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239599616:12345-0@lo:101:mdt00_001.0 Request processed in 124us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.542230:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:1.0:1789395117.542781:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239599744 00000100:00100000:1.0:1789395117.542786:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239599744 00000100:00100000:1.0:1789395117.542813:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:1.0:1789395117.542820:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239599744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.542886:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239599744:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.542892:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:1.0:1789395117.543137:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239599872 00000100:00100000:1.0:1789395117.543142:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239599872 00000100:00100000:1.0:1789395117.543170:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1789395117.543176:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239599872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.543253:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239599872:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395117.543260:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1789395117.543560:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600000 00000100:00100000:3.0:1789395117.543565:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600000 00000100:00100000:3.0:1789395117.543593:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1789395117.543600:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.543692:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600000:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395117.543700:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1789395117.543850:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600128 00000100:00100000:3.0:1789395117.543855:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600128 00000100:00100000:3.0:1789395117.543885:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1789395117.543891:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.543945:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600128:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.543952:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1789395117.544096:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600256 00000100:00100000:3.0:1789395117.544099:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600256 00000100:00100000:3.0:1789395117.544128:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:3.0:1789395117.544135:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.544201:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600256:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.544207:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:1.0:1789395117.544343:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600384 00000100:00100000:1.0:1789395117.544347:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600384 00000100:00100000:1.0:1789395117.544372:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1789395117.544379:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.544458:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239600384:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.544465:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000004:00080000:1.0:1789395117.545508:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 725 rpc_version 725 00000020:00100000:1.0:1789395117.545537:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.545546:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d5c00 x1876316239600640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.545562:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239600640:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.545603:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.545627:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.545775:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600640 00000100:00100000:3.0:1789395117.545781:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600640 00000100:00100000:3.0:1789395117.545818:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:3.0:1789395117.545826:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239600640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.546370:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239600640:12345-0@lo:1000:osp_up1-0.0 Request processed in 544us (765us total) trans 4294968408 rc 0/0 00000100:00100000:3.0:1789395117.546378:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:1.0:1789395117.546521:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239600640:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.546774:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600768 00000100:00100000:1.0:1789395117.546783:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600768 00000100:00100000:1.0:1789395117.546815:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1789395117.546822:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:6512:x1876316239600768:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.546836:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.546861:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 2/0,0 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169e45 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.546879:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169e45 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.546891:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e45 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.546899:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395117.546902:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.546906:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417e00, rc 0) 00000100:00100000:1.0:1789395117.546943:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239600768:12345-0@lo:101:mdt00_001.0 Request processed in 122us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.546949:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00010000:00010000:0.0:1789395117.547419:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395117.547426:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.547434:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395117.547439:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.547457:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.547482:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.547488:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395117.547517:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.547529:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345e00/0xff35729af3169e1b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169e22 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.547545:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.547547:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.547549:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.547753:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395117.547765:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239600896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.547798:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.548249:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239600896 00000100:00100000:0.0:1789395117.548255:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239600896 00000100:00100000:0.0:1789395117.548291:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1789395117.548298:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+15:3636:x1876316239600896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.548307:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.548323:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af3169e22 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169e1b expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.548335:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:0.0:1789395117.548344:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.548416:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+14:3636:x1876316239600896:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.548424:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1789395117.548436:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239600896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395117.573373:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.573475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231685632 00000100:00100000:3.0:1789395117.573484:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231685632 00000100:00100000:3.0:1789395117.573541:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23369 00000100:00100000:3.0:1789395117.573551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17598:x1876316231685632:12345-192.168.203.54@tcp:36:mkdir.0 00000100:00100000:3.0:1789395117.573693:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17598:x1876316231685632:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 143us (330us total) trans 0 rc -17/-17 00000100:00100000:3.0:1789395117.573700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23369 00000100:00100000:1.0:1789395117.598654:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231685760 00000100:00100000:1.0:1789395117.598665:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231685760 00000100:00100000:1.0:1789395117.598719:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23370 00000100:00100000:1.0:1789395117.598728:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17599:x1876316231685760:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395117.598746:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.598766:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169e53 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105bff expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598826:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598851:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598862:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598873:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598883:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169e30 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e29 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598895:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.598926:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169e30 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169e29 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.598940:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239601024:0@lo:104: 00000100:00100000:1.0:1789395117.599099:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.599137:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3aa80 going to sleep for 11 seconds 00010000:00010000:1.0:1789395117.599418:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395117.599424:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df800/0xff35729af3169e29 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169e30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.599432:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.599437:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df800/0xff35729af3169e29 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169e30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.599456:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df800/0xff35729af3169e29 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169e30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.599481:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df800/0xff35729af3169e29 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169e30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.599487:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.599509:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df800/0xff35729af3169e29 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169e30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.599517:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df800/0xff35729af3169e29 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169e30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.599751:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.599754:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.599755:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395117.599764:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395117.599775:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239601152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.599805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.600298:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239601024:0@lo:104: 00010000:00010000:1.0:1789395117.600317:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605271:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.605291:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605331:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605339:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395117.605373:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014600/0xff35729af3169dc0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169dc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395117.605414:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968408 is committed 00000001:00080000:0.0:1789395117.605433:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968407 is committed 00000020:00080000:0.0:1789395117.605456:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3c9b9c9c0 refcount 2 committed 0 result 0 batchid 377 00000020:00080000:0.0:1789395117.605461:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9c600 00000020:00080000:0.0:1789395117.605464:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].377 00000020:00080000:0.0:1789395117.605467:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0e00 00000020:00080000:0.0:1789395117.605469:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].377 00000020:00080000:0.0:1789395117.605481:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3c9b9c540 refcount 2 committed 0 result 0 batchid 376 00000020:00080000:0.0:1789395117.605484:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9cf00 00000020:00080000:0.0:1789395117.605487:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].375 00000020:00080000:0.0:1789395117.605488:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0600 00000020:00080000:0.0:1789395117.605491:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].376 00000020:00080000:0.0:1789395117.605494:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 374 batchid updated 00000020:00080000:0.0:1789395117.605504:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3c7a3a6c0 refcount 2 committed 0 result 0 batchid 375 00000020:00080000:0.0:1789395117.605506:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919cb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7a3ae40 00000020:00080000:0.0:1789395117.605509:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].374 00000020:00080000:0.0:1789395117.605511:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82f9200 00000020:00080000:0.0:1789395117.605513:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].375 00000020:00080000:0.0:1789395117.605519:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 373 batchid updated 00000100:00100000:0.0:1789395117.605544:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789395117.605563:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239601280:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395117.605627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395117.605668:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605676:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605682:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605688:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.605692:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605699:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605711:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x917910c6 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395117.605714:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.605718:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605724:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169bf2 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605735:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605742:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605747:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605752:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.605755:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605761:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605769:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff89a3c8b1dc00) 00010000:00010000:0.0:1789395117.605771:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.605774:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605780:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169bf9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605792:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605798:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605804:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605809:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.605812:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605818:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605829:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395117.605831:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.605834:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605840:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169c00 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605855:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605862:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605868:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605873:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.605876:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605882:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605890:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x917910c6 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395117.605893:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.605896:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605902:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af3169c54 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605919:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605925:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605930:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605934:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.605937:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605942:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605950:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395117.605952:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.605955:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605960:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169cd2 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605981:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605987:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605993:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.605998:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.606001:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606006:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606013:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395117.606016:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.606019:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606024:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af3169cd9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606036:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606042:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606048:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606053:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.606056:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606062:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606084:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395117.606086:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.606090:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606095:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af3169d03 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606109:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606115:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606121:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606125:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.606128:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606134:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606141:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff89a4c7b89f00) 00010000:00010000:0.0:1789395117.606143:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.606146:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606152:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345000/0xff35729af3169d50 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606170:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606176:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606182:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606186:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.606189:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606195:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606202:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff89a4c7b89100) 00010000:00010000:0.0:1789395117.606204:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.606207:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606213:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345600/0xff35729af3169d57 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395117.606231:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 377 committed batchid 374 00000004:00080000:0.0:1789395117.606330:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca349180 with version 717 00000020:00080000:0.0:1789395117.606342:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 373 cancel update log [0x200000401:0x3:0x0].372: rc = 0 00000020:00080000:0.0:1789395117.606379:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 373 cancel update log [0x240000400:0x3:0x0].373: rc = 0 00000004:00080000:0.0:1789395117.606420:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca349000 with version 718 00000020:00080000:0.0:1789395117.606423:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 374 cancel update log [0x200000401:0x3:0x0].373: rc = 0 00000020:00080000:0.0:1789395117.606444:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 374 cancel update log [0x240000400:0x3:0x0].374: rc = 0 00000020:00080000:0.0:1789395117.606450:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 374 00010000:00010000:0.0:1789395117.606499:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169e30 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169e29 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606510:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x101e480e (ffff89a4c7eb6a00) 00010000:00010000:0.0:1789395117.606514:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606522:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606530:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606552:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.606584:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239601152:12345-0@lo:103:ldlm_bl.0 Request processed in 5024us (6778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.606593:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1789395117.606613:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239601280 00000100:00100000:0.0:1789395117.606619:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239601280 00000100:00100000:0.0:1789395117.606655:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1789395117.606663:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3638:x1876316239601280:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1789395117.606675:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.606688:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417c00/0xff35729af3169dc7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169dc0 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606698:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x61ea7fc2 (ffff89a4c7eb6100) 00010000:00010000:0.0:1789395117.606705:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.606730:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239601280:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 68us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.606736:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000004:00080000:0.0:1789395117.606754:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 717 rpc_version 717 00000020:00100000:0.0:1789395117.606772:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395117.606778:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c988c380 x1876316239601536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395117.606792:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239601536:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395117.606822:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.606837:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349540 going to sleep for 11 seconds 00010000:00010000:0.0:1789395117.606853:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.606861:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.606933:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239601664:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395117.606958:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.606986:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.607003:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239601536 00000100:00100000:0.0:1789395117.607007:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239601536 00000100:00100000:0.0:1789395117.607029:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239601664 00000100:00100000:0.0:1789395117.607032:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239601664 00000100:00100000:0.0:1789395117.607043:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:0.0:1789395117.607048:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239601536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395117.607166:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239601536:12345-0@lo:1000:osp_up0-1.0 Request processed in 117us (343us total) trans 4294983432 rc 0/0 00000100:00100000:0.0:1789395117.607173:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:0.0:1789395117.607186:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1789395117.607192:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:10512:x1876316239601664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395117.607234:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:10512:x1876316239601664:12345-0@lo:1000:mdt00_004.0 Request processed in 42us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.607241:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1789395117.607278:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239601536:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1789395117.607286:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 718 rpc_version 718 00000020:00100000:0.0:1789395117.607296:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395117.607301:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c988c000 x1876316239601920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395117.607313:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239601920:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395117.607339:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.607352:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.607370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239601280:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395117.607408:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239601664:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789395117.607442:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607454:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607462:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.607481:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607492:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607498:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607503:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607509:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607514:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.607517:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607523:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607529:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:0.0:1789395117.607531:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.607534:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607540:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417600/0xff35729af3169e5a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607549:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607555:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607560:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607566:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.607568:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607573:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607579:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x101e480e (ffff89a4c7eb6a00) 00010000:00010000:0.0:1789395117.607581:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.607584:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607589:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af3169e61 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607622:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af3169e53 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bff expref: 8 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607638:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169e68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bff expref: 7 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.607646:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:0.0:1789395117.607648:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395117.607651:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014800, rc 0) 00000100:00100000:0.0:1789395117.607693:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17599:x1876316231685760:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 8967us (9200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.607700:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23370 00000100:00100000:0.0:1789395117.607802:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239601920 00000100:00100000:0.0:1789395117.607806:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239601920 00000100:00100000:0.0:1789395117.607821:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:0.0:1789395117.607827:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7455:x1876316239601920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395117.607895:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239601920:12345-0@lo:1000:osp_up0-1.0 Request processed in 68us (556us total) trans 4294983433 rc 0/0 00000100:00100000:0.0:1789395117.607902:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:0.0:1789395117.607929:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239601920:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395117.608897:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239601152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.612049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.612645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231685888 00000100:00100000:0.0:1789395117.612655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231685888 00000100:00100000:0.0:1789395117.612710:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23371 00000100:00100000:0.0:1789395117.612720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17599:x1876316231685888:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:0.0:1789395117.612744:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.612764:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169e6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.612824:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169e76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.612836:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.612858:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395117.612952:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1518:0x0]: returning size 4096 00000004:00200000:0.0:1789395117.612957:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395117.613247:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169e6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c06 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.613268:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c06 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.613276:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:0.0:1789395117.613279:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395117.613282:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014a00, rc 0) 00000100:00100000:0.0:1789395117.613335:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17599:x1876316231685888:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 617us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.613342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23371 00000100:00100000:3.0:1789395117.626866:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.627077:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231686016 00000100:00100000:1.0:1789395117.627088:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231686016 00000100:00100000:1.0:1789395117.627139:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23372 00000100:00100000:1.0:1789395117.627149:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17599:x1876316231686016:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395117.627169:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.627188:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af3169e7d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c0d expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.627239:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.627253:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.627264:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395117.627307:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xca:0x0]: returning size 4096 00000004:00200000:1.0:1789395117.627312:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395117.627341:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af3169e7d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c0d expref: 19 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.627357:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c0d expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.627366:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff89a3ca2fb700) 00010000:00010000:1.0:1789395117.627370:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395117.627373:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417a00, rc 0) 00000100:00100000:1.0:1789395117.627439:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17599:x1876316231686016:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 292us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.627453:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23372 00000100:00100000:3.0:1789395117.630474:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231686144 00000100:00100000:3.0:1789395117.630484:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231686144 00000100:00100000:3.0:1789395117.630544:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23373 00000100:00100000:3.0:1789395117.630555:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17599:x1876316231686144:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.630572:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.630590:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af3169e8b lrc: 2/0,0 mode: --/CR res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c14 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.630641:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.630654:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e45 expref: 5 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.630663:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.630699:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169e45 expref: 5 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.630712:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239602048:0@lo:104: 00000100:00100000:3.0:1789395117.630756:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.630790:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.630807:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239602048 00000100:00100000:3.0:1789395117.630811:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239602048 00000100:00100000:3.0:1789395117.630835:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1789395117.630842:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239602048:12345-0@lo:104: 00010000:00010000:3.0:1789395117.630854:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.630905:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395117.630911:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239602048:12345-0@lo:104: Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.630917:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00010000:00010000:3.0:1789395117.630936:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395117.630941:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.630950:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395117.630955:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.630964:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.631107:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.631113:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395117.631137:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.631145:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dfe00/0xff35729af3169e45 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169e4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.631163:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.631165:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.631166:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.632065:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239602176 00000100:00100000:3.0:1789395117.632080:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239602176 00010000:00010000:3.0:1789395117.632103:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169e45 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.632135:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:3.0:1789395117.632142:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6281450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239602176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.632152:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1789395117.636142:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 377 batchid updated 00010000:00010000:3.0:1789395117.636476:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af3169e4c lrc: 0/0,0 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af3169e45 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.636494:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:3.0:1789395117.636499:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.636513:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.636521:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.636558:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.636628:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6281450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239602176:12345-0@lo:103:ldlm_bl.0 Request processed in 4485us (5337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.636637:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000004:00080000:1.0:1789395117.636804:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 719 rpc_version 719 00000020:00100000:1.0:1789395117.636829:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.636836:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d7480 x1876316239602432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.636868:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239602432:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395117.636906:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.636934:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.638861:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239602432:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395117.638875:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 720 rpc_version 720 00000020:00100000:1.0:1789395117.638897:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.638902:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6a00 x1876316239602688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.638918:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239602688:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395117.638960:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.639054:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.639553:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239602688 00000100:00100000:3.0:1789395117.639560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239602688 00000100:00100000:3.0:1789395117.639609:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:3.0:1789395117.639617:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7455:x1876316239602688:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395117.639752:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239602688:12345-0@lo:1000:osp_up0-1.0 Request processed in 135us (790us total) trans 4294983435 rc 0/0 00000100:00100000:3.0:1789395117.639759:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:1.0:1789395117.640101:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239602688:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395117.640112:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 721 rpc_version 721 00000020:00100000:1.0:1789395117.640129:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.640135:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6680 x1876316239602944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.640150:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239602944:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395117.640181:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.640204:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.640715:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239602944 00000100:00100000:3.0:1789395117.640721:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239602944 00000100:00100000:3.0:1789395117.640755:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1789395117.640762:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239602944:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395117.640885:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7455:x1876316239602944:12345-0@lo:1000:osp_up0-1.0 Request processed in 123us (703us total) trans 4294983436 rc 0/0 00000100:00100000:3.0:1789395117.640892:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:1.0:1789395117.650810:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.650860:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231686272 00000100:00100000:1.0:1789395117.650868:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231686272 00000100:00100000:1.0:1789395117.650920:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1278 00000100:00100000:1.0:1789395117.650931:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231686272:12345-192.168.203.54@tcp:103:rmdir.0 00010000:00010000:1.0:1789395117.650946:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395117.651078:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af3169e68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bff expref: 8 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.651099:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff89a4c875d100) 00010000:00010000:1.0:1789395117.651112:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395117.651161:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231686272:12345-192.168.203.54@tcp:103:rmdir.0 Request processed in 232us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.651168:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1278 00000100:00100000:1.0:1789395117.653228:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.654758:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231686528 00000100:00100000:3.0:1789395117.654770:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231686528 00000100:00100000:3.0:1789395117.654832:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23374 00000100:00100000:3.0:1789395117.654843:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17599:x1876316231686528:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:3.0:1789395117.654893:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.654916:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014a00/0xff35729af3169e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c06 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.654934:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:3.0:1789395117.654939:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395117.655044:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.655054:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.655064:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.655094:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603072:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395117.655140:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.655164:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.656096:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239603072 00000100:00100000:3.0:1789395117.656103:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239603072 00000100:00100000:3.0:1789395117.656141:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1789395117.656149:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:6512:x1876316239603072:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.656160:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.656176:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169ea0 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169e99 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.656200:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169ea0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169e99 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.656219:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169ea0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169e99 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.656227:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363500) 00010000:00010000:3.0:1789395117.656231:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.656234:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344600, rc 0) 00000100:00100000:3.0:1789395117.656279:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:6512:x1876316239603072:12345-0@lo:101:mdt00_001.0 Request processed in 130us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.656286:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1789395117.656323:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968408 gen 2 00000004:00080000:3.0:1789395117.656329:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968396 committed transno 4294968408 00000020:00080000:3.0:1789395117.656334:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c9b9c6c0 refcount 2 committed 0 result 0 batchid 382 00000020:00080000:3.0:1789395117.656339:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9c780 00000020:00080000:3.0:1789395117.656342:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].380 00000020:00080000:3.0:1789395117.656344:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c1a00 00000020:00080000:3.0:1789395117.656347:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].382 00000004:00080000:3.0:1789395117.656371:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968398 committed transno 4294968408 00000004:00080000:3.0:1789395117.656382:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968399 committed transno 4294968408 00000004:00080000:3.0:1789395117.656403:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968400 committed transno 4294968408 00000004:00080000:3.0:1789395117.656424:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968401 committed transno 4294968408 00000004:00080000:3.0:1789395117.656433:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968406 committed transno 4294968408 00000004:00080000:3.0:1789395117.657077:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968408 committed transno 4294968408 00000100:00100000:3.0:1789395117.657106:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603072:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.657125:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.657141:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395117.657156:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1789395117.657180:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.657187:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.657194:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.657209:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603200:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395117.657242:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.657264:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000020:00080000:3.0:1789395117.657279:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 383 committed batchid 381 00000020:00080000:3.0:1789395117.657336:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 381 00000100:00100000:3.0:1789395117.668287:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603200:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.668316:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169eae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.668329:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169eae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395117.668351:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:3.0:1789395117.668423:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603328:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.669086:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.669117:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.669709:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603328:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.669755:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603456:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.669781:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.669806:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.670620:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603456:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789395117.670675:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.670685:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.670694:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.670707:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603584:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395117.670731:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.670756:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.672544:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239603584:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395117.672563:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672573:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672598:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169ec3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672607:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672614:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af3169ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672632:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af3169eca lrc: 3/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672649:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c0d expref: 17 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672657:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af3169eca lrc: 4/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672682:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c0d expref: 17 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.672696:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af3169e84 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c0d expref: 17 pid: 7813 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.672707:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1876316239603712:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395117.672776:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.679273:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239603840 00000100:00100000:3.0:1789395117.679278:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239603840 00000100:00100000:3.0:1789395117.679315:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1789395117.679323:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:6512:x1876316239603840:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.679338:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.679350:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169ed1 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.679370:0:17997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 6 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.679381:0:17997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.679428:0:17997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 6 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.679440:0:17997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 6 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.679462:0:17997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:17997:1876316239603968:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395117.679518:0:17997:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.688146:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231686784 00000100:00100000:0.0:1789395117.688154:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231686784 00010000:00010000:0.0:1789395117.688199:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 7 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.688238:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1530 00000100:00100000:0.0:1789395117.688247:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231686784:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.688260:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.688267:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 7 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688279:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 7 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688300:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:0.0:1789395117.688306:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688316:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688325:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688354:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.688367:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6495:1876316239604096:0@lo:105: 00000100:00100000:0.0:1789395117.688426:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.688456:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.688469:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239604096 00000100:00100000:0.0:1789395117.688472:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239604096 00000100:00100000:0.0:1789395117.688493:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1789395117.688499:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6495:x1876316239604096:12345-0@lo:105: 00010000:00010000:0.0:1789395117.688509:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688518:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688527:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688535:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688542:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688549:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.688561:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3de200) 00000100:00100000:0.0:1789395117.688592:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6495:x1876316239604096:12345-0@lo:105: Request processed in 93us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.688598:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1789395117.688630:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6495:1876316239604096:0@lo:105: 00010000:00010000:0.0:1789395117.688643:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.688674:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231686784:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 428us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.688680:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1530 00010000:00010000:3.0:1789395117.688967:0:17997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169e92 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c14 expref: 6 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.688983:0:17997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:17997:1876316239603968:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395117.689004:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.689011:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:3.0:1789395117.689014:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395117.689016:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345200, rc 0) 00000100:00100000:3.0:1789395117.689169:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6512:x1876316239603840:12345-0@lo:101:mdt00_001.0 Request processed in 9781us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.689177:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1789395117.692255:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239604224 00000100:00100000:3.0:1789395117.692264:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239604224 00000100:00100000:3.0:1789395117.692316:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1789395117.692326:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6512:x1876316239604224:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1789395117.694463:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:6512:x1876316239604224:12345-0@lo:403:mdt00_001.0 Request processed in 2133us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.694475:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000004:00080000:0.0:1789395117.695945:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 726 rpc_version 726 00000020:00100000:0.0:1789395117.695976:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395117.695985:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c988f100 x1876316239604480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395117.696006:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239604480:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395117.696059:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.696123:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.696228:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239604480 00000100:00100000:3.0:1789395117.696235:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239604480 00000100:00100000:3.0:1789395117.696312:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1789395117.696321:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239604480:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.696642:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239604480:12345-0@lo:1000:osp_up1-0.0 Request processed in 322us (582us total) trans 4294968409 rc 0/0 00000100:00100000:3.0:1789395117.696650:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:0.0:1789395117.696733:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239604480:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1789395117.697122:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395117.697129:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697136:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395117.697140:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.697148:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697180:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697187:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395117.697216:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697224:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ed1 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ed8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697240:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395117.697244:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697251:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395117.697254:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.697266:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697283:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697289:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395117.697303:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344800/0xff35729af3169eb5 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ebc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.697311:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.697312:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.697314:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395117.697325:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239604736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395117.697357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.697459:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239604608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.697484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.697547:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239604736 00000100:00100000:0.0:1789395117.697552:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239604736 00000100:00100000:0.0:1789395117.697615:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239604608 00000100:00100000:0.0:1789395117.697622:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239604608 00000100:00100000:3.0:1789395117.698456:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1789395117.698467:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3638:x1876316239604736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.698480:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.698498:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af3169ebc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169eb5 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.698512:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:3.0:1789395117.698520:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395117.698542:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1789395117.698551:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3637:x1876316239604608:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.698553:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239604736:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.698559:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00010000:00010000:1.0:1789395117.698560:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395117.698571:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345200/0xff35729af3169ed8 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169ed1 expref: 9 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.698582:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395117.698589:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395117.698623:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3637:x1876316239604608:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.698630:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00010000:00010000:1.0:1789395117.698661:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395117.698667:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.698674:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.698679:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.698687:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.698709:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.698715:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.698726:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.698732:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344000/0xff35729af3169e99 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ea0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.698747:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.698748:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.698750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.699679:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239604864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.699719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.699778:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239604608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.700062:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239604864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.700252:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395117.700271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239604736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.733126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231686912 00000100:00100000:1.0:1789395117.733136:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231686912 00000100:00100000:1.0:1789395117.733198:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23375 00000100:00100000:1.0:1789395117.733210:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17600:x1876316231686912:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395117.733245:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.733266:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169edf lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733328:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733342:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733361:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733439:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733452:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733460:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733501:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733508:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733514:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733520:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733526:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.733530:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733537:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733548:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395117.733551:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.733555:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733561:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af3169ee6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733572:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733578:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733584:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733589:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.733591:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733596:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733612:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xe7d4651 (ffff89a4d0654000) 00010000:00010000:1.0:1789395117.733614:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.733616:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733621:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af3169eed lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733648:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169edf lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c1b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733657:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395117.733659:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.733662:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af3169edf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c1b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.733670:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417800, rc 0) 00000100:00100000:1.0:1789395117.733725:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17600:x1876316231686912:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 518us (931us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395117.733736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23375 00000100:00100000:3.0:1789395117.739178:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231687040 00000100:00100000:3.0:1789395117.739187:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231687040 00000100:00100000:3.0:1789395117.739283:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23376 00000100:00100000:3.0:1789395117.739293:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:17600:x1876316231687040:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395117.739311:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.739332:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169ef4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c22 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.739432:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.739456:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.739467:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395117.739512:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1789395117.739517:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395117.739572:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344200/0xff35729af3169ef4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 8 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.739589:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 7 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.739604:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:3.0:1789395117.739607:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395117.739611:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344600, rc 0) 00000100:00100000:3.0:1789395117.739668:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17600:x1876316231687040:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 376us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.739675:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23376 00000100:00100000:0.0:1789395117.745954:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239604992 00000100:00100000:0.0:1789395117.745962:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239604992 00000100:00100000:0.0:1789395117.746009:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:0.0:1789395117.746019:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3636:x1876316239604992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395117.746064:0:8436:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444012032 avail 1297772544 00000100:00100000:0.0:1789395117.746131:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:3636:x1876316239604992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.746138:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:3.0:1789395117.746307:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239604992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789395117.748061:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.749678:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239605120 00000100:00100000:3.0:1789395117.749685:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239605120 00000100:00100000:3.0:1789395117.749717:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1789395117.749724:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6512:x1876316239605120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.749800:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6512:x1876316239605120:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.749809:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1789395117.750200:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239605248 00000100:00100000:3.0:1789395117.750204:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239605248 00000100:00100000:3.0:1789395117.750234:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:3.0:1789395117.750241:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6512:x1876316239605248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.750324:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6512:x1876316239605248:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (189us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395117.750335:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:0.0:1789395117.751115:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239605376 00000100:00100000:0.0:1789395117.751120:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239605376 00000100:00100000:0.0:1789395117.751248:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1789395117.751258:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:6512:x1876316239605376:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395117.751268:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.751283:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169f02 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.751307:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.751317:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.751341:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.751365:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 16 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.751377:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239605504:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395117.751721:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.753916:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8436:1876316239605504:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395117.753946:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.753958:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395117.753961:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.753965:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.753974:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:0.0:1789395117.754133:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:6512:x1876316239605376:12345-0@lo:101:mdt00_001.0 Request processed in 2875us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.754141:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1789395117.755139:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.755225:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231687424 00000100:00100000:1.0:1789395117.755232:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231687424 00010000:00010000:1.0:1789395117.755264:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 17 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.755305:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1531 00000100:00100000:1.0:1789395117.755313:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6281c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231687424:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395117.755327:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395117.755333:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 17 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.755345:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 17 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.755377:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af3169e14 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105bf8 expref: 17 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.755425:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395117.755431:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.755451:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.755461:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.755492:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.755505:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239605632:0@lo:105: 00000100:00100000:1.0:1789395117.755553:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.755587:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.755589:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239605632 00000100:00100000:3.0:1789395117.755594:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239605632 00000100:00100000:3.0:1789395117.755627:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1789395117.755633:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239605632:12345-0@lo:105: 00010000:00010000:3.0:1789395117.755643:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755651:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755657:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755661:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755666:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755670:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755690:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3dfa00) 00000100:00100000:3.0:1789395117.755722:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239605632:12345-0@lo:105: Request processed in 88us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1789395117.755724:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.755728:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00010000:00010000:0.0:1789395117.755739:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395117.755763:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395117.755792:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.755799:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.755808:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.755822:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239605760:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395117.755847:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.755868:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.755881:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239605760 00000100:00100000:3.0:1789395117.755885:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239605760 00000100:00100000:3.0:1789395117.755908:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1789395117.755912:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:6512:x1876316239605760:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.755923:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.755933:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169f17 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169f10 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755945:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169f17 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169f10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755953:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169f17 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.755958:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xe7d4651 (ffff89a3ca363800) 00010000:00010000:3.0:1789395117.755960:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.755962:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344000, rc 0) 00000100:00100000:3.0:1789395117.755999:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239605760:12345-0@lo:101:mdt00_001.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.756005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1789395117.756011:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239605632:0@lo:105: 00010000:00010000:1.0:1789395117.756027:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395117.756104:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239605760:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395117.756116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.756124:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395117.756136:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1789395117.756165:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239605888:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.756189:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.756212:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.756237:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239605888 00000100:00100000:3.0:1789395117.756241:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239605888 00000100:00100000:3.0:1789395117.756294:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1789395117.756302:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239605888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.756432:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239605888:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.756436:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:0.0:1789395117.756505:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239605888:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.756542:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606016:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.756564:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.756581:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.756614:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606016 00000100:00100000:3.0:1789395117.756618:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606016 00000100:00100000:3.0:1789395117.756670:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:3.0:1789395117.756676:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.756740:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606016:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (175us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395117.756747:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:0.0:1789395117.756780:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.756794:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6281c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231687424:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 752us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.756806:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1531 00000100:00100000:0.0:1789395117.756832:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606144:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.756864:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.756876:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.756886:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606144 00000100:00100000:1.0:1789395117.756891:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606144 00000100:00100000:1.0:1789395117.756910:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:1.0:1789395117.756916:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.756983:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606144:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (117us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395117.756990:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:0.0:1789395117.756994:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606144:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.757032:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606272:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.757052:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.757082:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.757203:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606272 00000100:00100000:3.0:1789395117.757207:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606272 00000100:00100000:3.0:1789395117.757229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:3.0:1789395117.757236:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.757282:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606272:12345-0@lo:1000:mdt00_001.0 Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.757289:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:0.0:1789395117.757293:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606272:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.757329:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606400:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.757421:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.757437:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.757651:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606400 00000100:00100000:1.0:1789395117.757656:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606400 00000100:00100000:1.0:1789395117.757687:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:1.0:1789395117.757694:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395117.757757:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606400:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.757765:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1789395117.757783:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606400:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.757818:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606528:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395117.757902:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.757922:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.757962:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606528 00000100:00100000:3.0:1789395117.757966:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606528 00000100:00100000:3.0:1789395117.758016:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:3.0:1789395117.758023:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.758086:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:6512:x1876316239606528:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.758095:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:1.0:1789395117.758112:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606528:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1789395117.760138:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].379, 2168 off574624 00000040:00080000:0.0:1789395117.760271:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].379, 2368 off628072 00000004:00080000:0.0:1789395117.760277:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c7a3ac00 with version 722 00000100:00100000:1.0:1789395117.760981:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606784 00000100:00100000:1.0:1789395117.760988:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606784 00000100:00100000:1.0:1789395117.761031:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:1.0:1789395117.761037:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7455:x1876316239606784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395117.761966:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7455:x1876316239606784:12345-0@lo:1000:osp_up0-1.0 Request processed in 924us (1188us total) trans 4294983438 rc 0/0 00000100:00100000:1.0:1789395117.761977:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00010000:00010000:0.0:1789395117.762264:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762280:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762291:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762308:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762321:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762350:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762362:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.762370:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.762687:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606912:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395117.762737:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395117.762761:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.762809:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239606912 00000100:00100000:3.0:1789395117.762815:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239606912 00000100:00100000:3.0:1789395117.762856:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:3.0:1789395117.762864:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:6512:x1876316239606912:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.762879:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.762895:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169f33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169f2c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.762915:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169f2c expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.762926:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f2c expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.762944:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff89a3ca363700) 00010000:00010000:3.0:1789395117.762948:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.762951:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344200, rc 0) 00000100:00100000:3.0:1789395117.762993:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:6512:x1876316239606912:12345-0@lo:101:mdt00_001.0 Request processed in 130us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.763000:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1789395117.763238:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239606912:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.763252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.763262:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.763287:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5d2788d reply state 000000008ddc4352 transno 4294968410 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.763300:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.763307:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff89a4c875d500) 00010000:00010000:1.0:1789395117.763310:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395117.763313:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395117.763318:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.763326:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395117.763337:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc8:0x0] 00000004:00010000:1.0:1789395117.763346:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5d2788d reply state 000000008ddc4352 transno 4294968410 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.763354:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.763360:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:1.0:1789395117.763362:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395117.763364:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1789395117.763368:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18a:0x0]: returning size 4096 00000004:00080000:1.0:1789395117.763376:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395117.764042:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.764053:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.764061:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.764135:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395117.764142:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395117.764147:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.764155:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.764252:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17600:x1876316231687296:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 15093us (16194us total) trans 4294968410 rc 0/0 00000100:00100000:1.0:1789395117.764260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23377 00010000:00010000:3.0:1789395117.764597:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395117.764609:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.764617:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfa00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395117.764623:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.764632:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.764661:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.764668:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789395117.764974:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239607040 00000100:00100000:0.0:1789395117.764981:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239607040 00000100:00100000:0.0:1789395117.765029:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1789395117.765038:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3637:x1876316239607040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.765050:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395117.765077:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af3169f09 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169f02 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.765092:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395117.765101:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395117.765229:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.765238:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfa00/0xff35729af3169f02 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169f09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.765257:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.765259:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395117.765261:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395117.765294:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3637:x1876316239607040:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.765301:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1789395117.790050:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.810875:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:0.0:1789395117.811105:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.811205:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231687808 00000100:00100000:3.0:1789395117.811215:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231687808 00000100:00100000:3.0:1789395117.811268:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23379 00000100:00100000:3.0:1789395117.811280:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17602:x1876316231687808:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:3.0:1789395117.811307:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.811330:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345200/0xff35729af3169f3a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c29 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811418:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811433:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811443:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811456:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811466:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169f17 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811475:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.811510:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af3169f17 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af3169f10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.811534:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239607168:0@lo:104: 00000100:00100000:3.0:1789395117.811584:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.811635:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.811702:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789395117.811714:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239607168 00000100:00100000:0.0:1789395117.811718:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239607168 00000100:00100000:0.0:1789395117.811757:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1789395117.811776:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239607168:12345-0@lo:104: 00010000:00010000:0.0:1789395117.811790:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.811841:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395117.811847:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239607168:12345-0@lo:104: Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.811855:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00010000:00010000:1.0:1789395117.812080:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395117.812087:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.812095:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395117.812101:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395117.812109:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.812137:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.812144:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395117.812164:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.812184:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015800/0xff35729af3169f10 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169f17 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.812201:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.812203:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.812205:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395117.812218:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239607296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.812250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.812402:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239607168:0@lo:104: 00010000:00010000:3.0:1789395117.812424:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.816877:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169eae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.816899:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169eae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.816942:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169eae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.816950:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789395117.817011:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239607424:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395117.817088:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789395117.817157:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345800/0xff35729af3169ea7 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169eae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395117.817179:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983438 is committed 00000001:00080000:3.0:1789395117.817196:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983437 is committed 00000020:00080000:3.0:1789395117.817204:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 383 batchid updated 00000020:00080000:3.0:1789395117.817220:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c80b33c0 refcount 2 committed 0 result 0 batchid 384 00000020:00080000:3.0:1789395117.817224:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c80b3180 00000020:00080000:3.0:1789395117.817228:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].381 00000020:00080000:3.0:1789395117.817230:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca3ef400 00000020:00080000:3.0:1789395117.817233:0:6490:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].383 00000020:00080000:3.0:1789395117.817250:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 384 committed batchid 383 00000004:00080000:3.0:1789395117.817359:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4d92d3840 with version 727 00000020:00080000:3.0:1789395117.817370:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 382 cancel update log [0x240000401:0x3:0x0].380: rc = 0 00000020:00080000:3.0:1789395117.817428:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 382 cancel update log [0x200000400:0x3:0x0].382: rc = 0 00000020:00080000:3.0:1789395117.817439:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 383 00000004:00080000:3.0:1789395117.817448:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 727 rpc_version 727 00000020:00100000:3.0:1789395117.817467:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395117.817476:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f4000 x1876316239607680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395117.817492:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239607680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.817526:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.817543:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c240 going to sleep for 11 seconds 00010000:00010000:3.0:1789395117.818458:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.818470:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.818557:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10512:1876316239607808:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789395117.818588:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.818608:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.818625:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239607680 00000100:00100000:3.0:1789395117.818629:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239607680 00000100:00100000:3.0:1789395117.818659:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239607808 00000100:00100000:3.0:1789395117.818662:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239607808 00000100:00100000:3.0:1789395117.818679:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:3.0:1789395117.818687:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7874:x1876316239607680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.818822:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239607680:12345-0@lo:1000:osp_up1-0.0 Request processed in 136us (1295us total) trans 4294968411 rc 0/0 00000100:00100000:3.0:1789395117.818830:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:3.0:1789395117.818847:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1789395117.818854:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:10512:x1876316239607808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789395117.818901:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:10512:x1876316239607808:12345-0@lo:1000:mdt00_004.0 Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.818908:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1789395117.818949:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239607680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.818969:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10512:1876316239607808:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789395117.819012:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af3169f4f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819024:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af3169f4f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819033:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af3169f4f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395117.819055:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af3169f4f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819078:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819085:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819092:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819099:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819105:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395117.819110:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819117:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819127:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395117.819130:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.819134:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819141:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af3169f41 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819154:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819161:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819167:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819173:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395117.819177:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.819185:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239607424:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1789395117.819188:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819200:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xe7d4651 (ffff89a3ca363800) 00010000:00010000:3.0:1789395117.819203:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.819206:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819213:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169f48 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819217:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819227:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819234:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819240:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dec00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.819245:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819247:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345200/0xff35729af3169f3a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c29 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819275:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.819281:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345600/0xff35729af3169f4f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c29 expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819290:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:3.0:1789395117.819292:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c7b89900) 00010000:00010000:1.0:1789395117.819297:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.819298:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395117.819303:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345600, rc 0) 00010000:00010000:1.0:1789395117.819304:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819315:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dec00/0xff35729af3169e37 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.819350:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17602:x1876316231687808:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 8072us (8484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.819358:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23379 00010000:00010000:1.0:1789395117.819558:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819565:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819571:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819576:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395117.819580:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819586:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819595:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff89a3ca2fb700) 00010000:00010000:1.0:1789395117.819598:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.819602:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.819607:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af3169e3e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.822990:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.830991:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231687936 00000100:00100000:1.0:1789395117.831006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231687936 00000100:00100000:1.0:1789395117.831087:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23380 00000100:00100000:1.0:1789395117.831099:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17602:x1876316231687936:12345-192.168.203.54@tcp:101:rmdir.0 00010000:00010000:1.0:1789395117.831124:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.831144:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169f56 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.831365:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169f5d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.831541:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169f5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.831554:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169f5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395117.831655:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18a:0x0]: returning size 4096 00000004:00200000:1.0:1789395117.831660:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395117.832323:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416e00/0xff35729af3169f56 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c30 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.832346:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169f5d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c30 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.832355:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:1.0:1789395117.832359:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395117.832362:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416200, rc 0) 00000100:00100000:1.0:1789395117.835585:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17602:x1876316231687936:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 4479us (12592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.835598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23380 00000100:00100000:3.0:1789395117.841831:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.850326:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.851002:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239607936 00000100:00100000:0.0:1789395117.851009:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239607936 00000100:00100000:0.0:1789395117.851063:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1789395117.851081:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239607936:12345-0@lo:104: 00010000:00010000:0.0:1789395117.851094:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.851160:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395117.851166:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10512:x1876316239607936:12345-0@lo:104: Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395117.851173:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00010000:00010000:0.0:1789395117.851194:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395117.851200:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.851207:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395117.851212:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395117.851220:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.851245:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.851251:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395117.851270:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.851277:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014e00/0xff35729af3169f2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af3169f33 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.851293:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.851295:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395117.851297:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395117.852708:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239608064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395117.852770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.852842:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10512:1876316239607936:0@lo:104: 00010000:00010000:1.0:1789395117.852867:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.853667:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608064 00000100:00100000:0.0:1789395117.853676:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608064 00010000:00010000:0.0:1789395117.854078:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344200/0xff35729af3169f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af3169f2c expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.854121:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:0.0:1789395117.854131:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1876316239608064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395117.854145:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1789395117.864656:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 384 batchid updated 00000020:00080000:3.0:1789395117.864723:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 384 00000004:00080000:3.0:1789395117.864782:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca31b3c0 with version 728 00000020:00080000:3.0:1789395117.864799:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 384 cancel update log [0x240000401:0x3:0x0].381: rc = 0 00000020:00080000:3.0:1789395117.864871:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 384 cancel update log [0x200000400:0x3:0x0].383: rc = 0 00000020:00080000:3.0:1789395117.864879:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 384 00010000:00010000:3.0:1789395117.865311:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.865319:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395117.865370:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xc8:0x0]: returning size 4096 00000004:00200000:3.0:1789395117.865375:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395117.865525:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af3169f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c3e expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.865604:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c3e expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.865612:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff89a3ca363700) 00010000:00010000:3.0:1789395117.865615:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395117.865617:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:3.0:1789395117.865668:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17602:x1876316231688192:12345-192.168.203.54@tcp:101:rmdir.0 Request processed in 15153us (15352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.865676:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23382 00000004:00080000:1.0:1789395117.866024:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 728 rpc_version 728 00000020:00100000:1.0:1789395117.866054:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395117.866062:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4ff86d180 x1876316239608320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395117.866091:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239608320:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395117.866133:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.866163:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.866339:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608320 00000100:00100000:3.0:1789395117.866347:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608320 00000100:00100000:3.0:1789395117.866420:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:3.0:1789395117.866430:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7874:x1876316239608320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395117.866793:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7874:x1876316239608320:12345-0@lo:1000:osp_up1-0.0 Request processed in 364us (658us total) trans 4294968412 rc 0/0 00000100:00100000:3.0:1789395117.866801:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:1.0:1789395117.876546:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.876600:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395117.876630:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231688576 00000100:00100000:1.0:1789395117.876640:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231688576 00000100:00100000:1.0:1789395117.876692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23383 00000100:00100000:1.0:1789395117.876703:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17602:x1876316231688576:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:1.0:1789395117.876757:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395117.876782:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416200/0xff35729af3169f5d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c30 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.876802:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:1.0:1789395117.876808:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395117.876857:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.876867:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.876881:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.876902:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608448:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395117.876947:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.876972:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395117.876992:0:17997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608448 00000100:00100000:1.0:1789395117.876996:0:17997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608448 00000100:00100000:1.0:1789395117.877023:0:17997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1789395117.877029:0:17997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:6512:x1876316239608448:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.877038:0:17997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395117.877052:0:17997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169f87 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169f80 expref: -99 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.877087:0:17997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169f87 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169f80 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.877100:0:17997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af3169f87 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f80 expref: 6 pid: 17997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.877107:0:17997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4d0654900) 00010000:00010000:1.0:1789395117.877110:0:17997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395117.877112:0:17997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416a00, rc 0) 00000100:00100000:1.0:1789395117.877147:0:17997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6512:x1876316239608448:12345-0@lo:101:mdt00_001.0 Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395117.877154:0:17997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1789395117.877194:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983438 gen 2 00000004:00080000:1.0:1789395117.877200:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983430 committed transno 4294983438 00000020:00080000:1.0:1789395117.877205:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca35c540 refcount 2 committed 0 result 0 batchid 378 00000020:00080000:1.0:1789395117.877209:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ea00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca35c300 00000020:00080000:1.0:1789395117.877212:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].378 00000020:00080000:1.0:1789395117.877214:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82eae00 00000020:00080000:1.0:1789395117.877217:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].378 00000004:00080000:1.0:1789395117.877241:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983432 committed transno 4294983438 00000004:00080000:1.0:1789395117.877252:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983433 committed transno 4294983438 00000004:00080000:1.0:1789395117.877260:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983434 committed transno 4294983438 00000004:00080000:1.0:1789395117.877270:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983435 committed transno 4294983438 00000004:00080000:1.0:1789395117.877278:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983436 committed transno 4294983438 00000004:00080000:1.0:1789395117.877285:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983438 committed transno 4294983438 00000100:00100000:1.0:1789395117.877302:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608448:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.877317:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f87 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.877328:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f87 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395117.877342:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1789395117.877362:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.877369:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395117.877376:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.881056:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608576:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395117.881128:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.881165:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.886463:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608576 00000100:00100000:3.0:1789395117.886478:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608576 00000100:00100000:3.0:1789395117.886539:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1789395117.886551:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:6512:x1876316239608576:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.886571:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.886595:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169f95 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169f8e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.886626:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169f95 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169f8e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.886641:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169f95 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f8e expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.886650:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xe7d4651 (ffff89a4c7b89400) 00010000:00010000:3.0:1789395117.886653:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395117.886657:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345000, rc 0) 00000100:00100000:3.0:1789395117.886730:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239608576:12345-0@lo:101:mdt00_001.0 Request processed in 181us (5601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.886737:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1789395117.886786:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608576:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.886805:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f95 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.886822:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f95 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395117.886843:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1789395117.886888:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608704:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.886924:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.886945:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.886961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608704 00000100:00100000:3.0:1789395117.886966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608704 00000100:00100000:3.0:1789395117.886990:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1789395117.886997:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239608704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.887054:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239608704:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.887061:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1789395117.887100:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608704:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.887137:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608832:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.887160:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.887175:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.887186:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608832 00000100:00100000:3.0:1789395117.887189:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608832 00000100:00100000:3.0:1789395117.887207:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1789395117.887213:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239608832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395117.887283:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239608832:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (121us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395117.887290:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1789395117.887316:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608832:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789395117.887358:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887366:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887375:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.887416:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608960:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395117.887441:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.887455:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.887465:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239608960 00000100:00100000:3.0:1789395117.887468:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239608960 00000100:00100000:3.0:1789395117.887487:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1789395117.887493:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:6512:x1876316239608960:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.887500:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395117.887511:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169fa3 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169f9c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887528:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169fa3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169f9c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887538:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344e00/0xff35729af3169fa3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169f9c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887545:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:3.0:1789395117.887548:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395117.887551:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344e00, rc 0) 00000100:00100000:3.0:1789395117.887578:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:6512:x1876316239608960:12345-0@lo:101:mdt00_001.0 Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.887584:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1789395117.887607:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239608960:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395117.887617:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169fa3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887625:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169fa3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887645:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887661:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887675:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887686:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169f6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c37 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887694:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887715:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169f6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c37 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.887733:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de200/0xff35729af3169f6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c37 expref: 10 pid: 6511 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.887743:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239609088:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395117.887798:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.895574:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.895631:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239609088:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395117.895656:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.912487:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.912500:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.912564:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.912572:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.912583:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.912604:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239609216:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395117.912656:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.912690:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.919036:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395117.919085:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231688832 00000100:00100000:3.0:1789395117.919095:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231688832 00010000:00010000:3.0:1789395117.919136:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c3e expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.919172:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1535 00000100:00100000:3.0:1789395117.919182:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6282c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231688832:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.919196:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.919202:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c3e expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919215:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af3169f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c3e expref: 14 pid: 10512 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919237:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff89a3ca363700) 00010000:00010000:3.0:1789395117.919243:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af3169fbf lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169fb8 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919253:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af3169fbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169fb8 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919261:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af3169fbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169fb8 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919294:0:8441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af3169fbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169fb8 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395117.919313:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239609472:0@lo:105: 00000100:00100000:3.0:1789395117.919360:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395117.919788:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395117.919816:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239609472 00000100:00100000:3.0:1789395117.919821:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239609472 00000100:00100000:3.0:1789395117.919863:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1789395117.919870:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239609472:12345-0@lo:105: 00010000:00010000:3.0:1789395117.919881:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919892:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919901:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919909:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919915:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919922:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.919936:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3c9345e00) 00000100:00100000:3.0:1789395117.919976:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239609472:12345-0@lo:105: Request processed in 106us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.919983:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1789395117.920026:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239609472:0@lo:105: 00010000:00010000:3.0:1789395117.920043:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.920093:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6282c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231688832:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 911us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.920100:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1535 00000100:00100000:1.0:1789395117.933136:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239609216:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395117.933159:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395117.935365:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239609600:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395117.938025:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395117.938081:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395117.942819:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239609600:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1789395117.951375:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].380, 664 off575288 00000040:00080000:3.0:1789395117.951720:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].380, 744 off628816 00000004:00080000:3.0:1789395117.951728:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca31b600 with version 723 00000100:00100000:0.0:1789395117.953359:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239609856 00000100:00100000:0.0:1789395117.953368:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239609856 00000100:00100000:0.0:1789395117.953456:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1789395117.953466:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f7834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7455:x1876316239609856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395117.954086:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f7834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239609856:12345-0@lo:1000:osp_up0-1.0 Request processed in 619us (951us total) trans 4294983439 rc 0/0 00000100:00100000:0.0:1789395117.954095:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000004:00200000:0.0:1789395117.954778:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18a:0x0]: returning size 4096 00010000:00010000:0.0:1789395117.954800:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954811:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954818:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954825:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9345800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.954844:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954852:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954868:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff89a4c875d500) 00010000:00010000:0.0:1789395117.954871:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395117.954876:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954881:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345800/0xff35729af3169fb1 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954897:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954905:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954915:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345e00/0xff35729af3169fb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169fbf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954940:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395117.954948:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc8:0x0] 00010000:00010000:0.0:1789395117.954955:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954961:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954967:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954971:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.954974:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954980:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.954988:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:0.0:1789395117.954991:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.954994:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955000:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344800/0xff35729af3169faa lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955011:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169fa3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955019:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169fa3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955025:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af3169f9c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169fa3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955048:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1789395117.955058:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395117.955062:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169f87 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955079:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169f87 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955085:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416e00/0xff35729af3169f80 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169f87 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955095:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1789395117.955099:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395117.955104:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f95 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.955111:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca416400/0xff35729af3169f8e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169f95 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395117.955185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17602:x1876316231688576:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 78482us (78581us total) trans 4294968413 rc 0/0 00000100:00100000:0.0:1789395117.955195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23383 00000100:00100000:3.0:1789395117.957462:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239609984 00000100:00100000:3.0:1789395117.957472:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239609984 00010000:00010000:1.0:1789395117.957771:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395117.957778:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395117.958206:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1789395117.958217:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3636:x1876316239609984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395117.958228:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395117.958246:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af3169fbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169fb8 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395117.958261:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff89a3ca363700) 00010000:00010000:3.0:1789395117.958269:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395117.958321:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3636:x1876316239609984:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395117.958329:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1789395117.958369:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239609984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395117.994880:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395117.994982:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231688960 00000100:00100000:0.0:1789395117.994992:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231688960 00000100:00100000:0.0:1789395117.995053:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23384 00000100:00100000:0.0:1789395117.995073:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17603:x1876316231688960:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395117.995099:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395117.995121:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169fc6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c45 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995190:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995205:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995219:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995234:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995242:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995250:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995296:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995304:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995311:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995318:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995324:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.995328:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995337:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995348:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:0.0:1789395117.995351:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.995356:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995363:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af3169fcd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995376:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995411:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995418:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995424:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395117.995426:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995433:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995441:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x7ed215cf (ffff89a4c875d200) 00010000:00010000:0.0:1789395117.995443:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.995446:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995452:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af3169fd4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995486:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169fc6 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c45 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995497:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:0.0:1789395117.995499:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395117.995503:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169fc6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c45 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395117.995513:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:0.0:1789395117.995697:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17603:x1876316231688960:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 634us (826us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395117.995705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23384 00000100:00100000:0.0:1789395118.005952:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395118.006128:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231689088 00000100:00100000:3.0:1789395118.006139:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231689088 00000100:00100000:3.0:1789395118.006196:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23385 00000100:00100000:3.0:1789395118.006208:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17603:x1876316231689088:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395118.006228:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395118.006252:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169fdb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c4c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.006313:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345400/0xff35729af3169fe2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.006327:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345400/0xff35729af3169fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.006339:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345400/0xff35729af3169fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395118.006416:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1789395118.006422:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395118.006592:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345a00/0xff35729af3169fdb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c4c expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.006615:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345400/0xff35729af3169fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c4c expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.006624:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c7b89800) 00010000:00010000:3.0:1789395118.006627:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395118.006630:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345400, rc 0) 00000100:00100000:3.0:1789395118.006687:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17603:x1876316231689088:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 481us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395118.006694:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23385 00000100:00100000:3.0:1789395118.021364:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395118.021874:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231689344 00000100:00100000:0.0:1789395118.021886:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231689344 00000100:00100000:0.0:1789395118.021963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23386 00000100:00100000:0.0:1789395118.021973:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17603:x1876316231689344:12345-192.168.203.54@tcp:36:lfs.0 00000100:00100000:0.0:1789395118.022093:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239610368:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.022186:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.022242:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395118.022682:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239610368:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.022785:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239610496:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.022806:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.022831:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395118.023320:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239610496:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789395118.023365:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.023376:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.023410:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395118.023422:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239610624:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395118.023591:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.023615:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395118.023657:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239610624 00000100:00100000:3.0:1789395118.023662:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239610624 00000100:00100000:3.0:1789395118.023686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:3.0:1789395118.023692:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6512:x1876316239610624:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395118.023700:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395118.023768:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169fe9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.023793:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.023803:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.023825:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.023837:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 9 pid: 10512 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395118.023848:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6516:1876316239610752:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395118.023904:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395118.038586:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395118.038626:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231689472 00000100:00100000:0.0:1789395118.038635:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231689472 00010000:00010000:0.0:1789395118.038675:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 10 pid: 10512 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395118.038713:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1536 00000100:00100000:0.0:1789395118.038724:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231689472:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395118.038739:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395118.038747:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 10 pid: 10512 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.038762:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 10 pid: 10512 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.038783:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:0.0:1789395118.038789:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.038800:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.038809:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.038841:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395118.038864:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6496:1876316239610880:0@lo:105: 00000100:00100000:0.0:1789395118.038908:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.038944:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395118.038966:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239610880 00000100:00100000:0.0:1789395118.038969:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239610880 00000100:00100000:0.0:1789395118.038998:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1789395118.039005:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6496:x1876316239610880:12345-0@lo:105: 00010000:00010000:0.0:1789395118.039016:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.039026:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.039034:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.039041:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.039048:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.039055:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.039078:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca014600) 00000100:00100000:0.0:1789395118.039113:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6496:x1876316239610880:12345-0@lo:105: Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.039119:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1789395118.039159:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6496:1876316239610880:0@lo:105: 00010000:00010000:0.0:1789395118.039172:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395118.039210:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231689472:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 487us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.039216:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1536 00010000:00010000:3.0:1789395118.039608:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344600/0xff35729af3169efb lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c22 expref: 9 pid: 10512 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395118.039623:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6516:1876316239610752:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395118.039642:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395118.039651:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:3.0:1789395118.039654:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395118.039656:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345a00, rc 0) 00000100:00100000:3.0:1789395118.039693:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6512:x1876316239610624:12345-0@lo:101:mdt00_001.0 Request processed in 16001us (16103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395118.039700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:0.0:1789395118.049640:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611008 00000100:00100000:0.0:1789395118.049652:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611008 00000100:00100000:0.0:1789395118.049706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:0.0:1789395118.049717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6512:x1876316239611008:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395118.049736:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395118.049759:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169ffe lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af3169ff7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.049789:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169ffe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af3169ff7 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.049804:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169ffe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af3169ff7 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.049812:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x7ed215cf (ffff89a4c875db00) 00010000:00010000:0.0:1789395118.049816:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395118.049819:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:0.0:1789395118.050207:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611008:12345-0@lo:101:mdt00_001.0 Request processed in 490us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.050214:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:0.0:1789395118.059602:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611136 00000100:00100000:0.0:1789395118.059622:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611136 00000100:00100000:0.0:1789395118.059696:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:0.0:1789395118.059711:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.059826:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611136:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (7162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.059833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:0.0:1789395118.060409:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611264 00000100:00100000:0.0:1789395118.060413:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611264 00000100:00100000:0.0:1789395118.060450:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:0.0:1789395118.060459:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.060544:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611264:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (233us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395118.060552:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:0.0:1789395118.062351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611392 00000100:00100000:0.0:1789395118.062357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611392 00000100:00100000:0.0:1789395118.062433:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:0.0:1789395118.062602:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.062781:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611392:12345-0@lo:1000:mdt00_001.0 Request processed in 338us (623us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395118.062788:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:0.0:1789395118.065567:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611520 00000100:00100000:0.0:1789395118.065577:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611520 00000100:00100000:0.0:1789395118.065635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:0.0:1789395118.065644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395118.065866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611520:12345-0@lo:1000:mdt00_001.0 Request processed in 222us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.065873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1789395118.066221:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239611520:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395118.066292:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239611648:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395118.066335:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395118.066358:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395118.067074:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239611648:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395118.067141:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239611776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395118.067175:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395118.067196:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395118.067891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611776 00000100:00100000:1.0:1789395118.067898:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611776 00000100:00100000:1.0:1789395118.067939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1789395118.067948:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395118.068016:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6512:x1876316239611776:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.068022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1789395118.068055:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239611776:0@lo:1000:mdt00_001.0 00080000:02000000:1.0:1789395118.068258:0:6512:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:1.0:1789395118.068271:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a3a000 with version 0 00000020:00080000:1.0:1789395118.068277:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c7a3a900 refcount 3 committed 0 result -5 batchid 386 00000020:00080000:1.0:1789395118.068281:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -5 sub_th ffff89a3c7a3a000 00000020:00080000:1.0:1789395118.068284:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120900 obd lustre-MDT0000-osd committed 1 started 0 stopped 1 result 0 sub_th ffff89a3ca289200 00000004:00080000:1.0:1789395118.068307:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395118.068316:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395118.068326:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395118.068333:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395118.068350:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395118.068356:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395118.068359:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395118.068365:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395118.068372:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395118.068381:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789395118.068606:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17603:x1876316231689344:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 46631us (47247us total) trans 0 rc -5/-5 00000100:00100000:1.0:1789395118.068613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23386 00000020:00080000:1.0:1789395118.068641:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 384 00010000:00010000:0.0:1789395118.069267:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395118.069276:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069288:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395118.069295:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395118.069303:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069334:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069340:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395118.069357:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069364:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af3169fe9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ff0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069379:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395118.069405:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069412:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395118.069416:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395118.069423:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069455:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069462:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395118.069468:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069475:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de200/0xff35729af3169ff7 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af3169ffe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069486:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395118.069488:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395118.069490:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395118.069511:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239611904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395118.069561:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.069591:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395118.069597:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239612032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395118.069618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.069648:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239611904 00000100:00100000:0.0:1789395118.069653:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239611904 00000100:00100000:0.0:1789395118.069694:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612032 00000100:00100000:0.0:1789395118.069697:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612032 00000100:00100000:0.0:1789395118.069718:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789395118.069725:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239611904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395118.069737:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395118.069752:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af3169ff0 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169fe9 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069770:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:0.0:1789395118.069780:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395118.069806:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3636:x1876316239611904:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.069812:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789395118.069826:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:0.0:1789395118.069832:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239612032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395118.069838:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395118.069847:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af3169ffe lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169ff7 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395118.069856:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x7ed215cf (ffff89a4c875db00) 00010000:00010000:0.0:1789395118.069863:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395118.069883:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1876316239612032:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.069888:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:0.0:1789395118.069915:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239612032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395118.069924:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239611904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395118.773167:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239612416:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773233:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395118.773239:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239612160:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773284:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239612928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395118.773327:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239612672:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395118.773360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.773360:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239613440:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239613184:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773415:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395118.773441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.773442:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789395118.773450:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239612544:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773465:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789395118.773474:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239612288:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395118.773505:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612416 00000100:00100000:0.0:1789395118.773505:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239613056:0@lo:400:kworker.0 00000100:00100000:3.0:1789395118.773515:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612416 00000100:00100000:1.0:1789395118.773521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.773554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612672 00000100:00100000:3.0:1789395118.773558:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613184 00000100:00100000:0.0:1789395118.773559:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612672 00000100:00100000:3.0:1789395118.773565:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613184 00000100:00100000:1.0:1789395118.773568:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239612800:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773597:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612544 00000100:00100000:0.0:1789395118.773601:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612544 00000100:00100000:3.0:1789395118.773602:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612288 00000100:00100000:3.0:1789395118.773607:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612288 00000100:00100000:0.0:1789395118.773628:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1789395118.773637:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1789395118.773641:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239612416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395118.773651:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239612672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773691:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239612416:12345-0@lo:400:kworker.0 Request processed in 53us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.773700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1789395118.773714:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239612672:12345-0@lo:400:kworker.0 Request processed in 66us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.773720:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1789395118.773728:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1789395118.773733:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239613184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395118.773764:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1789395118.773772:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239613184:12345-0@lo:400:kworker.0 Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395118.773777:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239612544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773779:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239613312:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773785:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1789395118.773801:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1789395118.773808:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.773843:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239612288:12345-0@lo:400:kworker.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395118.773849:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1789395118.773858:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239612672:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.773867:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612928 00000100:00100000:0.0:1789395118.773871:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612928 00000100:00100000:0.0:1789395118.773892:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613440 00000100:00100000:0.0:1789395118.773894:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613440 00000100:00100000:0.0:1789395118.773908:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612800 00000100:00100000:0.0:1789395118.773910:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612800 00000100:00100000:0.0:1789395118.773923:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613312 00000100:00100000:0.0:1789395118.773925:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613312 00000100:00100000:0.0:1789395118.773944:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789395118.773950:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239613184:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.773976:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239612288:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.774003:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239612160 00000100:00100000:1.0:1789395118.774008:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239612160 00000100:00100000:1.0:1789395118.774044:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1789395118.774047:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239612544:12345-0@lo:400:kworker.0 Request processed in 273us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.774056:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239612160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395118.774069:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1789395118.774115:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239612160:12345-0@lo:400:kworker.0 Request processed in 62us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.774123:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789395118.774177:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239612928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.774208:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239612928:12345-0@lo:400:kworker.0 Request processed in 34us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.774319:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789395118.774329:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239613440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.774362:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239613440:12345-0@lo:400:kworker.0 Request processed in 36us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.774369:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789395118.774405:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789395118.774413:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239612800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.774440:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239612800:12345-0@lo:400:kworker.0 Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.774446:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789395118.774458:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789395118.774463:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239613312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.774488:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239613312:12345-0@lo:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.775102:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789395118.775142:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789395118.775167:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239612800:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.775179:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239613312:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.775187:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239612160:0@lo:400:kworker.0 00000100:00080000:3.0:1789395118.775521:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395118.775526:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395118.775530:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395118.775533:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395118.776076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395118.776124:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239612416:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.776137:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239612928:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.776147:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239613440:0@lo:400:kworker.0 00000100:00100000:0.0:1789395118.776165:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239612544:0@lo:400:kworker.0 00000100:00100000:1.0:1789395118.776219:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613056 00000100:00100000:1.0:1789395118.776225:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613056 00000100:00100000:1.0:1789395118.776274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1789395118.776282:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239613056:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789395118.776409:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395118.776979:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239613056:12345-0@lo:400:kworker.0 Request processed in 695us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395118.776988:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00010000:00010000:1.0:1789395118.834628:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395119.281721:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239613568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395119.281788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395119.281938:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395119.281948:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239613696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395119.281977:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395119.283752:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789395119.283772:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239613824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395119.283820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395119.283871:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613568 00000100:00100000:0.0:1789395119.283878:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613568 00000100:00100000:0.0:1789395119.283914:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613696 00000100:00100000:0.0:1789395119.283917:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613696 00000100:00100000:0.0:1789395119.283939:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239613824 00000100:00100000:0.0:1789395119.283942:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239613824 00000100:00100000:0.0:1789395119.283957:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789395119.283965:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239613568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395119.283996:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395119.284038:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239613568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395119.284044:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789395119.284073:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789395119.284083:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239613696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395119.284099:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789395119.284126:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239613696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395119.284133:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789395119.284143:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789395119.284150:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239613824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395119.284159:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395119.284186:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239613824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395119.284192:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789395119.284234:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239613696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395119.284265:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239613824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395119.284292:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239613568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395119.864989:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395119.867754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231689728 00000100:00100000:1.0:1789395119.867768:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231689728 00000100:00100000:1.0:1789395119.867866:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23387 00000100:00100000:1.0:1789395119.867878:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17622:x1876316231689728:12345-192.168.203.54@tcp:36:mkdir.0 00010000:00010000:1.0:1789395119.867930:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395119.867954:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345400/0xff35729af3169fe2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c4c expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.867974:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c7b89800) 00010000:00010000:1.0:1789395119.867983:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395119.868058:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868071:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868082:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868095:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868102:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868109:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868825:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868839:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868859:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395119.868874:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a8b9844 reply state 000000000edeb61f transno 4294983440 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868885:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868891:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151b:0x0].0x0 (ffff89a4d0654800) 00010000:00010000:1.0:1789395119.868894:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395119.868896:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789395119.868900:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151b:0x0]: returning size 4096 00010000:00010000:1.0:1789395119.868908:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868915:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868921:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868927:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868933:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395119.868937:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868949:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868958:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4d0654500) 00010000:00010000:1.0:1789395119.868960:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395119.868963:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868970:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a005 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395119.868984:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a8b9844 reply state 000000000edeb61f transno 4294983440 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868992:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.868997:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff89a4d0654100) 00010000:00010000:1.0:1789395119.869000:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395119.869001:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789395119.869089:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17622:x1876316231689728:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 1211us (4107us total) trans 4294983440 rc 0/0 00000100:00100000:1.0:1789395119.869097:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23387 00000100:00080000:0.0:1789395119.870452:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395119.887607:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395119.893412:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395119.893526:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690112 00000100:00100000:1.0:1789395119.893537:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690112 00000100:00100000:1.0:1789395119.893593:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23389 00000100:00100000:1.0:1789395119.893603:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17623:x1876316231690112:12345-192.168.203.54@tcp:36:rmdir.0 00010000:00010000:1.0:1789395119.893654:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395119.893680:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a02f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c53 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893697:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151b:0x0].0x0 (ffff89a4d0654800) 00010000:00010000:1.0:1789395119.893702:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395119.893725:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893738:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893747:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893759:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893766:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893773:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893856:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893866:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.893873:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395119.894082:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151b:0x0]: returning size 4096 00010000:00010000:1.0:1789395119.894098:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894105:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894112:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894118:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395119.894122:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894130:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894139:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151b:0x0].0x0 (ffff89a4d0654800) 00010000:00010000:1.0:1789395119.894141:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395119.894145:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894151:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a044 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x151b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894166:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894173:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894178:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894187:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894193:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395119.894195:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894202:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894210:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4d0654500) 00010000:00010000:1.0:1789395119.894212:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395119.894215:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894221:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a036 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395119.894233:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be0e3899 reply state 00000000c4e4a815 transno 4294983441 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894244:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395119.894250:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff89a4d0654100) 00010000:00010000:1.0:1789395119.894252:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395119.894254:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395119.894328:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17623:x1876316231690112:12345-192.168.203.54@tcp:36:rmdir.0 Request processed in 726us (946us total) trans 4294983441 rc 0/0 00000100:00100000:1.0:1789395119.894336:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23389 00000020:00000080:0.0:1789395120.616893:0:20551:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866e6 len=0 uarg=00007ffdac6b6dc0 00000004:00000080:0.0:1789395120.616920:0:20551:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=c00866e6 len=608 karg=ffff89a4ff86b400 uarg=0000000000000000 00000004:00000080:0.0:1789395120.616970:0:20551:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3ffc7ad3d98 00100000:10000000:0.0:1789395120.616976:0:20551:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1789395120.617359:0:20551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000-mdtlov_UUID:20551:1876316239614208:0@lo:1101:lctl.0 00000100:00100000:1.0:1789395120.617451:0:20551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.617500:0:20551:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181180 going to sleep for 11 seconds 00100000:10000000:0.0:1789395120.620768:0:20554:0:(scrub.c:295:scrub_thread_prep()) lustre-MDT0001: OI scrub prep, flags = 0x42 00100000:10000000:0.0:1789395120.620815:0:20554:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00000100:00100000:3.0:1789395120.620935:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:20553:1876316239614336:0@lo:900:lfsck.0 00000100:00100000:3.0:1789395120.620995:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.621041:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.621095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239614336 00000100:00100000:1.0:1789395120.621101:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239614336 00000100:00100000:1.0:1789395120.621144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789395120.621153:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:20553:x1876316239614336:12345-0@lo:900:lfsck.0 00000100:00100000:1.0:1789395120.621216:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:20553:x1876316239614336:12345-0@lo:900:lfsck.0 Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.621224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789395120.621543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239614464 00000100:00100000:1.0:1789395120.621547:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239614464 00000100:00100000:1.0:1789395120.621581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:1.0:1789395120.621587:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20553:x1876316239614464:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.621646:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20553:x1876316239614464:12345-0@lo:1000:lfsck.0 Request processed in 59us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.621653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:1.0:1789395120.621815:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239614592 00000100:00100000:1.0:1789395120.621819:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239614592 00000100:00100000:1.0:1789395120.621843:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1789395120.621848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20553:x1876316239614592:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.621904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20553:x1876316239614592:12345-0@lo:1000:lfsck.0 Request processed in 55us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.621910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1789395120.622177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239614720 00000100:00100000:1.0:1789395120.622182:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239614720 00000100:00100000:1.0:1789395120.622207:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:1.0:1789395120.622213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20553:x1876316239614720:12345-0@lo:101:lfsck.0 00010000:00010000:1.0:1789395120.622223:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395120.622237:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a052 lrc: 2/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a04b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.622257:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a052 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a04b expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.622270:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417a00/0xff35729af316a052 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a04b expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.622278:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff89a4d0654500) 00010000:00010000:1.0:1789395120.622281:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.622284:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417a00, rc 0) 00000100:00100000:1.0:1789395120.622309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239614720:12345-0@lo:101:lfsck.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.622314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:1.0:1789395120.622983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239614848 00000100:00100000:1.0:1789395120.622987:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239614848 00000100:00100000:1.0:1789395120.623017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1789395120.623023:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239614848:12345-0@lo:101:lfsck.0 00010000:00010000:1.0:1789395120.623032:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395120.623054:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af316a060 lrc: 2/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a059 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.623069:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af316a060 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a059 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.623079:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416800/0xff35729af316a060 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a059 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.623086:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x4649583 (ffff89a4d0654b00) 00010000:00010000:1.0:1789395120.623089:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.623091:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416800, rc 0) 00000100:00100000:1.0:1789395120.623119:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:20553:x1876316239614848:12345-0@lo:101:lfsck.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.623124:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1789395120.623610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239614976 00000100:00100000:1.0:1789395120.623615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239614976 00000100:00100000:1.0:1789395120.623644:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:1.0:1789395120.623649:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:20553:x1876316239614976:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.623718:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:20553:x1876316239614976:12345-0@lo:1000:lfsck.0 Request processed in 68us (302us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.623724:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:1.0:1789395120.624352:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239615232 00000100:00100000:1.0:1789395120.624356:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239615232 00000100:00100000:1.0:1789395120.624409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:1.0:1789395120.624416:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:20553:x1876316239615232:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.628783:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615232:12345-0@lo:1000:lfsck.0 Request processed in 4007us (4231us total) trans 4294983442 rc 0/0 00000100:00100000:1.0:1789395120.628793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00100000:10000000:3.0:1789395120.629006:0:20553:0:(lfsck_namespace.c:4580:lfsck_namespace_prep()) lustre-MDT0001-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00100000:10000000:1.0:1789395120.629056:0:20554:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0001: OI scrub start, flags = 0x42, pos = 12 00100000:10000000:3.0:1789395120.629747:0:20553:0:(lfsck_namespace.c:4478:lfsck_namespace_checkpoint()) lustre-MDT0001-osd: namespace LFSCK checkpoint at the pos [13, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:3.0:1789395120.629753:0:20553:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-MDT0001-osd entry: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 20553 00010000:00010000:0.0:1789395120.629756:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629768:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629777:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629784:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395120.629790:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629799:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629815:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff89a4d0654100) 00010000:00010000:0.0:1789395120.629818:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395120.629823:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629829:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316a00c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629843:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629850:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629857:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629863:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395120.629866:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629872:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629879:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151b:0x0].0x0 (ffff89a4d0654800) 00010000:00010000:0.0:1789395120.629882:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395120.629885:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629891:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a013 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629911:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629917:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629924:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629929:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395120.629933:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629944:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629952:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff89a4d0654100) 00010000:00010000:0.0:1789395120.629954:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395120.629957:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.629963:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a03d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.630178:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20551:x1876316239614208:12345-0@lo:1101:lctl.0 Request processed in 11808us (12725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.630188:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:0.0:1789395120.630228:0:20551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000-mdtlov_UUID:20551:1876316239614208:0@lo:1101:lctl.0 00100000:10000000:1.0:1789395120.631180:0:20554:0:(scrub.c:370:scrub_thread_post()) lustre-MDT0001: OI scrub post with result = 1 00100000:10000000:1.0:1789395120.631211:0:20554:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789395120.631216:0:20554:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0001: OI scrub: stop, pos = 1024001: rc = 1 00000100:00100000:3.0:1789395120.631331:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615360:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.631376:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.631696:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c840 going to sleep for 11 seconds 00010000:00010000:1.0:1789395120.631722:0:20552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.631738:0:20552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.631749:0:20552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.631756:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239615360 00000100:00100000:0.0:1789395120.631762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239615360 00010000:00010000:1.0:1789395120.631764:0:20552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.631770:0:20552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.631776:0:20552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.631863:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:0.0:1789395120.631872:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615360:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.631997:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615360:12345-0@lo:1000:lfsck.0 Request processed in 126us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.632004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00100000:3.0:1789395120.632063:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615360:0@lo:1000:lfsck.0 00010000:00010000:1.0:1789395120.632119:0:20552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632127:0:20552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 2/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632134:0:20552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632141:0:20552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395120.632144:0:20552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632152:0:20552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 4/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632164:0:20552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xaaab9583 (ffff89a4d0654e00) 00010000:00010000:1.0:1789395120.632167:0:20552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.632170:0:20552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 2/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632177:0:20552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416000/0xff35729af316a06e lrc: 0/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632191:0:20552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632197:0:20552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 2/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632203:0:20552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632208:0:20552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395120.632212:0:20552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632217:0:20552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 4/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632224:0:20552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff89a4d0654500) 00010000:00010000:1.0:1789395120.632226:0:20552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.632229:0:20552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 2/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.632235:0:20552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a067 lrc: 0/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20552 initiator: MDT0 lru_score: 0 lru_type: 0 00100000:10000000:1.0:1789395120.632258:0:20552:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0000-osd: start lfsck_namespace assistant thread 00000100:00100000:3.0:1789395120.632401:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615488:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.632429:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.632573:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c240 going to sleep for 11 seconds 00100000:10000000:1.0:1789395120.632673:0:20552:0:(lfsck_namespace.c:4580:lfsck_namespace_prep()) lustre-MDT0000-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00000100:00100000:1.0:1789395120.632699:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239615488 00000100:00100000:1.0:1789395120.632704:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239615488 00100000:10000000:0.0:1789395120.632710:0:20556:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x0, pos = 12 00000100:00100000:1.0:1789395120.632739:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:1.0:1789395120.632745:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615488:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.632890:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615488:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.633098:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615616:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.633122:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.633151:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.633343:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615488:12345-0@lo:1000:lfsck.0 Request processed in 597us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.633351:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:0.0:1789395120.633360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239615616 00000100:00100000:0.0:1789395120.633364:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239615616 00000100:00100000:0.0:1789395120.633419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1789395120.633435:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615616:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.633486:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615616:12345-0@lo:1000:lfsck.0 Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.633492:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:1.0:1789395120.638913:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239615744 00000100:00100000:1.0:1789395120.638926:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239615744 00000100:00100000:1.0:1789395120.638977:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:1.0:1789395120.638987:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615744:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.639094:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615744:12345-0@lo:1000:lfsck.0 Request processed in 108us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.639102:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:1.0:1789395120.639141:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d5180 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615744:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.639433:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615872:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.639588:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.639625:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.639648:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239615872 00000100:00100000:3.0:1789395120.639653:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239615872 00000100:00100000:3.0:1789395120.639691:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1789395120.639698:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615872:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.639747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239615872:12345-0@lo:1000:lfsck.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.639753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:1.0:1789395120.643290:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239615872:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.643363:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239616128:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.643666:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.643698:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.644234:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239616128:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.644362:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239616512:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.644455:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.644472:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181900 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.644484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239616512 00000100:00100000:1.0:1789395120.644487:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239616512 00000100:00100000:1.0:1789395120.644512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:1.0:1789395120.644519:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239616512:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.644830:0:20552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239616640:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.646081:0:20552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.646092:0:20552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.646109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239616768 00000100:00100000:3.0:1789395120.646115:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239616768 00000100:00100000:3.0:1789395120.646143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239616640 00000100:00100000:3.0:1789395120.646145:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239616640 00000100:00100000:3.0:1789395120.646158:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:3.0:1789395120.646164:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239616768:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.646279:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239616768:12345-0@lo:1000:lfsck_namespace.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.646286:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00000100:00100000:3.0:1789395120.646300:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:3.0:1789395120.646305:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20552:x1876316239616640:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.646349:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20552:x1876316239616640:12345-0@lo:1000:lfsck.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.646354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:3.0:1789395120.646402:0:20552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239616640:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.646478:0:20552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239616896:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.646508:0:20552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.646547:0:20552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.646561:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239616896 00000100:00100000:3.0:1789395120.646564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239616896 00000100:00100000:3.0:1789395120.646591:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1789395120.646597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20552:x1876316239616896:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.646648:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20552:x1876316239616896:12345-0@lo:1000:lfsck.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.646655:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:1.0:1789395120.646666:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239616512:12345-0@lo:1000:lfsck_namespace.0 Request processed in 2143us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.646677:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000100:00100000:3.0:1789395120.646690:0:20552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239616896:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.646731:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239616512:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.646845:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239617152:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.647040:0:20552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239617280:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.647074:0:20552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.647095:0:20552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.647108:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239617024 00000100:00100000:3.0:1789395120.647111:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239617024 00000100:00100000:3.0:1789395120.647137:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:3.0:1789395120.647145:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239617024:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.647200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239617024:12345-0@lo:1000:lfsck_namespace.0 Request processed in 56us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.647206:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1789395120.647246:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.647258:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.647487:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239617152 00000100:00100000:3.0:1789395120.647491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239617152 00000100:00100000:3.0:1789395120.647617:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:3.0:1789395120.647628:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239617152:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.647692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239617152:12345-0@lo:1000:lfsck_namespace.0 Request processed in 66us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.647709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:3.0:1789395120.647743:0:20552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239617280:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.647915:0:20552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239617536:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.647942:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239617152:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.647945:0:20552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.647966:0:20552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.647978:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239617536 00000100:00100000:3.0:1789395120.647982:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239617536 00000100:00100000:3.0:1789395120.647998:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1789395120.648003:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20552:x1876316239617536:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.648096:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20552:x1876316239617536:12345-0@lo:1000:lfsck.0 Request processed in 90us (148us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.648103:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:1.0:1789395120.648131:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239617664:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.648135:0:20552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239617536:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.648243:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.648267:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181900 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.648374:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239617920:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.648429:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.648441:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.649058:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239617664:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.649109:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904ca80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239618048:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.649140:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.649173:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.649321:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239617920:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.649620:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239618176:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.649658:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.649691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618176 00000100:00100000:1.0:1789395120.649696:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618176 00000100:00100000:1.0:1789395120.649719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1789395120.649727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239618176:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.649806:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239618176:12345-0@lo:1000:lfsck.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.649812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1789395120.649829:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.649842:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239618176:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.649869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618304 00000100:00100000:1.0:1789395120.649875:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618304 00000100:00100000:1.0:1789395120.649893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:1.0:1789395120.649899:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239618304:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.650085:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ca80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239618048:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.650146:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239618560:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.650258:0:20552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20552:1876316239618688:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.650302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239618304:12345-0@lo:1000:lfsck_namespace.0 Request processed in 401us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.650318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00100000:1.0:1789395120.650336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618432 00000100:00100000:1.0:1789395120.650341:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618432 00000100:00100000:1.0:1789395120.650358:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1789395120.650363:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239618432:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.650461:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239618432:12345-0@lo:1000:lfsck_namespace.0 Request processed in 97us (154us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.650468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1789395120.650685:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239618944:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.650724:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.650750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618816 00000100:00100000:1.0:1789395120.650754:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618816 00000100:00100000:1.0:1789395120.650774:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618944 00000100:00100000:1.0:1789395120.650777:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618944 00000100:00100000:1.0:1789395120.650787:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1789395120.650792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239618816:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.650843:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239618816:12345-0@lo:1000:lfsck_namespace.0 Request processed in 50us (144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.650849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1789395120.650859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1789395120.650864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239618944:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.650933:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239618944:12345-0@lo:1000:lfsck.0 Request processed in 68us (210us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.650942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1789395120.651270:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.651289:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239618944:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.652067:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239619200:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.652105:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.652135:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239619200 00000100:00100000:1.0:1789395120.652140:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239619200 00000100:00100000:1.0:1789395120.652227:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032 00000100:00100000:1.0:1789395120.652237:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239619200:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.652301:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239619200:12345-0@lo:1000:lfsck.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.652429:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.652459:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.652484:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618560 00000100:00100000:0.0:1789395120.652488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618560 00000100:00100000:0.0:1789395120.652507:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034 00000100:00100000:0.0:1789395120.652514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239618560:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.652646:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032 00000100:00100000:1.0:1789395120.652662:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239619456 00000100:00100000:1.0:1789395120.652666:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239619456 00000100:00100000:1.0:1789395120.652679:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1789395120.652685:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239619456:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.652749:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239619456:12345-0@lo:1000:lfsck_namespace.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.652756:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1789395120.652780:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.652800:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239619200:0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.652941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239618560:12345-0@lo:1000:lfsck_namespace.0 Request processed in 426us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.653015:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034 00000100:00100000:3.0:1789395120.653028:0:20552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.653029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239619584 00000100:00100000:0.0:1789395120.653034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239619584 00000100:00100000:0.0:1789395120.653062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239618688 00000100:00100000:0.0:1789395120.653065:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239618688 00000100:00100000:3.0:1789395120.653066:0:20552:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.653080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:0.0:1789395120.653086:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239619584:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.653136:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239619584:12345-0@lo:1000:lfsck_namespace.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.653142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:0.0:1789395120.653152:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:1.0:1789395120.653248:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239619712:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.653284:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.653372:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239619712 00000100:00100000:1.0:1789395120.653379:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239619712 00000100:00100000:1.0:1789395120.653420:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239619840 00000100:00100000:1.0:1789395120.653423:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239619840 00000100:00100000:1.0:1789395120.653437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1789395120.653442:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239619712:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.653490:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239619712:12345-0@lo:1000:lfsck.0 Request processed in 47us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.653497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1789395120.653510:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:1.0:1789395120.653517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239619840:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.653653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20552:x1876316239618688:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.653723:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20552:x1876316239618688:12345-0@lo:1000:lfsck.0 Request processed in 565us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.653729:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00100000:0.0:1789395120.653760:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239618560:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.653835:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239619968:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.654037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239619840:12345-0@lo:1000:lfsck_namespace.0 Request processed in 520us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.654054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:1.0:1789395120.654079:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.654093:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239619712:0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.654435:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.654456:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.654469:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239619968 00000100:00100000:0.0:1789395120.654472:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239619968 00000100:00100000:0.0:1789395120.654500:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:0.0:1789395120.654506:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239619968:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.654552:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239619968:12345-0@lo:1000:lfsck_namespace.0 Request processed in 45us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.654640:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239620096:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.654672:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.654690:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239620096 00000100:00100000:1.0:1789395120.654694:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239620096 00000100:00100000:1.0:1789395120.654712:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:1.0:1789395120.654718:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20553:x1876316239620096:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.654759:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20553:x1876316239620096:12345-0@lo:1000:lfsck.0 Request processed in 41us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.654765:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00000100:00100000:1.0:1789395120.654779:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.654792:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239620096:0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.655026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00100000:0.0:1789395120.655067:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239619968:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.655130:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239620224:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.655213:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.655236:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.655279:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239620224 00000100:00100000:1.0:1789395120.655283:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239620224 00000100:00100000:1.0:1789395120.655373:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:1.0:1789395120.655380:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239620224:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.655457:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239620224:12345-0@lo:1000:lfsck_namespace.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.655463:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1789395120.655668:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239620224:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.655722:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239620352:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.655754:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.655779:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.655792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239620352 00000100:00100000:0.0:1789395120.655796:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239620352 00000100:00100000:0.0:1789395120.655828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1789395120.655836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239620352:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.656029:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239620480:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.656068:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.656091:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.656255:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239620352:12345-0@lo:1000:lfsck_namespace.0 Request processed in 420us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.656266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1789395120.656278:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239620608 00000100:00100000:0.0:1789395120.656281:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239620608 00000100:00100000:0.0:1789395120.656295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239620480 00000100:00100000:0.0:1789395120.656298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239620480 00000100:00100000:0.0:1789395120.656313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1789395120.656319:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239620608:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.656371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239620608:12345-0@lo:1000:lfsck_namespace.0 Request processed in 52us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.656377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1789395120.656420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:0.0:1789395120.656426:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239620480:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.656516:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239620480:12345-0@lo:1000:lfsck.0 Request processed in 89us (447us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395120.656522:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000100:00100000:1.0:1789395120.656650:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239620352:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.656718:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239620736:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.656745:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.656772:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.656793:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239620480:0@lo:1000:lfsck.0 00000100:00100000:0.0:1789395120.657023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239620736 00000100:00100000:0.0:1789395120.657028:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239620736 00000100:00100000:0.0:1789395120.657064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1789395120.657072:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239620736:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.657135:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239620736:12345-0@lo:1000:lfsck_namespace.0 Request processed in 63us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.657145:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:1.0:1789395120.657255:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239620736:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.657677:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239621120:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.657709:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.657741:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.657757:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621120 00000100:00100000:1.0:1789395120.657762:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621120 00000100:00100000:1.0:1789395120.657875:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621248 00000100:00100000:1.0:1789395120.657880:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621248 00000100:00100000:1.0:1789395120.657904:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1789395120.657911:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621120:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.658093:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621120:12345-0@lo:1000:lfsck_namespace.0 Request processed in 182us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.658099:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1789395120.658110:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:1.0:1789395120.658116:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239621248:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.658178:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239621248:12345-0@lo:1000:lfsck_namespace.0 Request processed in 62us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.658184:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00100000:1.0:1789395120.658206:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239621120:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.658274:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239621376:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.658299:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.658313:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.658324:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621376 00000100:00100000:1.0:1789395120.658327:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621376 00000100:00100000:1.0:1789395120.658343:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:1.0:1789395120.658349:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621376:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.658431:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621376:12345-0@lo:1000:lfsck_namespace.0 Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.658437:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00000100:00100000:1.0:1789395120.658462:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239621376:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.658784:0:20553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239621632:0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.658818:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621504 00000100:00100000:1.0:1789395120.658823:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621504 00000100:00100000:1.0:1789395120.658842:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052 00000100:00100000:1.0:1789395120.659123:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621504:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.659257:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621504:12345-0@lo:1000:lfsck_namespace.0 Request processed in 408us (465us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.659264:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052 00000100:00100000:1.0:1789395120.659291:0:20553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.659311:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621632 00000100:00100000:1.0:1789395120.659314:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621632 00000100:00100000:1.0:1789395120.659329:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:1.0:1789395120.659335:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239621632:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1789395120.659509:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20553:x1876316239621632:12345-0@lo:1000:lfsck.0 Request processed in 49us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.659515:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00100000:1.0:1789395120.659532:0:20553:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.659545:0:20553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20553:1876316239621632:0@lo:1000:lfsck.0 00000100:00100000:3.0:1789395120.659678:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239621248:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.659757:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239621888:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.659789:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.659801:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.659929:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621760 00000100:00100000:1.0:1789395120.659933:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621760 00000100:00100000:1.0:1789395120.660236:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239621888 00000100:00100000:1.0:1789395120.660241:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239621888 00000100:00100000:1.0:1789395120.660258:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:1.0:1789395120.660265:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621760:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.660347:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239621760:12345-0@lo:1000:lfsck_namespace.0 Request processed in 82us (642us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.660353:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:1.0:1789395120.660367:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:1.0:1789395120.660372:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239621888:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.660460:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239621888:12345-0@lo:1000:lfsck_namespace.0 Request processed in 87us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.660466:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00100000:10000000:1.0:1789395120.660607:0:20553:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-MDT0001-osd ffff89a3c7b94f80 exit: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 512126, dir_cookie = 0x724f585c5a9140c9, parent = [0x240000400:0xb8:0x0], pid = 20553: rc = 1 00100000:10000000:1.0:1789395120.660619:0:20553:0:(lfsck_lib.c:2594:lfsck_post_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace post, rc = 1 00000100:00100000:3.0:1789395120.660710:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239621888:0@lo:1000:lfsck_namespace.0 00100000:10000000:3.0:1789395120.660771:0:20557:0:(lfsck_engine.c:1612:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread post 00000100:00100000:3.0:1789395120.660791:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239622016:0@lo:1101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.660821:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.660835:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935000 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.662022:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622016 00000100:00100000:1.0:1789395120.662028:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622016 00000100:00100000:1.0:1789395120.662070:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622144 00000100:00100000:1.0:1789395120.662073:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622144 00000100:00100000:1.0:1789395120.662087:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:1.0:1789395120.662095:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239622016:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:1.0:1789395120.662116:0:11908:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0001-osd: namespace LFSCK handles notify 3 from MDT 0, status 1, flags 0 00000100:00100000:0.0:1789395120.662345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:0.0:1789395120.662355:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239622144:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:0.0:1789395120.662367:0:6517:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0000-osd: namespace LFSCK handles notify 3 from MDT 1, status 1, flags 0 00000100:00100000:1.0:1789395120.662478:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239622016:12345-0@lo:1101:lfsck_namespace.0 Request processed in 382us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.662486:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00100000:10000000:1.0:1789395120.662507:0:20553:0:(lfsck_lib.c:2604:lfsck_post_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace post, rc = 1 00100000:10000000:1.0:1789395120.662546:0:20553:0:(lfsck_namespace.c:4808:lfsck_namespace_post()) lustre-MDT0001-osd: namespace LFSCK post done: rc = 0 00100000:10000000:1.0:1789395120.662567:0:20553:0:(lfsck_lib.c:2621:lfsck_double_scan_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace double_scan, status 2 00000100:00100000:0.0:1789395120.662618:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239622144:12345-0@lo:1101:lfsck_namespace.0 Request processed in 265us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.662624:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00100000:10000000:1.0:1789395120.664516:0:20553:0:(lfsck_lib.c:2630:lfsck_double_scan_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace double_scan, status 0 00000004:00080000:1.0:1789395120.664944:0:20557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 571718558519ns, next at 458696065280ns, rc = 0 00080000:00080000:1.0:1789395120.664963:0:20557:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789395120.665099:0:20557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 571718713093ns, next at 469924355898ns, rc = 0 00080000:00080000:1.0:1789395120.665105:0:20557:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1789395120.666782:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666790:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666797:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666804:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395120.666809:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666816:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666827:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18a:0x0].0x0 (ffff89a4c875d400) 00010000:00010000:1.0:1789395120.666831:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.666835:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666845:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af3169f1e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666861:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666866:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666873:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666878:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395120.666881:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666887:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666894:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff89a4c875d500) 00010000:00010000:1.0:1789395120.666896:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.666899:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.666905:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af3169f25 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395120.666955:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00000100:00100000:1.0:1789395120.667311:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622528 00000100:00100000:1.0:1789395120.667319:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622528 00000100:00100000:1.0:1789395120.667359:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:1.0:1789395120.667367:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7455:x1876316239622528:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395120.668080:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00100000:10000000:1.0:1789395120.668115:0:20557:0:(lfsck_engine.c:1651:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:1.0:1789395120.668126:0:20557:0:(lfsck_namespace.c:6704:lfsck_namespace_assistant_handler_p2()) lustre-MDT0000-osd: namespace LFSCK phase2 scan start 00100000:10000000:1.0:1789395120.668172:0:20557:0:(lfsck_namespace.c:6329:lfsck_namespace_scan_local_lpf()) lustre-MDT0000-osd: start to scan backend /lost+found 00100000:10000000:1.0:1789395120.668194:0:20557:0:(lfsck_namespace.c:6432:lfsck_namespace_scan_local_lpf()) lustre-MDT0000-osd: stop to scan backend /lost+found: rc = 1 00000100:00100000:1.0:1789395120.668268:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239622656:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.668309:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.668335:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.668556:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7455:x1876316239622528:12345-0@lo:1000:osp_up0-1.0 Request processed in 1188us (1304us total) trans 4294983443 rc 0/0 00000100:00100000:0.0:1789395120.668670:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622656 00000100:00100000:0.0:1789395120.668677:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622656 00000100:00100000:1.0:1789395120.668743:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:1.0:1789395120.669014:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239622528:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.669334:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622784 00000100:00100000:1.0:1789395120.669339:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622784 00000100:00100000:0.0:1789395120.676326:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:1.0:1789395120.676339:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:0.0:1789395120.676349:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239622656:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.676355:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239622784:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.676749:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239622784:12345-0@lo:1000:lfsck_namespace.0 Request processed in 399us (7496us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.676758:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00100000:1.0:1789395120.677374:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622912 00000100:00100000:1.0:1789395120.677381:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622912 00000100:00100000:1.0:1789395120.677437:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:1.0:1789395120.677444:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239622912:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.677518:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239622912:12345-0@lo:1000:lfsck_namespace.0 Request processed in 74us (407us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.677524:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:2.0:1789395120.677751:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239623040:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.677780:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.677803:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.678005:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623040 00000100:00100000:1.0:1789395120.678010:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623040 00000100:00100000:1.0:1789395120.678028:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:1.0:1789395120.678034:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239623040:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.678134:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239623040:12345-0@lo:1000:lfsck_namespace.0 Request processed in 99us (353us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.678140:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000100:00100000:0.0:1789395120.678316:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239622656:12345-0@lo:1000:lfsck_namespace.0 Request processed in 1976us (10006us total) trans 0 rc 1/1 00000100:00100000:0.0:1789395120.678323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00100000:1.0:1789395120.678683:0:20557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968412 gen 2 00000004:00080000:1.0:1789395120.678689:0:20557:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968409 committed transno 4294968412 00000020:00080000:1.0:1789395120.678695:0:20557:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4d11e0780 refcount 2 committed 0 result 0 batchid 385 00000020:00080000:1.0:1789395120.678700:0:20557:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4d11e0840 00000020:00080000:1.0:1789395120.678703:0:20557:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].382 00000020:00080000:1.0:1789395120.678706:0:20557:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c79b9400 00000020:00080000:1.0:1789395120.678709:0:20557:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].384 00000004:00080000:1.0:1789395120.678731:0:20557:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968411 committed transno 4294968412 00000004:00080000:1.0:1789395120.678742:0:20557:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968412 committed transno 4294968412 00000100:00100000:1.0:1789395120.678755:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239622656:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.678830:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623168:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.679064:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239623040:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1789395120.679103:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.679119:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.679130:0:20555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.679656:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239622272:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395120.679695:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.679745:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239622272 00000100:00100000:0.0:1789395120.679750:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239622272 00000100:00100000:0.0:1789395120.679788:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1789395120.679795:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3638:x1876316239622272:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1789395120.679807:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395120.679824:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af3169f95 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af3169f8e expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.679840:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xe7d4651 (ffff89a4c7b89400) 00000100:00100000:1.0:1789395120.680251:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.680270:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000020:00080000:1.0:1789395120.680284:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 386 committed batchid 384 00000020:00080000:1.0:1789395120.680340:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 384 00000100:00100000:1.0:1789395120.680352:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623168 00000100:00100000:1.0:1789395120.680356:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623168 00000100:00100000:1.0:1789395120.680396:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:1.0:1789395120.680404:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623168:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.680489:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623168:12345-0@lo:1000:lfsck_namespace.0 Request processed in 86us (238us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.680496:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00000100:00100000:1.0:1789395120.680529:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623168:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.680781:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239623296:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.680814:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.680826:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00010000:00010000:0.0:1789395120.680941:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395120.681802:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3638:x1876316239622272:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 2004us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.681811:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1789395120.682010:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239622272:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395120.682230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623296 00000100:00100000:0.0:1789395120.682237:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623296 00000100:00100000:0.0:1789395120.682265:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:0.0:1789395120.682272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239623296:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.682829:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623424:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.682888:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.682916:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.682934:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623424 00000100:00100000:1.0:1789395120.682938:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623424 00000100:00100000:1.0:1789395120.682972:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:1.0:1789395120.682978:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623424:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683065:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623424:12345-0@lo:1000:lfsck_namespace.0 Request processed in 87us (176us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.683073:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:1.0:1789395120.683101:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623424:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683188:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623552:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683211:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.683220:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.683232:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623552 00000100:00100000:1.0:1789395120.683236:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623552 00000100:00100000:1.0:1789395120.683251:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:1.0:1789395120.683257:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623552:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683307:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623552:12345-0@lo:1000:lfsck_namespace.0 Request processed in 49us (94us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.683313:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:1.0:1789395120.683334:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623552:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683434:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623680:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683457:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.683467:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.683478:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623680 00000100:00100000:1.0:1789395120.683481:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623680 00000100:00100000:1.0:1789395120.683496:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:1.0:1789395120.683502:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623680:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683575:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623680:12345-0@lo:1000:lfsck_namespace.0 Request processed in 72us (116us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.683581:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00100000:1.0:1789395120.683603:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623680:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683651:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623808:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683673:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.683681:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.683692:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623808 00000100:00100000:1.0:1789395120.683695:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623808 00000100:00100000:1.0:1789395120.683708:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:1.0:1789395120.683713:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623808:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683758:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623808:12345-0@lo:1000:lfsck_namespace.0 Request processed in 44us (84us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395120.683764:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00100000:1.0:1789395120.683781:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623808:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683903:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623936:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.683925:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.683934:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.683944:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239623936 00000100:00100000:1.0:1789395120.683947:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239623936 00000100:00100000:1.0:1789395120.683963:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:1.0:1789395120.683968:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623936:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684035:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239623936:12345-0@lo:1000:lfsck_namespace.0 Request processed in 66us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.684041:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:1.0:1789395120.684075:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239623936:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1789395120.684111:0:20557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684127:0:20557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684139:0:20557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.684178:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624064:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684201:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.684210:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.684221:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624064 00000100:00100000:1.0:1789395120.684224:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624064 00000100:00100000:1.0:1789395120.684241:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:1.0:1789395120.684246:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624064:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684307:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624064:12345-0@lo:1000:lfsck_namespace.0 Request processed in 59us (104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.684313:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:1.0:1789395120.684334:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624064:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1789395120.684351:0:20557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684359:0:20557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684366:0:20557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684372:0:20557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395120.684377:0:20557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684405:0:20557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684418:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff89a4cbd92300) 00010000:00010000:1.0:1789395120.684421:0:20557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789395120.684426:0:20557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684432:0:20557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316a098 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.684498:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624192:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684522:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.684533:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.684546:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624192 00000100:00100000:1.0:1789395120.684549:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624192 00000100:00100000:1.0:1789395120.684564:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:1.0:1789395120.684570:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624192:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684617:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624192:12345-0@lo:1000:lfsck_namespace.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.684624:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000100:00100000:1.0:1789395120.684645:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624192:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684681:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624320:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684704:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.684713:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.684724:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624320 00000100:00100000:1.0:1789395120.684727:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624320 00000100:00100000:1.0:1789395120.684742:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:1.0:1789395120.684748:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624320:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684796:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624320:12345-0@lo:1000:lfsck_namespace.0 Request processed in 48us (90us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.684802:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:1.0:1789395120.684823:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624320:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1789395120.684857:0:20557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684865:0:20557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684873:0:20557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.684885:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624448:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1789395120.684904:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.684913:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.684924:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624448 00000100:00100000:1.0:1789395120.684927:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624448 00000100:00100000:1.0:1789395120.684943:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:1.0:1789395120.684948:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20557:x1876316239624448:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1789395120.684956:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395120.684970:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af316a0a6 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a09f expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684988:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af316a0a6 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a09f expref: 6 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.684999:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417c00/0xff35729af316a0a6 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a09f expref: 6 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.685007:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff89a4cbd92e00) 00010000:00010000:1.0:1789395120.685009:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.685012:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417c00, rc 0) 00000100:00100000:1.0:1789395120.685038:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20557:x1876316239624448:12345-0@lo:101:lfsck_namespace.0 Request processed in 89us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.685164:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239623296:12345-0@lo:1000:lfsck_namespace.0 Request processed in 2890us (4348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395120.686562:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239623296:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1789395120.686632:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.686644:0:20555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.686653:0:20555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.686659:0:20555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395120.686665:0:20555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.686677:0:20555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.686695:0:20555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x44:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:2.0:1789395120.686699:0:20555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789395120.686705:0:20555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.686713:0:20555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de800/0xff35729af316a091 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x44:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395120.686829:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239624576:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.686904:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.686953:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.687485:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 3 min 2 max 116 00000100:00100000:2.0:1789395120.687499:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_003' 00000100:00100000:1.0:1789395120.688096:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00100000:1.0:1789395120.688171:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624448:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1789395120.688196:0:20557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0a6 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.688217:0:20557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0a6 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395120.688236:0:20557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000403:0x1:0x0] 00010000:00010000:1.0:1789395120.688274:0:20557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.688281:0:20557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.688290:0:20557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.688308:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624704:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1789395120.688358:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.688378:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.688410:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624576 00000100:00100000:1.0:1789395120.688415:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624576 00000100:00100000:0.0:1789395120.696445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:0.0:1789395120.696482:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624704 00000100:00100000:0.0:1789395120.696490:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624704 00000100:00100000:0.0:1789395120.696519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074 00000100:00100000:0.0:1789395120.696528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20557:x1876316239624704:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1789395120.696549:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395120.696571:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af316a0b4 lrc: 2/0,0 mode: --/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a0ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.696599:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af316a0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a0ad expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.696614:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014a00/0xff35729af316a0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a0ad expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.696623:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x6b6cbb47 (ffff89a4c875db00) 00010000:00010000:0.0:1789395120.696626:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395120.696630:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014a00, rc 0) 00000100:00100000:0.0:1789395120.696706:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20557:x1876316239624704:12345-0@lo:101:lfsck_namespace.0 Request processed in 180us (8348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395120.696713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074 00000100:00100000:2.0:1789395120.697581:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624704:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1789395120.697602:0:20557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0b4 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.697612:0:20557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0b4 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395120.697631:0:20557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000403:0x1:0x0] 00000100:00100000:2.0:1789395120.697671:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624832:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.697712:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.697751:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.698533:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624832 00000100:00100000:1.0:1789395120.698540:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624832 00000100:00100000:2.0:1789395120.700104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075 00000100:00100000:2.0:1789395120.700120:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239624576:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.700256:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239624576:12345-0@lo:1000:lfsck_namespace.0 Request processed in 140us (13352us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395120.700263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075 00000100:00100000:2.0:1789395120.700283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:2.0:1789395120.700289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20557:x1876316239624832:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.700342:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20557:x1876316239624832:12345-0@lo:1000:lfsck_namespace.0 Request processed in 53us (2630us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395120.700348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:2.0:1789395120.700405:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239624576:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.700488:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239624960:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.700521:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.700542:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.700567:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239624832:0@lo:1000:lfsck_namespace.0 00000004:00080000:2.0:1789395120.700611:0:20557:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca1cc780 with version 0 00000020:00100000:2.0:1789395120.700627:0:20557:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395120.700634:0:20557:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f63800 x1876316239625216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395120.700647:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239625216:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.700670:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.700683:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.700694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239624960 00000100:00100000:2.0:1789395120.700698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239624960 00000100:00100000:2.0:1789395120.700718:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239625216 00000100:00100000:2.0:1789395120.700721:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239625216 00000100:00100000:2.0:1789395120.700733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:2.0:1789395120.700739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239624960:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.700783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239624960:12345-0@lo:1000:lfsck_namespace.0 Request processed in 43us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395120.700789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00100000:2.0:1789395120.700802:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:2.0:1789395120.700807:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20557:x1876316239625216:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.703055:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239624960:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.703169:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625344:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.703280:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.703299:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.703373:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239625344 00000100:00100000:1.0:1789395120.703380:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239625344 00000100:00100000:1.0:1789395120.703433:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079 00000100:00100000:1.0:1789395120.703442:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239625344:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1789395120.703532:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239625344:12345-0@lo:1000:lfsck_namespace.0 Request processed in 90us (251us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395120.703541:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079 00000100:00100000:2.0:1789395120.703616:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625344:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1789395120.703657:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.703668:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.703678:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395120.703690:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625472:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1789395120.703714:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.703737:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.703776:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239625472 00000100:00100000:1.0:1789395120.703780:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239625472 00000100:00100000:1.0:1789395120.703795:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:1.0:1789395120.703800:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20555:x1876316239625472:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1789395120.703809:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395120.703824:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316a0c2 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a0bb expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.703849:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316a0c2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a0bb expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.703861:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416a00/0xff35729af316a0c2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a0bb expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.703869:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff89a4cbd92500) 00010000:00010000:1.0:1789395120.703872:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.703876:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416a00, rc 0) 00000100:00100000:1.0:1789395120.703911:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239625472:12345-0@lo:101:lfsck_namespace.0 Request processed in 110us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.703917:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00100000:2.0:1789395120.703971:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625472:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1789395120.703984:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0c2 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.703995:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0c2 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395120.704007:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00010000:00010000:2.0:1789395120.704025:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.704032:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.704039:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395120.704062:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625600:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1789395120.704084:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.704104:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.704140:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239625600 00000100:00100000:1.0:1789395120.704144:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239625600 00000100:00100000:1.0:1789395120.704162:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081 00000100:00100000:1.0:1789395120.704169:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239625600:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1789395120.704176:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395120.704188:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af316a0d0 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a0c9 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.704202:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af316a0d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a0c9 expref: 10 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.704212:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416200/0xff35729af316a0d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a0c9 expref: 10 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.704219:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x3403eb9 (ffff89a4cbd92d00) 00010000:00010000:1.0:1789395120.704221:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395120.704224:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416200, rc 0) 00000100:00100000:1.0:1789395120.704258:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20555:x1876316239625600:12345-0@lo:101:lfsck_namespace.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395120.704263:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081 00000100:00100000:2.0:1789395120.704316:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625600:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1789395120.704326:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0d0 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.704334:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0d0 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395120.704343:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00000100:00100000:2.0:1789395120.704362:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625728:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.704414:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.704430:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.704495:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239625728 00000100:00100000:0.0:1789395120.704499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239625728 00000100:00100000:0.0:1789395120.704530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:0.0:1789395120.704539:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20555:x1876316239625728:12345-0@lo:1000:lfsck_namespace.0 00000001:00080000:3.0:1789395120.704604:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968414 is committed 00000100:00100000:0.0:1789395120.704609:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20555:x1876316239625728:12345-0@lo:1000:lfsck_namespace.0 Request processed in 72us (195us total) trans 0 rc -2/-2 00000020:00080000:3.0:1789395120.704612:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 380 batchid updated 00000100:00100000:0.0:1789395120.704616:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000020:00080000:1.0:1789395120.704642:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 380 00000004:00080000:1.0:1789395120.704685:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca06af00 with version 725 00000020:00080000:1.0:1789395120.704695:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 379 cancel update log [0x200000401:0x3:0x0].379: rc = 0 00000020:00080000:1.0:1789395120.704757:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 379 cancel update log [0x240000400:0x3:0x0].379: rc = 0 00000004:00080000:1.0:1789395120.704776:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca06a300 with version 726 00000020:00080000:1.0:1789395120.704779:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 380 cancel update log [0x200000401:0x3:0x0].380: rc = 0 00000020:00080000:1.0:1789395120.704796:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 380 cancel update log [0x240000400:0x3:0x0].380: rc = 0 00000020:00080000:1.0:1789395120.704801:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 380 00000004:00080000:1.0:1789395120.704809:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 725 rpc_version 725 00000020:00100000:1.0:1789395120.704824:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395120.704831:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a17800 x1876316239625984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395120.704843:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239625984:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.704870:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.704893:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.704905:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239625984 00000100:00100000:1.0:1789395120.704909:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239625984 00000100:00100000:1.0:1789395120.704933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083 00000100:00100000:1.0:1789395120.704939:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7455:x1876316239625984:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.705031:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7455:x1876316239625984:12345-0@lo:1000:osp_up0-1.0 Request processed in 92us (160us total) trans 4294983444 rc 0/0 00000100:00100000:1.0:1789395120.705038:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083 00000100:00100000:1.0:1789395120.705085:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a17800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239625984:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395120.705093:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 726 rpc_version 726 00000020:00100000:1.0:1789395120.705104:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395120.705109:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4ffb6df80 x1876316239626240/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395120.705121:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb6df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239626240:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.705144:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.705159:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.705169:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239626240 00000100:00100000:1.0:1789395120.705173:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239626240 00000100:00100000:1.0:1789395120.705192:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:1.0:1789395120.705198:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:7455:x1876316239626240:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.705270:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7455:x1876316239626240:12345-0@lo:1000:osp_up0-1.0 Request processed in 71us (124us total) trans 4294983445 rc 0/0 00000100:00100000:1.0:1789395120.705277:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:1.0:1789395120.705306:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239626240:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395120.705362:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239625728:0@lo:1000:lfsck_namespace.0 00000004:00080000:2.0:1789395120.705437:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca1cccc0 with version 0 00000020:00100000:2.0:1789395120.705451:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395120.705456:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f62d80 x1876316239626496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395120.705468:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239626496:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.705491:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.705512:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.705630:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20557:x1876316239625216:12345-0@lo:1000:lfsck_namespace.0 Request processed in 4822us (4959us total) trans 4294968414 rc 0/0 00000100:00100000:3.0:1789395120.705637:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:3.0:1789395120.705650:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239626496 00000100:00100000:3.0:1789395120.705653:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239626496 00000100:00100000:3.0:1789395120.705675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:3.0:1789395120.705680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:20555:x1876316239626496:12345-0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1789395120.706211:0:20557:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968414 committed transno 4294968414 00000100:00100000:3.0:1789395120.706216:0:20557:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968414 gen 2 00000100:00100000:3.0:1789395120.706226:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239625216:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.706247:0:20557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0b4 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706258:0:20557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416e00/0xff35729af316a0ad lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x1:0x0].0x6b6cbb47 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0b4 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706268:0:20557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0a6 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706274:0:20557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca416000/0xff35729af316a09f lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0a6 expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1789395120.706282:0:20557:0:(lfsck_namespace.c:1662:lfsck_namespace_create_orphan_dir()) lustre-MDT0000-osd: namespace LFSCK create orphan dir for the object [0x240000402:0xd5:0x0], name = [0x240000402:0xd5:0x0]-P-0: rc = 1 00010000:00010000:3.0:1789395120.706319:0:20557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706327:0:20557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706336:0:20557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.706348:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239626624:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.706375:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.706414:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.706427:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239626624 00000100:00100000:3.0:1789395120.706430:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239626624 00000100:00100000:3.0:1789395120.706460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086 00000100:00100000:3.0:1789395120.706467:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20557:x1876316239626624:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.706478:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.706492:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af316a0de lrc: 2/0,0 mode: --/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a0d7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706512:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af316a0de lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a0d7 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706524:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344c00/0xff35729af316a0de lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a0d7 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706532:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd5:0x0].0x0 (ffff89a3c9b1b600) 00010000:00010000:3.0:1789395120.706535:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395120.706538:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344c00, rc 0) 00000100:00100000:3.0:1789395120.706569:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239626624:12345-0@lo:101:lfsck_namespace.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.706575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086 00000100:00100000:3.0:1789395120.706600:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239626624:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.706612:0:20557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0de expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706621:0:20557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0de expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.706632:0:20557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0xd5:0x0] 00010000:00010000:3.0:1789395120.706649:0:20557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706655:0:20557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706662:0:20557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20557 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.706673:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239626752:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.706693:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.706710:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239626752 00000100:00100000:3.0:1789395120.706712:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239626752 00000100:00100000:3.0:1789395120.706729:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087 00000100:00100000:3.0:1789395120.706735:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20557:x1876316239626752:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.706741:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.706751:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af316a0ec lrc: 2/0,0 mode: --/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a0e5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706770:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af316a0ec lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a0e5 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706779:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9345a00/0xff35729af316a0ec lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a0e5 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706785:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd5:0x0].0x7d29dea (ffff89a3c9b1bf00) 00010000:00010000:3.0:1789395120.706787:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1789395120.706789:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345a00, rc 0) 00000100:00100000:3.0:1789395120.706810:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239626752:12345-0@lo:101:lfsck_namespace.0 Request processed in 75us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.706815:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087 00000100:00100000:3.0:1789395120.706828:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.706838:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239626752:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.706846:0:20557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0ec expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.706854:0:20557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0ec expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.706863:0:20557:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0xd5:0x0] 00000100:00100000:3.0:1789395120.706904:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239626880:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.706924:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.706939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239626880 00000100:00100000:3.0:1789395120.706942:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239626880 00000100:00100000:3.0:1789395120.706955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:3.0:1789395120.706960:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239626880:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.707008:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239626880:12345-0@lo:1000:lfsck_namespace.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.707014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:3.0:1789395120.707026:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff9353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.707036:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239626880:0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1789395120.707143:0:20557:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4ff935e40 with version 0 00000020:00100000:3.0:1789395120.707154:0:20557:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.707160:0:20557:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f5880 x1876316239627136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.707171:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627136:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.707193:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.707208:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239627136 00000100:00100000:3.0:1789395120.707211:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239627136 00000100:00100000:3.0:1789395120.707225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:3.0:1789395120.707230:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20557:x1876316239627136:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.707312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:20557:x1876316239627136:12345-0@lo:1000:lfsck_namespace.0 Request processed in 80us (117us total) trans 4294968415 rc 0/0 00000100:00100000:3.0:1789395120.707319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:3.0:1789395120.707334:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.707348:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627136:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.707375:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627264:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.707431:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.707448:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239627264 00000100:00100000:3.0:1789395120.707451:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239627264 00000100:00100000:3.0:1789395120.707466:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:3.0:1789395120.707471:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:20557:x1876316239627264:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.707513:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:20557:x1876316239627264:12345-0@lo:1000:lfsck_namespace.0 Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.707518:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:3.0:1789395120.707531:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.707542:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627264:0@lo:1000:lfsck_namespace.0 00000040:00080000:3.0:1789395120.707652:0:20557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].385, 448 off586112 00000040:00080000:3.0:1789395120.707672:0:20557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].383, 448 off638888 00000004:00080000:3.0:1789395120.707676:0:20557:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4ff935300 with version 729 00000004:00080000:3.0:1789395120.707691:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 729 rpc_version 729 00000020:00100000:3.0:1789395120.707706:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.707711:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f5f80 x1876316239627520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.707724:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239627520:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395120.707748:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.707761:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f5b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.707773:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239627520 00000100:00100000:3.0:1789395120.707776:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239627520 00000100:00100000:3.0:1789395120.707794:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:3.0:1789395120.707800:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239627520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395120.708070:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239627520:12345-0@lo:1000:osp_up1-0.0 Request processed in 270us (320us total) trans 4294968416 rc 0/0 00000100:00100000:3.0:1789395120.708077:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:3.0:1789395120.708107:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239627520:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395120.708167:0:20557:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4c4f5b300 with version 0 00000020:00100000:3.0:1789395120.708181:0:20557:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.708186:0:20557:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f6a00 x1876316239627776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.708199:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627776:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708225:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.708244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239627776 00000100:00100000:3.0:1789395120.708248:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239627776 00000100:00100000:3.0:1789395120.708265:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092 00000100:00100000:3.0:1789395120.708272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:20557:x1876316239627776:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708354:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239627776:12345-0@lo:1000:lfsck_namespace.0 Request processed in 82us (128us total) trans 4294968417 rc 0/0 00000100:00100000:3.0:1789395120.708361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092 00000100:00100000:3.0:1789395120.708376:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f5bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.708411:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627776:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.708423:0:20557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0ec expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.708433:0:20557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9345400/0xff35729af316a0e5 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xd5:0x0].0x7d29dea bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0ec expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.708441:0:20557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0de expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.708448:0:20557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3c9344600/0xff35729af316a0d7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0de expref: -99 pid: 20557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1789395120.708455:0:20557:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0000-osd: namespace LFSCK insert object [0x200000401:0x6e:0x0] with the name [0x200000401:0x6e:0x0]:1 and type 40000 to the parent [0x240000402:0xd5:0x0]: rc = 1 00000100:00100000:3.0:1789395120.708528:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627904:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708553:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.708572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239627904 00000100:00100000:3.0:1789395120.708575:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239627904 00000100:00100000:3.0:1789395120.708590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093 00000100:00100000:3.0:1789395120.708596:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239627904:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708646:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239627904:12345-0@lo:1000:lfsck_namespace.0 Request processed in 50us (91us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.708653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093 00000100:00100000:3.0:1789395120.708667:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.708677:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239627904:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708729:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239628032:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708752:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.708771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239628032 00000100:00100000:3.0:1789395120.708774:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239628032 00000100:00100000:3.0:1789395120.708789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1789395120.708795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239628032:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708834:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239628032:12345-0@lo:1000:lfsck_namespace.0 Request processed in 40us (81us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.708840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1789395120.708855:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.708866:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239628032:0@lo:1000:lfsck_namespace.0 00100000:10000000:3.0:1789395120.708904:0:20557:0:(lfsck_namespace.c:6723:lfsck_namespace_assistant_handler_p2()) lustre-MDT0000-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00000100:00100000:3.0:1789395120.708923:0:20557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239628160:0@lo:1101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.708945:0:20557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.708961:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239628160 00000100:00100000:3.0:1789395120.708965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239628160 00000100:00100000:3.0:1789395120.709020:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1789395120.709501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239628160:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:3.0:1789395120.709528:0:6516:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0001-osd: namespace LFSCK handles notify 4 from MDT 0, status 1, flags 0 00000100:00100000:3.0:1789395120.709565:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:20557:x1876316239628160:12345-0@lo:1101:lfsck_namespace.0 Request processed in 521us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.709571:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1789395120.709597:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.709613:0:20557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20557:1876316239628160:0@lo:1101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.709619:0:20557:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356c00 going to sleep for 0 seconds 00100000:10000000:3.0:1789395120.709627:0:20557:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before exit 00000004:00080000:3.0:1789395120.709645:0:20557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 571763259199ns, next at 458696065280ns, rc = 0 00080000:00080000:3.0:1789395120.709654:0:20557:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789395120.709669:0:20557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 571763283980ns, next at 469924355898ns, rc = 0 00080000:00080000:3.0:1789395120.709673:0:20557:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00080000:3.0:1789395120.714222:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983446 is committed 00000020:00080000:3.0:1789395120.714238:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 386 batchid updated 00000020:00080000:0.0:1789395120.714284:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00000004:00080000:0.0:1789395120.714341:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca349900 with version 730 00000020:00080000:0.0:1789395120.714352:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 385 cancel update log [0x240000401:0x3:0x0].382: rc = 0 00000020:00080000:0.0:1789395120.714431:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 385 cancel update log [0x200000400:0x3:0x0].384: rc = 0 00000020:00080000:0.0:1789395120.714441:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00000004:00080000:0.0:1789395120.714449:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 730 rpc_version 730 00000020:00100000:0.0:1789395120.714477:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395120.714486:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79bd180 x1876316239628416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395120.714516:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239628416:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395120.714573:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.714616:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395120.714812:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239628416 00000100:00100000:1.0:1789395120.714820:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239628416 00000100:00100000:1.0:1789395120.714870:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:1.0:1789395120.714880:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239628416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395120.714999:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239628416:12345-0@lo:1000:osp_up1-0.0 Request processed in 120us (424us total) trans 4294968418 rc 0/0 00000100:00100000:1.0:1789395120.715007:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:0.0:1789395120.715381:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239628416:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395120.715685:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239626496:12345-0@lo:1000:lfsck_namespace.0 Request processed in 10003us (10191us total) trans 4294983446 rc 0/0 00000100:00100000:3.0:1789395120.715693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000004:00080000:1.0:1789395120.715768:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983446 committed transno 4294983446 00000100:00100000:1.0:1789395120.715772:0:20555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983446 gen 2 00000004:00080000:1.0:1789395120.715775:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983443 committed transno 4294983446 00000004:00080000:1.0:1789395120.715788:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983444 committed transno 4294983446 00000004:00080000:1.0:1789395120.715797:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983445 committed transno 4294983446 00000100:00100000:1.0:1789395120.715812:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239626496:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1789395120.715833:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0d0 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.715844:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de200/0xff35729af316a0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x3403eb9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0d0 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.715852:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0c2 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.715859:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de600/0xff35729af316a0bb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0c2 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:1.0:1789395120.715865:0:20555:0:(lfsck_namespace.c:1662:lfsck_namespace_create_orphan_dir()) lustre-MDT0001-osd: namespace LFSCK create orphan dir for the object [0x200000402:0x140c:0x0], name = [0x200000402:0x140c:0x0]-P-0: rc = 1 00010000:00010000:1.0:1789395120.715904:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.715911:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.715924:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.715937:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239628544:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1789395120.715964:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.715990:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.716139:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239628544 00000100:00100000:3.0:1789395120.716144:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239628544 00000100:00100000:3.0:1789395120.716179:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:3.0:1789395120.716186:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20555:x1876316239628544:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.716202:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.716217:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af316a0fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a0f3 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.716273:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af316a0fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a0f3 expref: 10 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.716284:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344800/0xff35729af316a0fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a0f3 expref: 10 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.716317:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x140c:0x0].0x0 (ffff89a3c9b1bb00) 00010000:00010000:3.0:1789395120.716320:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395120.716323:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344800, rc 0) 00000100:00100000:3.0:1789395120.716352:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20555:x1876316239628544:12345-0@lo:101:lfsck_namespace.0 Request processed in 167us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.716358:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000004:00080000:2.0:1789395120.716490:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000004:00080000:2.0:1789395120.716505:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00100000:10000000:3.0:1789395120.716620:0:20557:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:3.0:1789395120.716676:0:20557:0:(lfsck_engine.c:1778:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:3.0:1789395120.716681:0:20557:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00000100:00100000:1.0:1789395120.716947:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239628544:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1789395120.716963:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0fa expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.716975:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a0fa expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395120.716990:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x140c:0x0] 00010000:00010000:1.0:1789395120.717012:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.717019:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395120.717026:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395120.717040:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239628672:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1789395120.717078:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.717109:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.717191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239628672 00000100:00100000:3.0:1789395120.717196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239628672 00000100:00100000:3.0:1789395120.717235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098 00000100:00100000:3.0:1789395120.717242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20555:x1876316239628672:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.717251:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.717263:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316a108 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a101 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.717284:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316a108 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a101 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.717294:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345800/0xff35729af316a108 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a101 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.717301:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x140c:0x0].0x2b2a12fb (ffff89a3c9b1b200) 00010000:00010000:3.0:1789395120.717303:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1789395120.717306:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345800, rc 0) 00000100:00100000:3.0:1789395120.717342:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:20555:x1876316239628672:12345-0@lo:101:lfsck_namespace.0 Request processed in 100us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.717347:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098 00000100:00100000:2.0:1789395120.717423:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239628672:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1789395120.717435:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a108 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.717444:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a108 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395120.717455:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x140c:0x0] 00000100:00100000:2.0:1789395120.717505:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239628800:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.717532:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.717549:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.717597:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239628800 00000100:00100000:3.0:1789395120.717600:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239628800 00000100:00100000:3.0:1789395120.717627:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099 00000100:00100000:3.0:1789395120.717633:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:20555:x1876316239628800:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.717688:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:20555:x1876316239628800:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.717695:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099 00000100:00100000:2.0:1789395120.717747:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239628800:0@lo:1000:lfsck_namespace.0 00000004:00080000:2.0:1789395120.717846:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca1cc480 with version 0 00000020:00100000:2.0:1789395120.717859:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395120.717865:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f63480 x1876316239629056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395120.717882:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629056:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.717905:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.717925:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.717962:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239629056 00000100:00100000:3.0:1789395120.717966:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239629056 00000100:00100000:3.0:1789395120.717993:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1789395120.717999:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:20555:x1876316239629056:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.718109:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:20555:x1876316239629056:12345-0@lo:1000:lfsck_namespace.0 Request processed in 110us (203us total) trans 4294983447 rc 0/0 00000100:00100000:3.0:1789395120.718120:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1789395120.718146:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629056:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.718173:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629184:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.718195:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.718206:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.718247:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239629184 00000100:00100000:2.0:1789395120.718251:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239629184 00000100:00100000:2.0:1789395120.718280:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:2.0:1789395120.718287:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:20555:x1876316239629184:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.718341:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:20555:x1876316239629184:12345-0@lo:1000:lfsck_namespace.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395120.718348:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:3.0:1789395120.718490:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629184:0@lo:1000:lfsck_namespace.0 00000040:00080000:3.0:1789395120.718629:0:20555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].381, 448 off575736 00000040:00080000:3.0:1789395120.718655:0:20555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].381, 448 off629264 00000004:00080000:3.0:1789395120.718660:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356c00 with version 727 00000004:00080000:1.0:1789395120.718709:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 727 rpc_version 727 00000020:00100000:1.0:1789395120.718729:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395120.718736:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d6a00 x1876316239629440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395120.718750:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239629440:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.718779:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.718832:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.724005:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239629440 00000100:00100000:2.0:1789395120.724019:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239629440 00000100:00100000:2.0:1789395120.724089:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:2.0:1789395120.724100:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7455:x1876316239629440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395120.727206:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:7455:x1876316239629440:12345-0@lo:1000:osp_up0-1.0 Request processed in 3098us (8415us total) trans 4294983448 rc 0/0 00000100:00100000:2.0:1789395120.727218:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:1.0:1789395120.727414:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239629440:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1789395120.731274:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356900 with version 0 00000020:00100000:3.0:1789395120.731309:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.731321:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6d80 x1876316239629696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 408/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.731344:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629696:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.731500:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.731593:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.735765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239629696 00000100:00100000:0.0:1789395120.735780:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239629696 00000100:00100000:3.0:1789395120.735915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:3.0:1789395120.735925:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20555:x1876316239629696:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239629696:12345-0@lo:1000:lfsck_namespace.0 Request processed in 213us (4636us total) trans 4294983449 rc 0/0 00000100:00100000:3.0:1789395120.736144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:3.0:1789395120.736192:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629696:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.736214:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a108 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.736226:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417400/0xff35729af316a101 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x140c:0x0].0x2b2a12fb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a108 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.736235:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0fa expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.736242:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417000/0xff35729af316a0f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x140c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a0fa expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1789395120.736249:0:20555:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x44:0x0] with the name [0x240000401:0x44:0x0]:1 and type 40000 to the parent [0x200000402:0x140c:0x0]: rc = 1 00000100:00100000:3.0:1789395120.736367:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629824:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736427:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.736459:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.736475:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239629824 00000100:00100000:3.0:1789395120.736479:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239629824 00000100:00100000:3.0:1789395120.736507:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:3.0:1789395120.736513:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239629824:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736573:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239629824:12345-0@lo:1000:lfsck_namespace.0 Request processed in 59us (146us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.736579:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:3.0:1789395120.736603:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629824:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736671:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629952:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736691:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.736704:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.736715:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239629952 00000100:00100000:3.0:1789395120.736718:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239629952 00000100:00100000:3.0:1789395120.736736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:3.0:1789395120.736741:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239629952:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736788:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239629952:12345-0@lo:1000:lfsck_namespace.0 Request processed in 46us (95us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.736794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:3.0:1789395120.736814:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239629952:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736861:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630080:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736882:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.736894:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.736905:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630080 00000100:00100000:3.0:1789395120.736908:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630080 00000100:00100000:3.0:1789395120.736925:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:3.0:1789395120.736931:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630080:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.736986:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630080:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (103us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.736992:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:3.0:1789395120.737014:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630080:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737091:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630208:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737112:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.737124:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.737134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630208 00000100:00100000:3.0:1789395120.737137:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630208 00000100:00100000:3.0:1789395120.737152:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:3.0:1789395120.737157:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630208:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630208:12345-0@lo:1000:lfsck_namespace.0 Request processed in 51us (95us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.737216:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:3.0:1789395120.737239:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630208:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737289:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630336:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737311:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.737324:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.737334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630336 00000100:00100000:3.0:1789395120.737337:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630336 00000100:00100000:3.0:1789395120.737352:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00100000:3.0:1789395120.737358:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630336:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737439:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630336:12345-0@lo:1000:lfsck_namespace.0 Request processed in 81us (127us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.737445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:3.0:1789395120.737466:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630336:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737530:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630464:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737552:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.737571:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.737581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630464 00000100:00100000:3.0:1789395120.737584:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630464 00000100:00100000:3.0:1789395120.737598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:3.0:1789395120.737603:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630464:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737650:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630464:12345-0@lo:1000:lfsck_namespace.0 Request processed in 46us (97us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.737659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:3.0:1789395120.737682:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630464:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737783:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630592:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737806:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.737820:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.737831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630592 00000100:00100000:3.0:1789395120.737833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630592 00000100:00100000:3.0:1789395120.737849:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110 00000100:00100000:3.0:1789395120.737855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630592:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.737929:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630592:12345-0@lo:1000:lfsck_namespace.0 Request processed in 74us (121us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.737936:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110 00000100:00100000:3.0:1789395120.737961:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630592:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.737996:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738013:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738024:0:20555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.738075:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630720:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738099:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.738112:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.738122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630720 00000100:00100000:3.0:1789395120.738125:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630720 00000100:00100000:3.0:1789395120.738141:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111 00000100:00100000:3.0:1789395120.738146:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630720:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738204:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630720:12345-0@lo:1000:lfsck_namespace.0 Request processed in 57us (103us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.738210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111 00000100:00100000:3.0:1789395120.738232:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630720:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.738248:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738255:0:20555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738263:0:20555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738269:0:20555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395120.738273:0:20555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738281:0:20555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738293:0:20555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7b:0x0].0x0 (ffff89a3c9b1b400) 00010000:00010000:3.0:1789395120.738297:0:20555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789395120.738301:0:20555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 2/0,0 mode: --/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738308:0:20555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344e00/0xff35729af316a10f lrc: 0/0,0 mode: --/EX res: [0x240000401:0x7b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.738357:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630848:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738407:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.738427:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.738438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630848 00000100:00100000:3.0:1789395120.738441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630848 00000100:00100000:3.0:1789395120.738458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:3.0:1789395120.738464:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630848:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738518:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630848:12345-0@lo:1000:lfsck_namespace.0 Request processed in 54us (134us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.738525:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 00000100:00100000:3.0:1789395120.738549:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630848:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738581:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630976:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738604:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.738617:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.738627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239630976 00000100:00100000:3.0:1789395120.738630:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239630976 00000100:00100000:3.0:1789395120.738646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:3.0:1789395120.738653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630976:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738703:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239630976:12345-0@lo:1000:lfsck_namespace.0 Request processed in 50us (98us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.738710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:3.0:1789395120.738733:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239630976:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.738764:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738777:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738787:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.738799:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631104:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.738826:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.738839:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.738849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239631104 00000100:00100000:3.0:1789395120.738852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239631104 00000100:00100000:3.0:1789395120.738868:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114 00000100:00100000:3.0:1789395120.738874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239631104:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.738883:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.738895:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af316a11d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af316a11d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a116 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738924:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345e00/0xff35729af316a11d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a116 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.738932:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff89a4cbd92500) 00010000:00010000:3.0:1789395120.738934:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395120.738937:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345e00, rc 0) 00000100:00100000:3.0:1789395120.738965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:20555:x1876316239631104:12345-0@lo:101:lfsck_namespace.0 Request processed in 91us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.738974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114 00000100:00100000:3.0:1789395120.741174:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631104:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.741202:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a11d expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.741216:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a11d expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.741234:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00010000:00010000:3.0:1789395120.741270:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.741277:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.741288:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.741303:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631232:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.743343:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.743445:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.743981:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239631232 00000100:00100000:2.0:1789395120.743990:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239631232 00000100:00100000:2.0:1789395120.744034:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:2.0:1789395120.744051:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20555:x1876316239631232:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1789395120.744068:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395120.744094:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af316a12b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a124 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.744121:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af316a12b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a124 expref: 16 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.744135:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de800/0xff35729af316a12b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a124 expref: 16 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.744143:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0xc5b723b7 (ffff89a4f3d38200) 00010000:00010000:2.0:1789395120.744146:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395120.744150:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de800, rc 0) 00000100:00100000:2.0:1789395120.744197:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239631232:12345-0@lo:101:lfsck_namespace.0 Request processed in 155us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395120.744203:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1789395120.744318:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631232:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.744333:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a12b expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.744344:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a12b expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.744367:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00000100:00100000:3.0:1789395120.744433:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631360:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.744462:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.744485:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.748550:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239631360 00000100:00100000:2.0:1789395120.748566:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239631360 00000100:00100000:2.0:1789395120.748625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116 00000100:00100000:2.0:1789395120.748635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239631360:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.748771:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239631360:12345-0@lo:1000:lfsck_namespace.0 Request processed in 137us (4307us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395120.748779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116 00000100:00100000:3.0:1789395120.749191:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631360:0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1789395120.749252:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356300 with version 0 00000020:00100000:3.0:1789395120.749276:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.749283:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6300 x1876316239631616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.749302:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631616:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.749338:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.749524:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.750176:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239631616 00000100:00100000:2.0:1789395120.750182:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239631616 00000100:00100000:2.0:1789395120.750257:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117 00000100:00100000:2.0:1789395120.750265:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239631616:12345-0@lo:1000:lfsck_namespace.0 00000001:00080000:2.0:1789395120.757303:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983450 is committed 00000100:00100000:3.0:1789395120.764426:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20555:x1876316239631616:12345-0@lo:1000:lfsck_namespace.0 Request processed in 14152us (15078us total) trans 4294983450 rc 0/0 00000100:00100000:3.0:1789395120.764441:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117 00000004:00080000:2.0:1789395120.765631:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983450 committed transno 4294983450 00000100:00100000:2.0:1789395120.765638:0:20555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983450 gen 2 00000004:00080000:2.0:1789395120.765643:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983447 committed transno 4294983450 00000004:00080000:2.0:1789395120.765663:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983448 committed transno 4294983450 00000004:00080000:2.0:1789395120.765674:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983449 committed transno 4294983450 00000100:00100000:2.0:1789395120.765699:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631616:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1789395120.765726:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a12b expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.765736:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345600/0xff35729af316a124 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xc5b723b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a12b expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.765745:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a11d expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.765751:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9345200/0xff35729af316a116 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a11d expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1789395120.765758:0:20555:0:(lfsck_namespace.c:1662:lfsck_namespace_create_orphan_dir()) lustre-MDT0001-osd: namespace LFSCK create orphan dir for the object [0x200000402:0x147a:0x0], name = [0x200000402:0x147a:0x0]-P-0: rc = 1 00010000:00010000:3.0:1789395120.767650:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.767666:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.767678:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.767701:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631744:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.767763:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.767820:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.767892:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239631744 00000100:00100000:2.0:1789395120.767901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239631744 00000100:00100000:2.0:1789395120.767961:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:2.0:1789395120.767971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20555:x1876316239631744:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1789395120.767993:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395120.768012:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af316a139 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a132 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.768036:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af316a139 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a132 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.768061:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de000/0xff35729af316a139 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a132 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.768074:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x147a:0x0].0x0 (ffff89a4f3d38900) 00010000:00010000:2.0:1789395120.768085:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395120.768088:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de000, rc 0) 00000100:00100000:2.0:1789395120.768125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239631744:12345-0@lo:101:lfsck_namespace.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395120.768132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:3.0:1789395120.768632:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631744:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.768649:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a139 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768660:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a139 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.768680:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x147a:0x0] 00010000:00010000:3.0:1789395120.768706:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768714:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768722:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.768735:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631872:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.768763:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.768786:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.768801:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239631872 00000100:00100000:3.0:1789395120.768805:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239631872 00000100:00100000:3.0:1789395120.768837:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:3.0:1789395120.768843:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:20555:x1876316239631872:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.768851:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.768863:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316a147 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a140 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768883:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316a147 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a140 expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768894:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344000/0xff35729af316a147 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a140 expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768901:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x147a:0x0].0x24e1bf1c (ffff89a3c9b1b000) 00010000:00010000:3.0:1789395120.768904:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1789395120.768906:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344000, rc 0) 00000100:00100000:3.0:1789395120.768933:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20555:x1876316239631872:12345-0@lo:101:lfsck_namespace.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.768939:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:3.0:1789395120.768962:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239631872:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.768972:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a147 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.768980:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a147 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.768990:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x147a:0x0] 00000100:00100000:3.0:1789395120.769056:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632000:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.769091:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.769106:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.769120:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239632000 00000100:00100000:3.0:1789395120.769123:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239632000 00000100:00100000:3.0:1789395120.769145:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:3.0:1789395120.769151:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20555:x1876316239632000:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.769212:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20555:x1876316239632000:12345-0@lo:1000:lfsck_namespace.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.769218:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:3.0:1789395120.769241:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632000:0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1789395120.769353:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca3560c0 with version 0 00000020:00100000:3.0:1789395120.769366:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.769373:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d5180 x1876316239632256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.769408:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632256:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.769430:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.769448:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.769470:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239632256 00000100:00100000:3.0:1789395120.769474:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239632256 00000100:00100000:3.0:1789395120.770138:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:3.0:1789395120.770148:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20555:x1876316239632256:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.770280:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239632256:12345-0@lo:1000:lfsck_namespace.0 Request processed in 134us (848us total) trans 4294983451 rc 0/0 00000100:00100000:3.0:1789395120.770286:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:3.0:1789395120.770319:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632256:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.770354:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632384:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.770378:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.770422:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.770434:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239632384 00000100:00100000:3.0:1789395120.770439:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239632384 00000100:00100000:3.0:1789395120.770457:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122 00000100:00100000:3.0:1789395120.770461:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239632384:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.771158:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20555:x1876316239632384:12345-0@lo:1000:lfsck_namespace.0 Request processed in 693us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.771166:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122 00000100:00100000:3.0:1789395120.771202:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632384:0@lo:1000:lfsck_namespace.0 00000040:00080000:3.0:1789395120.771363:0:20555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].382, 448 off576184 00000040:00080000:3.0:1789395120.771411:0:20555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].382, 448 off629712 00000004:00080000:3.0:1789395120.771417:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356300 with version 728 00000004:00080000:1.0:1789395120.771599:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 728 rpc_version 728 00000020:00100000:1.0:1789395120.771619:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395120.771627:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d7800 x1876316239632640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395120.771643:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239632640:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.771677:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.771710:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.772145:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239632640 00000100:00100000:3.0:1789395120.772151:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239632640 00000100:00100000:3.0:1789395120.772234:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123 00000100:00100000:3.0:1789395120.772243:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:7455:x1876316239632640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395120.772626:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:7455:x1876316239632640:12345-0@lo:1000:osp_up0-1.0 Request processed in 384us (947us total) trans 4294983452 rc 0/0 00000100:00100000:3.0:1789395120.772646:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123 00000100:00100000:1.0:1789395120.772797:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239632640:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1789395120.775610:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca349b40 with version 0 00000020:00100000:0.0:1789395120.775645:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395120.775657:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79bdc00 x1876316239632896/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 408/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395120.775682:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632896:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.775742:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.780457:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239632896 00000100:00100000:2.0:1789395120.780471:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239632896 00000100:00100000:2.0:1789395120.780764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1789395120.780777:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:20555:x1876316239632896:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.780976:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239632896:12345-0@lo:1000:lfsck_namespace.0 Request processed in 202us (5233us total) trans 4294983453 rc 0/0 00000100:00100000:2.0:1789395120.780984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:0.0:1789395120.781716:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.781758:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239632896:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1789395120.781782:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a147 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.781794:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344200/0xff35729af316a140 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x147a:0x0].0x24e1bf1c bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a147 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.781804:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a139 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.781812:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3c9344e00/0xff35729af316a132 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x147a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a139 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:0.0:1789395120.781820:0:20555:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x7b:0x0] with the name [0x240000401:0x7b:0x0]:1 and type 40000 to the parent [0x200000402:0x147a:0x0]: rc = 1 00000100:00100000:0.0:1789395120.781951:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633024:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.781996:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.782018:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.782167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633024 00000100:00100000:2.0:1789395120.782172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633024 00000100:00100000:2.0:1789395120.782215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:2.0:1789395120.782224:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633024:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.782308:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633024:12345-0@lo:1000:lfsck_namespace.0 Request processed in 84us (310us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395120.782315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:0.0:1789395120.783223:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633024:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.783350:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633152:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.783396:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.783417:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.784040:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633152 00000100:00100000:3.0:1789395120.784056:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633152 00000100:00100000:3.0:1789395120.784164:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1789395120.784173:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633152:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.784274:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633152:12345-0@lo:1000:lfsck_namespace.0 Request processed in 102us (890us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.784281:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00100000:0.0:1789395120.785250:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633152:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1789395120.785310:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 3/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.785331:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.785342:0:20555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.785435:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633280:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.786621:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.786660:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.805153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633280 00000100:00100000:2.0:1789395120.805165:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633280 00000100:00100000:2.0:1789395120.805214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:2.0:1789395120.805223:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633280:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.805459:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633280:12345-0@lo:1000:lfsck_namespace.0 Request processed in 236us (18840us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395120.805466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:0.0:1789395120.806233:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633280:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1789395120.806282:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.806291:0:20555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.806299:0:20555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.806305:0:20555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395120.806309:0:20555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.806317:0:20555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.806332:0:20555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7d:0x0].0x0 (ffff89a4c875d200) 00010000:00010000:0.0:1789395120.806335:0:20555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789395120.806340:0:20555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 2/0,0 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.806347:0:20555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014800/0xff35729af316a14e lrc: 0/0,0 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.806583:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633408:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.806628:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.806720:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.816639:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633408 00000100:00100000:3.0:1789395120.816654:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633408 00000100:00100000:3.0:1789395120.818568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128 00000100:00100000:3.0:1789395120.818581:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633408:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.818730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633408:12345-0@lo:1000:lfsck_namespace.0 Request processed in 151us (12100us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395120.818738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128 00000100:00100000:0.0:1789395120.819155:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633408:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.819236:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633536:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.819272:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.819319:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.822412:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633536 00000100:00100000:3.0:1789395120.822436:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633536 00000100:00100000:3.0:1789395120.822493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129 00000100:00100000:3.0:1789395120.822504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633536:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.823277:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633536:12345-0@lo:1000:lfsck_namespace.0 Request processed in 775us (4003us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.823286:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129 00000100:00100000:0.0:1789395120.823886:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633536:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1789395120.823959:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.823970:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.823980:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.823997:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633664:0@lo:101:lfsck_namespace.0 00000100:00100000:0.0:1789395120.824032:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.826230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633664 00000100:00100000:3.0:1789395120.826243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633664 00000100:00100000:3.0:1789395120.826300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:3.0:1789395120.826309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239633664:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.826327:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.826347:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af316a15c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a155 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.826377:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af316a15c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a155 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.826408:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9345000/0xff35729af316a15c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a155 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.826418:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff89a4cbd92500) 00010000:00010000:3.0:1789395120.826431:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395120.826436:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9345000, rc 0) 00000100:00100000:3.0:1789395120.826496:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:20555:x1876316239633664:12345-0@lo:101:lfsck_namespace.0 Request processed in 188us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.826503:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:0.0:1789395120.826786:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395120.826815:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633664:0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1789395120.826833:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a15c expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.826850:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a15c expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395120.826867:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00010000:00010000:0.0:1789395120.826902:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.826909:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.826917:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395120.826935:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633792:0@lo:101:lfsck_namespace.0 00000100:00100000:0.0:1789395120.826970:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.827207:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.831670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633792 00000100:00100000:3.0:1789395120.831683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633792 00000100:00100000:3.0:1789395120.831734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:3.0:1789395120.831743:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:20555:x1876316239633792:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.831762:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.831787:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217a400/0xff35729af316a16a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.831814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217a400/0xff35729af316a16a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a163 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.831829:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217a400/0xff35729af316a16a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a163 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.831837:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0xd8bed831 (ffff89a3c9b1b100) 00010000:00010000:3.0:1789395120.831841:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395120.831845:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a50217a400, rc 0) 00000100:00100000:3.0:1789395120.831912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239633792:12345-0@lo:101:lfsck_namespace.0 Request processed in 170us (4942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.831919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:0.0:1789395120.832191:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633792:0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1789395120.832211:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a16a expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395120.832223:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a16a expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395120.832243:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00000100:00100000:0.0:1789395120.832286:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633920:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1789395120.832323:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395120.832357:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.833608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239633920 00000100:00100000:3.0:1789395120.833616:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239633920 00000100:00100000:3.0:1789395120.833663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132 00000100:00100000:3.0:1789395120.833672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239633920:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.833775:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239633920:12345-0@lo:1000:lfsck_namespace.0 Request processed in 103us (1451us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395120.833782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132 00000100:00100000:3.0:1789395120.833820:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239633920:0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1789395120.833883:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356c00 with version 0 00000020:00100000:3.0:1789395120.833902:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.833909:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6a00 x1876316239634176/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.833925:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634176:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.833955:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.833973:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.833984:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239634176 00000100:00100000:3.0:1789395120.833987:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239634176 00000100:00100000:3.0:1789395120.834007:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133 00000100:00100000:3.0:1789395120.834013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239634176:12345-0@lo:1000:lfsck_namespace.0 00000001:00080000:3.0:1789395120.846639:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983454 is committed 00000100:00100000:3.0:1789395120.846756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:20555:x1876316239634176:12345-0@lo:1000:lfsck_namespace.0 Request processed in 12739us (12796us total) trans 4294983454 rc 0/0 00000100:00100000:3.0:1789395120.846768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133 00000004:00080000:3.0:1789395120.846817:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983454 committed transno 4294983454 00000100:00100000:3.0:1789395120.846821:0:20555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983454 gen 2 00000004:00080000:3.0:1789395120.846825:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983451 committed transno 4294983454 00000004:00080000:3.0:1789395120.846840:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983452 committed transno 4294983454 00000004:00080000:3.0:1789395120.846849:0:20555:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983453 committed transno 4294983454 00000100:00100000:3.0:1789395120.846870:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634176:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1789395120.846897:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a16a expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.846909:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca015600/0xff35729af316a163 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xd8bed831 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a16a expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.846918:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a15c expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.846925:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca014800/0xff35729af316a155 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a15c expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1789395120.846932:0:20555:0:(lfsck_namespace.c:1662:lfsck_namespace_create_orphan_dir()) lustre-MDT0001-osd: namespace LFSCK create orphan dir for the object [0x200000402:0x147e:0x0], name = [0x200000402:0x147e:0x0]-P-0: rc = 1 00010000:00010000:3.0:1789395120.846976:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.846984:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.846994:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.847009:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634304:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.847039:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.848578:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.848606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239634304 00000100:00100000:3.0:1789395120.848614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239634304 00000100:00100000:3.0:1789395120.848662:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3134 00000100:00100000:3.0:1789395120.848670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:20555:x1876316239634304:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.848689:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.848706:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217ae00/0xff35729af316a178 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a171 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.848732:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217ae00/0xff35729af316a178 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a171 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.848745:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217ae00/0xff35729af316a178 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a171 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.848753:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x147e:0x0].0x0 (ffff89a3c9b1b300) 00010000:00010000:3.0:1789395120.848756:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395120.848759:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a50217ae00, rc 0) 00000100:00100000:3.0:1789395120.848807:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239634304:12345-0@lo:101:lfsck_namespace.0 Request processed in 138us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.848813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3134 00000100:00100000:3.0:1789395120.848847:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634304:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.848863:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a178 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.848873:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a178 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.848890:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x147e:0x0] 00010000:00010000:3.0:1789395120.848916:0:20555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.848923:0:20555:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.848932:0:20555:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20555 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395120.848947:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634432:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1789395120.848975:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.848995:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.849005:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239634432 00000100:00100000:3.0:1789395120.849008:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239634432 00000100:00100000:3.0:1789395120.849034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135 00000100:00100000:3.0:1789395120.849041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20555:x1876316239634432:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.849061:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395120.849072:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217b400/0xff35729af316a186 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.849086:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217b400/0xff35729af316a186 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a17f expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.849095:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a50217b400/0xff35729af316a186 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a17f expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.849102:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x147e:0x0].0xc87934c6 (ffff89a3c9b1be00) 00010000:00010000:3.0:1789395120.849105:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1789395120.849108:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a50217b400, rc 0) 00000100:00100000:3.0:1789395120.849135:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:20555:x1876316239634432:12345-0@lo:101:lfsck_namespace.0 Request processed in 94us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.849142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135 00000100:00100000:3.0:1789395120.849167:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634432:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1789395120.849176:0:20555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a186 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395120.849184:0:20555:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a186 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395120.849194:0:20555:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x147e:0x0] 00000100:00100000:3.0:1789395120.849251:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634560:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.849277:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.849291:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395120.849302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239634560 00000100:00100000:3.0:1789395120.849305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239634560 00000100:00100000:3.0:1789395120.849324:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1789395120.849331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:20555:x1876316239634560:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.849411:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:20555:x1876316239634560:12345-0@lo:1000:lfsck_namespace.0 Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395120.850705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1789395120.850757:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634560:0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1789395120.850886:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356c00 with version 0 00000020:00100000:3.0:1789395120.850905:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395120.850913:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6a00 x1876316239634816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395120.850931:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634816:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1789395120.850969:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395120.851039:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.856276:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239634816 00000100:00100000:2.0:1789395120.856291:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239634816 00000100:00100000:2.0:1789395120.856354:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:2.0:1789395120.856364:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:20555:x1876316239634816:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.859943:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239634816:12345-0@lo:1000:lfsck_namespace.0 Request processed in 3572us (8964us total) trans 4294983455 rc 0/0 00000100:00100000:2.0:1789395120.859957:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:2.0:1789395120.863490:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634816:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.863578:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634944:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.863639:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.863686:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.863714:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239634944 00000100:00100000:2.0:1789395120.863719:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239634944 00000100:00100000:2.0:1789395120.863768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:2.0:1789395120.863777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239634944:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.863881:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:20555:x1876316239634944:12345-0@lo:1000:lfsck_namespace.0 Request processed in 104us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395120.863888:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:2.0:1789395120.863919:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239634944:0@lo:1000:lfsck_namespace.0 00000040:00080000:2.0:1789395120.864135:0:20555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].383, 448 off576632 00000040:00080000:2.0:1789395120.864163:0:20555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].383, 448 off630160 00000004:00080000:2.0:1789395120.864168:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca1cc480 with version 729 00000004:00080000:1.0:1789395120.864635:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 729 rpc_version 729 00000020:00100000:1.0:1789395120.864661:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395120.864669:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d5c00 x1876316239635200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395120.864687:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239635200:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395120.864724:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395120.864745:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.864806:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239635200 00000100:00100000:2.0:1789395120.864812:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239635200 00000100:00100000:2.0:1789395120.864839:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:2.0:1789395120.864858:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:7455:x1876316239635200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395120.866222:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239635200:12345-0@lo:1000:osp_up0-1.0 Request processed in 1372us (1494us total) trans 4294983456 rc 0/0 00000100:00100000:2.0:1789395120.866233:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:0.0:1789395120.866521:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239635200:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1789395120.866774:0:20555:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca1cc0c0 with version 0 00000020:00100000:2.0:1789395120.866794:0:20555:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395120.866801:0:20555:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f63480 x1876316239635456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 408/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395120.866818:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239635456:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.866864:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.866893:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.866909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239635456 00000100:00100000:2.0:1789395120.866914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239635456 00000100:00100000:2.0:1789395120.866947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:2.0:1789395120.866954:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:20555:x1876316239635456:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.867069:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:20555:x1876316239635456:12345-0@lo:1000:lfsck_namespace.0 Request processed in 115us (204us total) trans 4294983457 rc 0/0 00000100:00100000:2.0:1789395120.867085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00100000:2.0:1789395120.867114:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239635456:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1789395120.867128:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a186 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.867141:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217a200/0xff35729af316a17f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x147e:0x0].0xc87934c6 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a186 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.867155:0:20555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a178 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395120.867162:0:20555:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a50217b200/0xff35729af316a171 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x147e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a178 expref: -99 pid: 20555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1789395120.867168:0:20555:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x7d:0x0] with the name [0x240000401:0x7d:0x0]:1 and type 40000 to the parent [0x200000402:0x147e:0x0]: rc = 1 00000100:00100000:2.0:1789395120.867257:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239635584:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.867281:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.867295:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.867307:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239635584 00000100:00100000:2.0:1789395120.867311:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239635584 00000100:00100000:2.0:1789395120.867329:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:2.0:1789395120.867341:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:20555:x1876316239635584:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.867441:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:20555:x1876316239635584:12345-0@lo:1000:lfsck_namespace.0 Request processed in 105us (157us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395120.867447:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:2.0:1789395120.867470:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239635584:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.867716:0:20555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239635712:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.867742:0:20555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395120.867763:0:20555:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789395120.867776:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239635712 00000100:00100000:2.0:1789395120.867779:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239635712 00000100:00100000:2.0:1789395120.867797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:2.0:1789395120.867803:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:20555:x1876316239635712:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1789395120.867859:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:20555:x1876316239635712:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (115us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395120.867865:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:2.0:1789395120.867888:0:20555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20555:1876316239635712:0@lo:1000:lfsck_namespace.0 00100000:10000000:2.0:1789395120.867909:0:20555:0:(lfsck_namespace.c:6723:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00100000:10000000:2.0:1789395120.867917:0:20555:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before exit 00000004:00080000:2.0:1789395120.867931:0:20555:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 571921545268ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789395120.867939:0:20555:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789395120.867966:0:20555:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 571921580870ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789395120.867971:0:20555:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789395120.870277:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:0.0:1789395120.870800:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:0.0:1789395120.870821:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca349c00 refcount 2 committed 0 result 0 batchid 386 00000020:00080000:0.0:1789395120.870828:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca349b40 00000020:00080000:0.0:1789395120.870832:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca289200 00000020:00080000:0.0:1789395120.870843:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca356480 refcount 2 committed 0 result 0 batchid 385 00000020:00080000:0.0:1789395120.870857:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca356300 00000020:00080000:0.0:1789395120.870860:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].382 00000020:00080000:0.0:1789395120.870863:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82eba00 00000020:00080000:0.0:1789395120.870866:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].382 00000020:00080000:0.0:1789395120.870872:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca356600 refcount 2 committed 0 result 0 batchid 384 00000020:00080000:0.0:1789395120.870874:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ea00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca3560c0 00000020:00080000:0.0:1789395120.870877:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82ebc00 00000020:00080000:0.0:1789395120.870881:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca356540 refcount 2 committed 0 result 0 batchid 383 00000020:00080000:0.0:1789395120.870883:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca356900 00000020:00080000:0.0:1789395120.870886:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ed00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c79b9000 00000020:00080000:0.0:1789395120.870890:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca356d80 refcount 2 committed 0 result 0 batchid 382 00000020:00080000:0.0:1789395120.870892:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca356c00 00000020:00080000:0.0:1789395120.870895:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].381 00000020:00080000:0.0:1789395120.870897:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c79b9200 00000020:00080000:0.0:1789395120.870899:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].381 00000020:00080000:0.0:1789395120.870903:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca1cc600 refcount 2 committed 0 result 0 batchid 381 00000020:00080000:0.0:1789395120.870907:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cc480 00000020:00080000:0.0:1789395120.870910:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca3d2c00 00000001:00080000:0.0:1789395120.870918:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968418 is committed 00000020:00080000:0.0:1789395120.870948:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 386 committed batchid 380 00000020:00080000:0.0:1789395120.871007:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 380 00100000:10000000:0.0:1789395120.871018:0:20555:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:0.0:1789395120.871072:0:20555:0:(lfsck_engine.c:1778:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:0.0:1789395120.871092:0:20555:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00010000:00010000:2.0:1789395120.885672:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395121.722816:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395121.722862:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395121.722884:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395121.722912:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395121.722944:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395121.722970:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690752 00000100:00100000:0.0:1789395121.722979:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690752 00000100:00100000:0.0:1789395121.723034:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690624 00000100:00100000:0.0:1789395121.723047:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690624 00000100:00100000:0.0:1789395121.723075:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 382 00000100:00100000:0.0:1789395121.723085:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231690752:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395121.723147:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231690752:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395121.723154:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 382 00000100:00100000:0.0:1789395121.723171:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 383 00000100:00100000:0.0:1789395121.723177:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231690624:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395121.723199:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231690624:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395121.723208:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 383 00000100:00080000:0.0:1789395121.723226:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789395121.723231:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395121.723278:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690240 00000100:00100000:1.0:1789395121.723282:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690240 00000100:00100000:1.0:1789395121.723320:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 431 00000100:00100000:1.0:1789395121.723328:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231690240:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395121.723361:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231690240:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395121.723368:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 431 00000100:00100000:3.0:1789395121.723652:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690496 00000100:00100000:3.0:1789395121.723657:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690496 00000100:00100000:3.0:1789395121.723702:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690368 00000100:00100000:3.0:1789395121.723705:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690368 00000100:00100000:3.0:1789395121.723728:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 575 00000100:00100000:3.0:1789395121.723735:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231690496:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395121.723768:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231690496:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 33us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395121.723774:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 575 00000100:00100000:3.0:1789395121.723788:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 576 00000100:00100000:3.0:1789395121.723795:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231690368:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395121.723823:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231690368:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 29us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395121.723829:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 576 00000100:00080000:1.0:1789395121.724211:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789395121.724215:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789395121.910482:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395122.872055:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239635840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395122.872128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395122.873061:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239635840 00000100:00100000:0.0:1789395122.873071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239635840 00000100:00100000:0.0:1789395122.873119:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:0.0:1789395122.873129:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239635840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395122.873163:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443983360 avail 1297743872 00000100:00100000:0.0:1789395122.873218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239635840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395122.873225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00100000:2.0:1789395122.875472:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239635840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789395122.914900:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395122.914972:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231690880 00000100:00100000:3.0:1789395122.914982:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231690880 00000100:00100000:3.0:1789395122.915053:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23390 00000100:00100000:3.0:1789395122.915065:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17655:x1876316231690880:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395122.915086:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395122.915108:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a18d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c5a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.915162:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316a194 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.915175:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316a194 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.915189:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316a194 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395122.915236:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1789395122.915242:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395122.915295:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a18d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c5a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.915329:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316a194 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c5a expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.915338:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395122.915341:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395122.915343:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b000, rc 0) 00000100:00100000:3.0:1789395122.915790:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17655:x1876316231690880:12345-192.168.203.54@tcp:101:ls.0 Request processed in 726us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395122.915799:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23390 00000100:00100000:3.0:1789395122.921239:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395122.921500:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231691008 00000100:00100000:1.0:1789395122.921511:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231691008 00000100:00100000:1.0:1789395122.921565:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23391 00000100:00100000:1.0:1789395122.921575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:17655:x1876316231691008:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:1.0:1789395122.921596:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395122.921619:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a19b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c61 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395122.921677:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395122.921690:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395122.921703:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395122.921744:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1789395122.921749:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1789395122.921799:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a19b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395122.921816:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395122.921831:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:1.0:1789395122.921834:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789395122.921837:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417800, rc 0) 00000100:00100000:1.0:1789395122.921893:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17655:x1876316231691008:12345-192.168.203.54@tcp:101:ls.0 Request processed in 319us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395122.921900:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23391 00010000:00010000:1.0:1789395122.930656:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395122.935603:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395122.936203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231691136 00000100:00100000:3.0:1789395122.936213:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231691136 00000100:00100000:3.0:1789395122.936273:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5013 00000100:00100000:3.0:1789395122.936284:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17655:x1876316231691136:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:3.0:1789395122.950321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17655:x1876316231691136:12345-192.168.203.54@tcp:37:ls.0 Request processed in 14029us (14717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395122.950334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5013 00000100:00100000:0.0:1789395122.960431:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395122.960649:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231691264 00000100:00100000:2.0:1789395122.960658:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231691264 00000100:00100000:2.0:1789395122.960799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5014 00000100:00100000:2.0:1789395122.960809:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17655:x1876316231691264:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395122.968877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17655:x1876316231691264:12345-192.168.203.54@tcp:37:ls.0 Request processed in 8057us (8442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395122.968893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5014 00000100:00100000:1.0:1789395122.975267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395122.975345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231691520 00000100:00100000:3.0:1789395122.975357:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231691520 00000100:00100000:3.0:1789395122.975447:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23392 00000100:00100000:3.0:1789395122.975458:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17655:x1876316231691520:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395122.975478:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395122.975508:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a1a9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c68 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975580:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975596:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975610:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975625:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975632:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975638:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975689:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316a1be lrc: 3/1,0 mode: --/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975698:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316a1be lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975706:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316a1be lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975719:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975726:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975733:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975741:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975747:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395122.975752:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975760:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975771:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395122.975775:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395122.975779:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975787:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a1b0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975801:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975808:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975814:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975820:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395122.975823:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975830:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975837:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8b6906c (ffff89a3ca35f400) 00010000:00010000:3.0:1789395122.975840:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395122.975843:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975849:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316a1b7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975881:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a1a9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c68 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975894:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316a1be lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c68 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.975902:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:3.0:1789395122.975904:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395122.975907:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b800, rc 0) 00000100:00100000:3.0:1789395122.980150:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17655:x1876316231691520:12345-192.168.203.54@tcp:101:ls.0 Request processed in 4682us (4879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395122.980167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23392 00000100:00100000:3.0:1789395122.987229:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395122.987302:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231691776 00000100:00100000:0.0:1789395122.987310:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231691776 00000100:00100000:0.0:1789395122.987370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23393 00000100:00100000:0.0:1789395122.987381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:17655:x1876316231691776:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395122.987827:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395122.987851:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a1c5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c6f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395122.987991:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x9c:0x0]: returning size 4096 00010000:00010000:0.0:1789395122.988105:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a1c5 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c6f expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395122.988120:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:0.0:1789395122.988123:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395122.988129:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a1c5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c6f expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395122.988145:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:0.0:1789395122.988210:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17655:x1876316231691776:12345-192.168.203.54@tcp:101:ls.0 Request processed in 831us (990us total) trans 4294968419 rc 301/301 00000100:00100000:0.0:1789395122.988217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23393 00000100:00100000:0.0:1789395122.998999:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395122.999077:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231691904 00000100:00100000:3.0:1789395122.999087:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231691904 00000100:00100000:3.0:1789395122.999140:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23394 00000100:00100000:3.0:1789395122.999149:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:17655:x1876316231691904:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395122.999172:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395122.999191:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316a1d3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c76 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.999252:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316a1da lrc: 3/1,0 mode: --/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.999264:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316a1da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.999276:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316a1da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395122.999361:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x9c:0x0]: returning size 4096 00000004:00200000:3.0:1789395122.999366:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1789395122.999416:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316a1da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.999442:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316a1d3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c76 expref: 10 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.999462:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316a1da lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c76 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395122.999477:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:3.0:1789395122.999480:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395122.999484:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a400, rc 0) 00000100:00100000:3.0:1789395122.999538:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17655:x1876316231691904:12345-192.168.203.54@tcp:101:ls.0 Request processed in 390us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395122.999545:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23394 00000100:00100000:1.0:1789395123.007560:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.007695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231692032 00000100:00100000:3.0:1789395123.007705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231692032 00000100:00100000:3.0:1789395123.007766:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23395 00000100:00100000:3.0:1789395123.007775:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:17655:x1876316231692032:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.007793:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.007813:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a1e1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.007877:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.007890:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.007900:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.007938:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x51:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.007943:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.007973:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a1e1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.007995:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.008004:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x51:0x0].0x0 (ffff89a3ca35f900) 00010000:00010000:3.0:1789395123.008007:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.008010:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23aa00, rc 0) 00000100:00100000:3.0:1789395123.008075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17655:x1876316231692032:12345-192.168.203.54@tcp:101:ls.0 Request processed in 301us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.008081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23395 00000100:00080000:1.0:1789395123.008133:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395123.016042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.016107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231692160 00000100:00100000:0.0:1789395123.016116:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231692160 00000100:00100000:0.0:1789395123.016192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23396 00000100:00100000:0.0:1789395123.016203:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17655:x1876316231692160:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.016222:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.016245:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a1ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.016303:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.016315:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.016326:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.016412:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.016417:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395123.016456:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a1ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.016471:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.016480:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:0.0:1789395123.016482:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.016486:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:0.0:1789395123.016547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231692160:12345-192.168.203.54@tcp:101:ls.0 Request processed in 346us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.016555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23396 00000100:00080000:2.0:1789395123.016794:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395123.042921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.053728:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231692288 00000100:00100000:3.0:1789395123.053742:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231692288 00000100:00100000:3.0:1789395123.053803:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5015 00000100:00100000:3.0:1789395123.053813:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17655:x1876316231692288:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:3.0:1789395123.075220:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17655:x1876316231692288:12345-192.168.203.54@tcp:37:ls.0 Request processed in 21400us (32300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.075234:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5015 00000100:00100000:3.0:1789395123.086070:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.086175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231692416 00000100:00100000:0.0:1789395123.086186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231692416 00000100:00100000:0.0:1789395123.086240:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5016 00000100:00100000:0.0:1789395123.086251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231692416:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395123.095965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231692416:12345-192.168.203.54@tcp:37:ls.0 Request processed in 9707us (9896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.095977:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5016 00000100:00100000:3.0:1789395123.102724:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.102858:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231692672 00000100:00100000:0.0:1789395123.102871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231692672 00000100:00100000:0.0:1789395123.102964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5017 00000100:00100000:0.0:1789395123.102975:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:17655:x1876316231692672:12345-192.168.203.54@tcp:35:ls.0 00000040:00080000:0.0:1789395123.103286:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].384, 344 off576976 00000040:00080000:0.0:1789395123.103327:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].384, 424 off630584 00000004:00080000:0.0:1789395123.103332:0:6515:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca181000 with version 730 00000004:00080000:1.0:1789395123.103451:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 730 rpc_version 730 00000020:00100000:1.0:1789395123.103563:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395123.103576:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d4380 x1876316239636096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395123.103602:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239636096:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395123.103667:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395123.103752:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.107530:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239636096 00000100:00100000:2.0:1789395123.107546:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239636096 00000100:00100000:2.0:1789395123.107607:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:2.0:1789395123.107618:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7455:x1876316239636096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395123.107856:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:7455:x1876316239636096:12345-0@lo:1000:osp_up0-1.0 Request processed in 239us (4188us total) trans 4294983458 rc 0/0 00000100:00100000:2.0:1789395123.107863:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:1.0:1789395123.108123:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239636096:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395123.109771:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17655:x1876316231692672:12345-192.168.203.54@tcp:35:ls.0 Request processed in 6790us (7057us total) trans 4294968420 rc 0/0 00000100:00100000:0.0:1789395123.109783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5017 00000100:00100000:3.0:1789395123.120818:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.123038:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231692928 00000100:00100000:0.0:1789395123.123051:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231692928 00000100:00100000:1.0:1789395123.123297:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23397 00000100:00100000:1.0:1789395123.123309:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:17655:x1876316231692928:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:1.0:1789395123.123335:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395123.123363:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a1fd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c8b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395123.123512:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:7813:1876316239636224:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1789395123.123568:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395123.123656:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395123.123875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239636224 00000100:00100000:0.0:1789395123.123880:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239636224 00000100:00100000:0.0:1789395123.123949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789395123.123957:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7813:x1876316239636224:12345-0@lo:900:mdt00_003.0 00000100:00100000:0.0:1789395123.124014:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7813:x1876316239636224:12345-0@lo:900:mdt00_003.0 Request processed in 58us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.124021:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789395123.124099:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:7813:1876316239636224:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1789395123.124161:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239636352:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395123.124198:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395123.124224:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.124275:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239636352 00000100:00100000:2.0:1789395123.124280:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239636352 00000100:00100000:2.0:1789395123.124320:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:2.0:1789395123.124328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:7813:x1876316239636352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789395123.124421:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:7813:x1876316239636352:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.124428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:2.0:1789395123.124456:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239636352:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789395123.124515:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.124524:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.124534:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395123.124546:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239636480:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1789395123.124570:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.124587:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca0c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.124719:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239636480 00000100:00100000:1.0:1789395123.124724:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239636480 00000100:00100000:1.0:1789395123.124755:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:1.0:1789395123.124763:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:7813:x1876316239636480:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395123.124771:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395123.124784:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a20b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a204 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.124807:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a20b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a204 expref: 24 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.124821:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417600/0xff35729af316a20b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a204 expref: 24 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.124829:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395123.124832:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395123.124836:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417600, rc 0) 00000100:00100000:1.0:1789395123.124864:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:7813:x1876316239636480:12345-0@lo:101:mdt00_003.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.124869:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:2.0:1789395123.124986:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239636480:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789395123.125000:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a20b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125010:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a20b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395123.125038:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789395123.125045:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a20b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125053:0:7813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df800/0xff35729af316a204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a20b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125076:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125086:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125094:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125107:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125115:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125122:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125222:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316a220 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125231:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316a220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125243:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316a220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125255:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125261:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125267:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125273:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125280:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.125284:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125292:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125302:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:2.0:1789395123.125305:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.125308:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125315:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316a212 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125328:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125334:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125338:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125342:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.125345:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125350:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125368:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xa04846ca (ffff89a3ca2fb100) 00010000:00010000:2.0:1789395123.125370:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.125373:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125378:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316a219 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125446:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a1fd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c8b expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125459:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316a220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c8b expref: 12 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.125466:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:2.0:1789395123.125468:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.125471:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395123.125616:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:17655:x1876316231692928:12345-192.168.203.54@tcp:101:ls.0 Request processed in 2309us (4806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.125623:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23397 00000100:00100000:1.0:1789395123.135885:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.135971:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231693184 00000100:00100000:3.0:1789395123.135981:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231693184 00000100:00100000:3.0:1789395123.136048:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23398 00000100:00100000:3.0:1789395123.136059:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231693184:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.136080:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.136104:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a227 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c92 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.136268:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x142e:0x0]: returning size 4096 00010000:00010000:3.0:1789395123.136590:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a227 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c92 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.136605:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:3.0:1789395123.136608:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395123.136614:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a227 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c92 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.136630:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a600, rc 0) 00000100:00100000:3.0:1789395123.136734:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17655:x1876316231693184:12345-192.168.203.54@tcp:101:ls.0 Request processed in 677us (857us total) trans 4294983459 rc 301/301 00000100:00100000:3.0:1789395123.136742:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23398 00000100:00100000:1.0:1789395123.165922:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.166009:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231693312 00000100:00100000:3.0:1789395123.166019:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231693312 00000100:00100000:3.0:1789395123.166092:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23399 00000100:00100000:3.0:1789395123.166112:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17655:x1876316231693312:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.166138:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.166179:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a235 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105c99 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.166251:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a23c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.166267:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.166278:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.166377:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x142e:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.166424:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1789395123.166446:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.166470:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a235 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c99 expref: 19 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.166493:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a23c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c99 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.166512:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395123.166515:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.166519:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ba00, rc 0) 00000100:00100000:3.0:1789395123.166577:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17655:x1876316231693312:12345-192.168.203.54@tcp:101:ls.0 Request processed in 476us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.166585:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23399 00000100:00100000:2.0:1789395123.172695:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.172795:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231693440 00000100:00100000:0.0:1789395123.172805:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231693440 00000100:00100000:0.0:1789395123.172869:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23400 00000100:00100000:0.0:1789395123.172880:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17655:x1876316231693440:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.172902:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.172927:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a243 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ca0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.172989:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.173004:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.173015:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.173073:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x55:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.173078:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395123.173113:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a243 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.173141:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 19 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.173158:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x55:0x0].0x0 (ffff89a4fbb8ec00) 00010000:00010000:0.0:1789395123.173172:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.173176:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014c00, rc 0) 00000100:00100000:0.0:1789395123.173239:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231693440:12345-192.168.203.54@tcp:101:ls.0 Request processed in 360us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.173246:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23400 00000100:00100000:1.0:1789395123.176602:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.176717:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231693568 00000100:00100000:3.0:1789395123.176727:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231693568 00000100:00100000:3.0:1789395123.176790:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23401 00000100:00100000:3.0:1789395123.176800:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:17655:x1876316231693568:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.176820:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.176844:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a251 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ca7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.176910:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.176923:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.176933:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.176975:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x55:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.176981:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.177018:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a251 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.177048:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.177057:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x55:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:3.0:1789395123.177060:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.177064:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b600, rc 0) 00000100:00100000:3.0:1789395123.177129:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17655:x1876316231693568:12345-192.168.203.54@tcp:101:ls.0 Request processed in 330us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.177151:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23401 00000100:00100000:1.0:1789395123.200326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.203791:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231693696 00000100:00100000:0.0:1789395123.203807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231693696 00000100:00100000:0.0:1789395123.203890:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5018 00000100:00100000:0.0:1789395123.203900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231693696:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395123.212000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231693696:12345-192.168.203.54@tcp:37:ls.0 Request processed in 8092us (11681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.212014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5018 00000100:00100000:1.0:1789395123.224505:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.224744:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231693824 00000100:00100000:0.0:1789395123.224755:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231693824 00000100:00100000:0.0:1789395123.224814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5019 00000100:00100000:0.0:1789395123.224825:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3ca0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17655:x1876316231693824:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.234856:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3ca0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17655:x1876316231693824:12345-192.168.203.54@tcp:37:ls.0 Request processed in 10022us (10359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.234870:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5019 00000100:00100000:3.0:1789395123.243858:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.243967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231694080 00000100:00100000:0.0:1789395123.243977:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231694080 00000100:00100000:0.0:1789395123.244045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5020 00000100:00100000:0.0:1789395123.244055:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231694080:12345-192.168.203.54@tcp:35:ls.0 00000100:00100000:0.0:1789395123.244307:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17655:x1876316231694080:12345-192.168.203.54@tcp:35:ls.0 Request processed in 253us (459us total) trans 4294983460 rc 0/0 00000100:00100000:0.0:1789395123.244315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5020 00000100:00100000:3.0:1789395123.252698:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.253681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231694336 00000100:00100000:2.0:1789395123.253693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231694336 00000100:00100000:2.0:1789395123.253761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23402 00000100:00100000:2.0:1789395123.253773:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:17655:x1876316231694336:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.253793:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.253813:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316a25f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253885:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253899:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253909:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253924:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253931:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253942:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.253995:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316a274 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254004:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316a274 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254011:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316a274 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254038:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254046:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254052:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254059:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254064:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.254069:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254077:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254089:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:2.0:1789395123.254093:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.254098:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254116:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a266 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254133:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254139:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254154:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254160:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.254170:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254176:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254185:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x55d495e6 (ffff89a3ca2fb100) 00010000:00010000:2.0:1789395123.254188:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.254190:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254196:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316a26d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316a25f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cae expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254251:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316a274 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cae expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.254259:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a3ca2fbc00) 00010000:00010000:2.0:1789395123.254261:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.254263:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395123.254333:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17655:x1876316231694336:12345-192.168.203.54@tcp:101:ls.0 Request processed in 562us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.254341:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23402 00000100:00100000:1.0:1789395123.260667:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.260745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231694592 00000100:00100000:3.0:1789395123.260756:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231694592 00000100:00100000:3.0:1789395123.260817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23403 00000100:00100000:3.0:1789395123.260827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17655:x1876316231694592:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.260858:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.260880:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a27b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cb5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.261054:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x146e:0x0]: returning size 4096 00010000:00010000:3.0:1789395123.261169:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a27b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cb5 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.261184:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:3.0:1789395123.261187:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395123.261193:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a27b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cb5 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.261209:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a600, rc 0) 00000100:00100000:3.0:1789395123.261272:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17655:x1876316231694592:12345-192.168.203.54@tcp:101:ls.0 Request processed in 446us (614us total) trans 4294983461 rc 301/301 00000100:00100000:3.0:1789395123.261280:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23403 00000100:00100000:3.0:1789395123.270006:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.270094:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231694720 00000100:00100000:1.0:1789395123.270102:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231694720 00000100:00100000:2.0:1789395123.270258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23404 00000100:00100000:2.0:1789395123.270271:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17655:x1876316231694720:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.270294:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.270324:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a289 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cbc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.270431:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316a290 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.270444:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316a290 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.270455:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316a290 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.270551:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x146e:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.270556:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1789395123.270581:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316a290 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.270608:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a289 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cbc expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.270631:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316a290 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cbc expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.270639:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a3ca2fbe00) 00010000:00010000:2.0:1789395123.270641:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395123.270644:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395123.270697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17655:x1876316231694720:12345-192.168.203.54@tcp:101:ls.0 Request processed in 430us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.270702:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23404 00000100:00100000:1.0:1789395123.274960:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.275065:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231694848 00000100:00100000:0.0:1789395123.275076:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231694848 00000100:00100000:0.0:1789395123.275138:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23405 00000100:00100000:0.0:1789395123.275149:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17655:x1876316231694848:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.275169:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.275193:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a297 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cc3 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.275256:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.275269:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.275281:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.275330:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x75:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.275335:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395123.275370:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a297 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 24 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.275435:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 23 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.275444:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x75:0x0].0x0 (ffff89a4fbb8e600) 00010000:00010000:0.0:1789395123.275447:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.275450:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015400, rc 0) 00000100:00100000:0.0:1789395123.275507:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231694848:12345-192.168.203.54@tcp:101:ls.0 Request processed in 360us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.275514:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23405 00000100:00100000:3.0:1789395123.282263:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.282346:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231694976 00000100:00100000:0.0:1789395123.282356:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231694976 00000100:00100000:0.0:1789395123.282448:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23406 00000100:00100000:0.0:1789395123.282459:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:17655:x1876316231694976:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.282479:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.282502:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af316a2a5 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.282569:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 3/1,0 mode: --/PR res: [0x240000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.282584:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.282595:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.282649:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x75:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.282654:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395123.282690:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af316a2a5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x75:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.282707:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.282716:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x75:0x0].0x0 (ffff89a4fbb8e300) 00010000:00010000:0.0:1789395123.282719:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.282722:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015200, rc 0) 00000100:00100000:0.0:1789395123.282770:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17655:x1876316231694976:12345-192.168.203.54@tcp:101:ls.0 Request processed in 313us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.282777:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23406 00000100:00100000:1.0:1789395123.303623:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.303712:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231695104 00000100:00100000:2.0:1789395123.303721:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231695104 00000100:00100000:2.0:1789395123.303772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5021 00000100:00100000:2.0:1789395123.303782:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231695104:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.324771:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231695104:12345-192.168.203.54@tcp:37:ls.0 Request processed in 20978us (21144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.324785:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5021 00000100:00100000:1.0:1789395123.347610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.347765:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231695232 00000100:00100000:3.0:1789395123.347774:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231695232 00000100:00100000:3.0:1789395123.347833:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5022 00000100:00100000:3.0:1789395123.347843:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17655:x1876316231695232:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:3.0:1789395123.357451:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17655:x1876316231695232:12345-192.168.203.54@tcp:37:ls.0 Request processed in 9599us (9840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.357468:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5022 00000100:00100000:1.0:1789395123.367935:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.368033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231695488 00000100:00100000:3.0:1789395123.368044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231695488 00000100:00100000:3.0:1789395123.368098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5023 00000100:00100000:3.0:1789395123.368116:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231695488:12345-192.168.203.54@tcp:35:ls.0 00000100:00100000:3.0:1789395123.368416:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:17655:x1876316231695488:12345-192.168.203.54@tcp:35:ls.0 Request processed in 300us (490us total) trans 4294983462 rc 0/0 00000100:00100000:3.0:1789395123.368424:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5023 00000100:00100000:1.0:1789395123.392623:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.392719:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231695744 00000100:00100000:3.0:1789395123.392729:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231695744 00000100:00100000:3.0:1789395123.392801:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23407 00000100:00100000:3.0:1789395123.392813:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:17655:x1876316231695744:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.392837:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.392859:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a2b3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cd1 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.392933:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.392948:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.392959:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.392977:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.392990:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.392997:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.393142:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00010000:00010000:3.0:1789395123.393212:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393220:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393226:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393234:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393240:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395123.393245:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393253:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393267:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395123.393271:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395123.393276:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393288:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316a2ba lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393302:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393308:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393313:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393318:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395123.393321:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393328:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393335:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf404c279 (ffff89a3ca35f100) 00010000:00010000:3.0:1789395123.393337:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395123.393340:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.393346:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a2c1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.395193:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a2b3 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cd1 expref: 26 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.395221:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395123.395224:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395123.395229:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a2b3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cd1 expref: 26 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.395244:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a600, rc 0) 00000100:00100000:2.0:1789395123.397883:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:17655:x1876316231695744:12345-192.168.203.54@tcp:101:ls.0 Request processed in 5062us (5260us total) trans 4294983463 rc 301/301 00000100:00100000:2.0:1789395123.397896:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23407 00000100:00100000:0.0:1789395123.423291:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.425174:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231695872 00000100:00100000:3.0:1789395123.425190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231695872 00000100:00100000:3.0:1789395123.425254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23408 00000100:00100000:3.0:1789395123.425265:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:17655:x1876316231695872:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.425287:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.425324:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a2cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.425789:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a2d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.425805:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.425817:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.425894:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.425899:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1789395123.425919:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.425943:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316a2cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cd8 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.425961:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cd8 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.425969:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff89a3ca35fd00) 00010000:00010000:2.0:1789395123.425971:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395123.425975:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395123.426100:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17655:x1876316231695872:12345-192.168.203.54@tcp:101:ls.0 Request processed in 836us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.426108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23408 00000100:00100000:1.0:1789395123.439119:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.439209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231696000 00000100:00100000:2.0:1789395123.439220:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231696000 00000100:00100000:2.0:1789395123.439290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23409 00000100:00100000:2.0:1789395123.439301:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17655:x1876316231696000:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.439513:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.439538:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a2dd lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cdf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.439715:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.439728:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.439739:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.439785:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xa7:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.439791:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1789395123.439828:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a2dd lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.439847:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.439855:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa7:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:2.0:1789395123.439859:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395123.439862:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395123.439988:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17655:x1876316231696000:12345-192.168.203.54@tcp:101:ls.0 Request processed in 687us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.439995:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23409 00000100:00100000:1.0:1789395123.459205:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.459363:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231696128 00000100:00100000:2.0:1789395123.459374:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231696128 00000100:00100000:2.0:1789395123.459466:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23410 00000100:00100000:2.0:1789395123.459476:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:17655:x1876316231696128:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.459499:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.459522:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a2eb lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ce6 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.459646:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.459662:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.459672:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.459719:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xa7:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.459724:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1789395123.459759:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316a2eb lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 17 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.459778:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 16 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.459787:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff89a3ca2fba00) 00010000:00010000:2.0:1789395123.459789:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395123.459792:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:2.0:1789395123.459848:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231696128:12345-192.168.203.54@tcp:101:ls.0 Request processed in 374us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.459855:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23410 00000100:00100000:2.0:1789395123.473717:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.478479:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231696256 00000100:00100000:3.0:1789395123.478495:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231696256 00000100:00100000:3.0:1789395123.478699:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5024 00000100:00100000:3.0:1789395123.478710:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3ca2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17655:x1876316231696256:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:3.0:1789395123.489097:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3ca2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17655:x1876316231696256:12345-192.168.203.54@tcp:37:ls.0 Request processed in 10379us (15378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.489110:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5024 00000100:00100000:1.0:1789395123.493690:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.493782:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231696384 00000100:00100000:0.0:1789395123.493792:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231696384 00000100:00100000:0.0:1789395123.493915:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5025 00000100:00100000:0.0:1789395123.493926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231696384:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395123.498074:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231696384:12345-192.168.203.54@tcp:37:ls.0 Request processed in 4140us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.498088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5025 00000100:00100000:1.0:1789395123.503062:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.503148:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231696640 00000100:00100000:3.0:1789395123.503158:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231696640 00000100:00100000:3.0:1789395123.503262:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5026 00000100:00100000:3.0:1789395123.503274:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17655:x1876316231696640:12345-192.168.203.54@tcp:35:ls.0 00000100:00100000:3.0:1789395123.503552:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17655:x1876316231696640:12345-192.168.203.54@tcp:35:ls.0 Request processed in 279us (497us total) trans 4294983464 rc 0/0 00000100:00100000:3.0:1789395123.503560:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5026 00000100:00100000:1.0:1789395123.507898:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.508062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231696896 00000100:00100000:2.0:1789395123.508071:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231696896 00000100:00100000:2.0:1789395123.508132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23411 00000100:00100000:2.0:1789395123.508143:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17655:x1876316231696896:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.508164:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.508184:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316a2f9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ced expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508253:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508266:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508276:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508289:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508295:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508301:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508359:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a30e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508368:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a30e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508375:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a30e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508631:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508640:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508646:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508652:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508658:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.508662:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508670:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508681:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395123.508685:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.508689:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508695:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316a300 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508709:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508716:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508721:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508727:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.508729:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508734:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508740:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xef411af6 (ffff89a3ca2fb600) 00010000:00010000:2.0:1789395123.508743:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.508745:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508751:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316a307 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508784:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316a2f9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ced expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508797:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a30e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ced expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.508803:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:2.0:1789395123.508805:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.508808:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd600, rc 0) 00000100:00100000:2.0:1789395123.510139:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:17655:x1876316231696896:12345-192.168.203.54@tcp:101:ls.0 Request processed in 1992us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.510152:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23411 00000100:00100000:0.0:1789395123.519682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.519977:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231697152 00000100:00100000:2.0:1789395123.519989:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231697152 00000100:00100000:2.0:1789395123.520092:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23412 00000100:00100000:2.0:1789395123.520103:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:17655:x1876316231697152:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.520124:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.520148:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316a315 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cf4 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.520302:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x166:0x0]: returning size 4096 00010000:00010000:2.0:1789395123.520426:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316a315 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cf4 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.520441:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:2.0:1789395123.520444:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.520450:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316a315 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cf4 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.520469:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cde00, rc 0) 00000100:00100000:2.0:1789395123.520596:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17655:x1876316231697152:12345-192.168.203.54@tcp:101:ls.0 Request processed in 494us (920us total) trans 4294968421 rc 301/301 00000100:00100000:2.0:1789395123.520603:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23412 00000100:00100000:1.0:1789395123.526915:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.527037:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231697280 00000100:00100000:0.0:1789395123.527047:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231697280 00000100:00100000:0.0:1789395123.527110:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23413 00000100:00100000:0.0:1789395123.527120:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:17655:x1876316231697280:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.527142:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.527163:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a323 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105cfb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.527225:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316a32a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.527239:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316a32a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.527250:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316a32a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.527344:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x166:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.527348:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1789395123.527366:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316a32a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.527647:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a323 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cfb expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.527670:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316a32a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cfb expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.527678:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a4fbb8ea00) 00010000:00010000:0.0:1789395123.527681:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.527684:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:0.0:1789395123.527831:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17655:x1876316231697280:12345-192.168.203.54@tcp:101:ls.0 Request processed in 712us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.527841:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23413 00000100:00100000:3.0:1789395123.532073:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.532167:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231697408 00000100:00100000:2.0:1789395123.532177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231697408 00000100:00100000:2.0:1789395123.532278:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23414 00000100:00100000:2.0:1789395123.532289:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:17655:x1876316231697408:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.532312:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.532334:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316a331 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d02 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.532429:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.532443:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.532454:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.532494:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xb6:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.532509:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1789395123.532549:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316a331 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.532567:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.532575:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb6:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:2.0:1789395123.532578:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395123.532582:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc200, rc 0) 00000100:00100000:2.0:1789395123.532643:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231697408:12345-192.168.203.54@tcp:101:ls.0 Request processed in 356us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.532651:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23414 00000100:00100000:2.0:1789395123.536351:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.536584:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231697536 00000100:00100000:0.0:1789395123.536594:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231697536 00000100:00100000:0.0:1789395123.536685:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23415 00000100:00100000:0.0:1789395123.536695:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:17655:x1876316231697536:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.536713:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.536736:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a33f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d09 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.536793:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.536817:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.536829:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.536876:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb6:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.536881:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395123.536915:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a33f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.536931:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 30 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.536939:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb6:0x0].0x0 (ffff89a4fbb8e500) 00010000:00010000:0.0:1789395123.536941:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.536945:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015c00, rc 0) 00000100:00100000:0.0:1789395123.537005:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231697536:12345-192.168.203.54@tcp:101:ls.0 Request processed in 311us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.537012:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23415 00000100:00100000:3.0:1789395123.552253:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.553342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231697664 00000100:00100000:0.0:1789395123.553353:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231697664 00000100:00100000:1.0:1789395123.553606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5027 00000100:00100000:1.0:1789395123.553620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231697664:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.559476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231697664:12345-192.168.203.54@tcp:37:ls.0 Request processed in 5848us (7221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.559500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5027 00000100:00100000:1.0:1789395123.566322:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.566610:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231697792 00000100:00100000:3.0:1789395123.566621:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231697792 00000100:00100000:3.0:1789395123.566722:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5028 00000100:00100000:3.0:1789395123.566733:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231697792:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395123.570941:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231697792:12345-192.168.203.54@tcp:37:ls.0 Request processed in 4191us (4608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.570959:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5028 00000100:00100000:1.0:1789395123.581007:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.581333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698048 00000100:00100000:2.0:1789395123.581344:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698048 00000100:00100000:2.0:1789395123.581619:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5029 00000100:00100000:2.0:1789395123.581630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:17655:x1876316231698048:12345-192.168.203.54@tcp:35:ls.0 00000100:00100000:2.0:1789395123.581895:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17655:x1876316231698048:12345-192.168.203.54@tcp:35:ls.0 Request processed in 267us (895us total) trans 4294968422 rc 0/0 00000100:00100000:2.0:1789395123.581903:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5029 00000100:00100000:1.0:1789395123.588794:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.589009:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698304 00000100:00100000:0.0:1789395123.589019:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698304 00000100:00100000:0.0:1789395123.589129:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23416 00000100:00100000:0.0:1789395123.589141:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:17655:x1876316231698304:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.589168:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.589189:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a34d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d10 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589264:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589280:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589292:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589309:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589317:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589324:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.589483:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x25:0x0]: returning size 4096 00010000:00010000:0.0:1789395123.589753:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589761:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589767:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589774:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589780:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395123.589784:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589792:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589803:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:0.0:1789395123.589806:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395123.589811:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589818:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316a354 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589831:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589839:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589863:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589868:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395123.589871:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589876:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589883:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5fcc6f89 (ffff89a4fbb8e800) 00010000:00010000:0.0:1789395123.589886:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395123.589889:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589894:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014400/0xff35729af316a35b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589934:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a34d lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d10 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589945:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:0.0:1789395123.589947:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395123.589951:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a34d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d10 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.589959:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014200, rc 0) 00000100:00100000:0.0:1789395123.590036:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17655:x1876316231698304:12345-192.168.203.54@tcp:101:ls.0 Request processed in 898us (1251us total) trans 4294968423 rc 301/301 00000100:00100000:0.0:1789395123.590045:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23416 00000100:00100000:1.0:1789395123.595474:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.595819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698432 00000100:00100000:2.0:1789395123.595828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698432 00000100:00100000:2.0:1789395123.596058:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23417 00000100:00100000:2.0:1789395123.596070:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:17655:x1876316231698432:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.596094:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.596117:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316a369 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d17 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.596218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316a370 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.596232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316a370 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.596242:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316a370 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.596313:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x25:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.596318:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1789395123.596338:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316a370 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.596363:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316a369 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d17 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.596379:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316a370 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d17 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.596427:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:2.0:1789395123.596429:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395123.596433:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cce00, rc 0) 00000100:00100000:2.0:1789395123.596497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17655:x1876316231698432:12345-192.168.203.54@tcp:101:ls.0 Request processed in 429us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.596504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23417 00000100:00100000:1.0:1789395123.603074:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.603161:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698560 00000100:00100000:3.0:1789395123.603172:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698560 00000100:00100000:3.0:1789395123.603233:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23418 00000100:00100000:3.0:1789395123.603244:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:17655:x1876316231698560:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.603266:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.603289:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316a377 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d1e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.603345:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.603359:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.603371:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.603682:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x16:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.603688:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.603925:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316a377 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 24 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.603944:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 23 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.603954:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x16:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:3.0:1789395123.603957:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.603960:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ae00, rc 0) 00000100:00100000:3.0:1789395123.604075:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231698560:12345-192.168.203.54@tcp:101:ls.0 Request processed in 833us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.604084:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23418 00000100:00100000:1.0:1789395123.610630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.610792:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698688 00000100:00100000:0.0:1789395123.610802:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698688 00000100:00100000:0.0:1789395123.610864:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23419 00000100:00100000:0.0:1789395123.610875:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231698688:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.610894:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.610916:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a385 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d25 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.610975:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.610991:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.611002:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.611059:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x16:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.611064:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1789395123.611097:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a385 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.611116:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.611124:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:0.0:1789395123.611128:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.611131:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014400, rc 0) 00000100:00100000:0.0:1789395123.611318:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:17655:x1876316231698688:12345-192.168.203.54@tcp:101:ls.0 Request processed in 444us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.611325:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23419 00000100:00100000:1.0:1789395123.618204:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.618279:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698816 00000100:00100000:0.0:1789395123.618289:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698816 00000100:00100000:0.0:1789395123.618342:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5030 00000100:00100000:0.0:1789395123.618351:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231698816:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395123.624005:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231698816:12345-192.168.203.54@tcp:37:ls.0 Request processed in 5646us (5801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.624019:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5030 00000100:00100000:2.0:1789395123.628836:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.628917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231698944 00000100:00100000:1.0:1789395123.628927:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231698944 00000100:00100000:1.0:1789395123.629033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5031 00000100:00100000:1.0:1789395123.629043:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:17655:x1876316231698944:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.633845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:17655:x1876316231698944:12345-192.168.203.54@tcp:37:ls.0 Request processed in 4793us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.633859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5031 00000100:00100000:3.0:1789395123.637791:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.638079:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231699200 00000100:00100000:0.0:1789395123.638090:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231699200 00000100:00100000:0.0:1789395123.638176:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5032 00000100:00100000:0.0:1789395123.638187:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:17655:x1876316231699200:12345-192.168.203.54@tcp:35:ls.0 00000040:00080000:0.0:1789395123.638832:0:14460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].385, 344 off577320 00000040:00080000:0.0:1789395123.638892:0:14460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].385, 424 off631008 00000004:00080000:0.0:1789395123.638899:0:14460:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca181a80 with version 731 00000004:00080000:1.0:1789395123.638956:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 731 rpc_version 731 00000020:00100000:1.0:1789395123.638985:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395123.638994:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c904f100 x1876316239636736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395123.639017:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239636736:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395123.639074:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.639124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239636736 00000100:00100000:2.0:1789395123.639129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239636736 00000100:00100000:1.0:1789395123.639134:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.639159:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:2.0:1789395123.639167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239636736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395123.639421:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239636736:12345-0@lo:1000:osp_up0-1.0 Request processed in 254us (345us total) trans 4294983465 rc 0/0 00000100:00100000:2.0:1789395123.639429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1789395123.639570:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239636736:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395123.639782:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:17655:x1876316231699200:12345-192.168.203.54@tcp:35:ls.0 Request processed in 1595us (1997us total) trans 4294968424 rc 0/0 00000100:00100000:0.0:1789395123.639790:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5032 00000100:00100000:1.0:1789395123.647307:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.647563:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231699456 00000100:00100000:2.0:1789395123.647574:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231699456 00000100:00100000:2.0:1789395123.647643:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23420 00000100:00100000:2.0:1789395123.647654:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:17655:x1876316231699456:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.647679:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.647799:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc000/0xff35729af316a393 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d2c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647873:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647887:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647898:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647913:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647921:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647928:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647982:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a3a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647990:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.647998:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648016:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648036:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648044:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648051:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648057:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cdc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.648062:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648070:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648081:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:2.0:1789395123.648085:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.648090:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648096:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a39a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648112:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648119:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648125:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648131:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.648134:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648141:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648148:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x3873ad72 (ffff89a3ca2fb400) 00010000:00010000:2.0:1789395123.648151:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.648155:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648161:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316a3a1 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648194:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc000/0xff35729af316a393 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d2c expref: 26 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648209:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d2c expref: 25 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.648217:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a3ca2fb700) 00010000:00010000:2.0:1789395123.648220:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.648222:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cca00, rc 0) 00000100:00100000:2.0:1789395123.648289:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:17655:x1876316231699456:12345-192.168.203.54@tcp:101:ls.0 Request processed in 637us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.648301:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23420 00000100:00100000:1.0:1789395123.652977:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.653062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231699712 00000100:00100000:2.0:1789395123.653070:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231699712 00000100:00100000:2.0:1789395123.653118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23421 00000100:00100000:2.0:1789395123.653126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:17655:x1876316231699712:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.653142:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.653161:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a3af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.653283:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1502:0x0]: returning size 4096 00010000:00010000:2.0:1789395123.653348:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a3af lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d33 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.653358:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:2.0:1789395123.653361:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.653364:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a3af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d33 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.653377:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc800, rc 0) 00000100:00100000:2.0:1789395123.653479:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:17655:x1876316231699712:12345-192.168.203.54@tcp:101:ls.0 Request processed in 352us (509us total) trans 4294983466 rc 301/301 00000100:00100000:2.0:1789395123.653487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23421 00000100:00100000:3.0:1789395123.662016:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.662081:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231699840 00000100:00100000:0.0:1789395123.662091:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231699840 00000100:00100000:0.0:1789395123.662156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23422 00000100:00100000:0.0:1789395123.662166:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:17655:x1876316231699840:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.662195:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.662218:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a3bd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d3a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.662285:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316a3c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.662300:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316a3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.662312:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316a3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395123.662776:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1502:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.662781:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1789395123.662801:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316a3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.662824:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a3bd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d3a expref: 34 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.662859:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316a3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d3a expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.662868:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:0.0:1789395123.662871:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395123.662874:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015000, rc 0) 00000100:00100000:0.0:1789395123.662926:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:17655:x1876316231699840:12345-192.168.203.54@tcp:101:ls.0 Request processed in 762us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.662933:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23422 00000100:00100000:1.0:1789395123.671164:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.671241:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231699968 00000100:00100000:3.0:1789395123.671251:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231699968 00000100:00100000:3.0:1789395123.671353:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23423 00000100:00100000:3.0:1789395123.671367:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:17655:x1876316231699968:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.671419:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.671443:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a3cb lrc: 2/0,0 mode: --/CR res: [0x200000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d41 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.671510:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.671523:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.671534:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.671579:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xbf:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.671585:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.671620:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a3cb lrc: 0/0,0 mode: --/CR res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 35 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.671638:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 34 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.671648:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbf:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395123.671651:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.671654:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23be00, rc 0) 00000100:00100000:3.0:1789395123.671725:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:17655:x1876316231699968:12345-192.168.203.54@tcp:101:ls.0 Request processed in 362us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.671732:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23423 00000100:00100000:1.0:1789395123.678793:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.679265:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231700096 00000100:00100000:3.0:1789395123.679275:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231700096 00000100:00100000:3.0:1789395123.679340:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23424 00000100:00100000:3.0:1789395123.679352:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:17655:x1876316231700096:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.679371:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.679436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316a3d9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.679509:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.679523:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.679537:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.679585:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xbf:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.679590:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.679624:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316a3d9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.679643:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.679652:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbf:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:3.0:1789395123.679656:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.679659:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b400, rc 0) 00000100:00100000:3.0:1789395123.679721:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17655:x1876316231700096:12345-192.168.203.54@tcp:101:ls.0 Request processed in 371us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.679728:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23424 00000100:00100000:2.0:1789395123.685966:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.686064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231700224 00000100:00100000:1.0:1789395123.686074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231700224 00000100:00100000:1.0:1789395123.686120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5033 00000100:00100000:1.0:1789395123.686130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:17655:x1876316231700224:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.693589:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:17655:x1876316231700224:12345-192.168.203.54@tcp:37:ls.0 Request processed in 7451us (7621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.693602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5033 00000100:00100000:3.0:1789395123.700732:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.700963:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231700352 00000100:00100000:0.0:1789395123.700973:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231700352 00000100:00100000:0.0:1789395123.701045:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5034 00000100:00100000:0.0:1789395123.701056:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17655:x1876316231700352:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.706210:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17655:x1876316231700352:12345-192.168.203.54@tcp:37:ls.0 Request processed in 5145us (5476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.706224:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5034 00000100:00100000:1.0:1789395123.713681:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.713825:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231700608 00000100:00100000:2.0:1789395123.713833:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231700608 00000100:00100000:2.0:1789395123.713889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5035 00000100:00100000:2.0:1789395123.713900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:17655:x1876316231700608:12345-192.168.203.54@tcp:35:ls.0 00000100:00100000:2.0:1789395123.714091:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+35:17655:x1876316231700608:12345-192.168.203.54@tcp:35:ls.0 Request processed in 193us (417us total) trans 4294983467 rc 0/0 00000100:00100000:2.0:1789395123.714096:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5035 00000100:00100000:0.0:1789395123.722217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.722325:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231700864 00000100:00100000:3.0:1789395123.722335:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231700864 00000100:00100000:3.0:1789395123.722434:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23425 00000100:00100000:3.0:1789395123.722444:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17655:x1876316231700864:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.722464:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.722483:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316a3e7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d4f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722562:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722578:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722589:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722605:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722612:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722618:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722672:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722680:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722687:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722701:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722708:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722714:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722725:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722732:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395123.722737:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722745:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722755:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:3.0:1789395123.722759:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395123.722763:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722770:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a3ee lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722783:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722789:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722795:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722800:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395123.722802:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722812:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722819:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb228bbb0 (ffff89a3ca35f200) 00010000:00010000:3.0:1789395123.722821:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395123.722824:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722830:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316a3f5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722870:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316a3e7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722883:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.722890:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:3.0:1789395123.722893:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395123.722895:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a800, rc 0) 00000100:00100000:3.0:1789395123.722945:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17655:x1876316231700864:12345-192.168.203.54@tcp:101:ls.0 Request processed in 503us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.722952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23425 00000100:00100000:0.0:1789395123.726783:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.727054:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231701120 00000100:00100000:2.0:1789395123.727064:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231701120 00000100:00100000:2.0:1789395123.727125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23426 00000100:00100000:2.0:1789395123.727136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+35:17655:x1876316231701120:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.727158:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.727181:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a403 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d56 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.727345:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13c0:0x0]: returning size 4096 00010000:00010000:2.0:1789395123.727672:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a403 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d56 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.727687:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:2.0:1789395123.727689:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.727694:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a403 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d56 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.727716:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc000, rc 0) 00000100:00100000:2.0:1789395123.727761:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:17655:x1876316231701120:12345-192.168.203.54@tcp:101:ls.0 Request processed in 628us (987us total) trans 4294983468 rc 301/301 00000100:00100000:2.0:1789395123.727767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23426 00000100:00100000:0.0:1789395123.733856:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.733962:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231701248 00000100:00100000:3.0:1789395123.733973:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231701248 00000100:00100000:3.0:1789395123.734036:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23427 00000100:00100000:3.0:1789395123.734045:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:17655:x1876316231701248:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.734069:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.734090:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a411 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d5d expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.734151:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316a418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.734164:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316a418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.734174:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316a418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.734258:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13c0:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.734262:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1789395123.734280:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316a418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.734302:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a411 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d5d expref: 38 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.734337:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316a418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d5d expref: 37 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.734347:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f300) 00010000:00010000:3.0:1789395123.734349:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.734353:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b200, rc 0) 00000100:00100000:3.0:1789395123.734605:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+37:17655:x1876316231701248:12345-192.168.203.54@tcp:101:ls.0 Request processed in 559us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.734613:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23427 00000100:00100000:0.0:1789395123.738919:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.738998:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231701376 00000100:00100000:3.0:1789395123.739007:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231701376 00000100:00100000:3.0:1789395123.739094:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23428 00000100:00100000:3.0:1789395123.739104:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+37:17655:x1876316231701376:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.739121:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.739142:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a41f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d64 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.739195:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.739208:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.739219:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.739261:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.739266:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.739297:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a41f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.739313:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.739321:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:3.0:1789395123.739325:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.739328:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ac00, rc 0) 00000100:00100000:3.0:1789395123.739380:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:17655:x1876316231701376:12345-192.168.203.54@tcp:101:ls.0 Request processed in 278us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.739428:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23428 00000100:00100000:1.0:1789395123.742677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.742764:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231701504 00000100:00100000:3.0:1789395123.742773:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231701504 00000100:00100000:3.0:1789395123.742828:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23429 00000100:00100000:3.0:1789395123.742838:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17655:x1876316231701504:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.742913:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.742937:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a42d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d6b expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.742998:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.743013:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.743036:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.743078:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.743083:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395123.743119:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a42d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 29 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.743136:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 28 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.743146:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1e:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:3.0:1789395123.743149:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.743152:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a600, rc 0) 00000100:00100000:3.0:1789395123.743266:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17655:x1876316231701504:12345-192.168.203.54@tcp:101:ls.0 Request processed in 428us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.743274:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23429 00000100:00100000:0.0:1789395123.752004:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.752080:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231701632 00000100:00100000:2.0:1789395123.752090:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231701632 00000100:00100000:2.0:1789395123.752149:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5036 00000100:00100000:2.0:1789395123.752161:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:17655:x1876316231701632:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:1.0:1789395123.756522:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:17655:x1876316231701632:12345-192.168.203.54@tcp:37:ls.0 Request processed in 4350us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.756536:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5036 00000100:00100000:1.0:1789395123.760746:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.760816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231701760 00000100:00100000:2.0:1789395123.760825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231701760 00000100:00100000:2.0:1789395123.760934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5037 00000100:00100000:2.0:1789395123.760944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17655:x1876316231701760:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.764302:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17655:x1876316231701760:12345-192.168.203.54@tcp:37:ls.0 Request processed in 3350us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.764316:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5037 00000100:00100000:0.0:1789395123.773931:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.774043:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231702016 00000100:00100000:1.0:1789395123.774053:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231702016 00000100:00100000:1.0:1789395123.774102:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5038 00000100:00100000:1.0:1789395123.774113:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:17655:x1876316231702016:12345-192.168.203.54@tcp:35:ls.0 00000040:00080000:1.0:1789395123.774367:0:14460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].386, 344 off586456 00000040:00080000:1.0:1789395123.774462:0:14460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].384, 424 off639312 00000004:00080000:1.0:1789395123.774469:0:14460:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca06a600 with version 731 00000004:00080000:0.0:1789395123.774717:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 731 rpc_version 731 00000020:00100000:0.0:1789395123.774745:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395123.774752:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c8852a00 x1876316239636992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395123.774773:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8852a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239636992:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395123.774820:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.774884:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.774886:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239636992 00000100:00100000:2.0:1789395123.774893:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239636992 00000100:00100000:2.0:1789395123.774931:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:2.0:1789395123.774941:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239636992:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395123.775236:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239636992:12345-0@lo:1000:osp_up1-0.0 Request processed in 297us (413us total) trans 4294968425 rc 0/0 00000100:00100000:2.0:1789395123.775244:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:0.0:1789395123.775298:0:7874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968418 gen 2 00000004:00080000:0.0:1789395123.775303:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968415 committed transno 4294968418 00000020:00080000:0.0:1789395123.775319:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4ff9353c0 refcount 2 committed 0 result 0 batchid 387 00000020:00080000:0.0:1789395123.775324:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ee00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4ff935e40 00000020:00080000:0.0:1789395123.775326:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c83c2e00 00000004:00080000:0.0:1789395123.775356:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968416 committed transno 4294968418 00000020:00080000:0.0:1789395123.775359:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4ff935a80 refcount 2 committed 0 result 0 batchid 388 00000020:00080000:0.0:1789395123.775362:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4ff935300 00000020:00080000:0.0:1789395123.775366:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].383 00000020:00080000:0.0:1789395123.775369:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c1800 00000020:00080000:0.0:1789395123.775372:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].385 00000004:00080000:0.0:1789395123.775380:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968417 committed transno 4294968418 00000020:00080000:1.0:1789395123.775477:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 388 committed batchid 386 00000020:00080000:1.0:1789395123.775695:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00000020:00080000:0.0:1789395123.775783:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4c4f5b780 refcount 2 committed 0 result 0 batchid 389 00000020:00080000:0.0:1789395123.775787:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4c4f5b300 00000020:00080000:0.0:1789395123.775789:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c1e00 00000020:00080000:1.0:1789395123.775818:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 389 committed batchid 386 00000020:00080000:1.0:1789395123.775835:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00000004:00080000:0.0:1789395123.775868:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968418 committed transno 4294968418 00000100:00100000:0.0:1789395123.775882:0:7874:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a3c8852a00 x1876316239636992/t4294968425(4294968425) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 1789395139 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789395123.775909:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8852a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239636992:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395123.776070:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:17655:x1876316231702016:12345-192.168.203.54@tcp:35:ls.0 Request processed in 1957us (2146us total) trans 4294983469 rc 0/0 00000100:00100000:1.0:1789395123.776077:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5038 00000100:00100000:1.0:1789395123.780064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.780163:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231702272 00000100:00100000:0.0:1789395123.780173:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231702272 00000100:00100000:0.0:1789395123.780228:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23430 00000100:00100000:0.0:1789395123.780239:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17655:x1876316231702272:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395123.780260:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.780279:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af316a43b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d72 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780349:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780362:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780372:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780754:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780765:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780772:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780827:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780836:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780843:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780918:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780925:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780931:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780937:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780944:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395123.780948:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780956:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780968:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:0.0:1789395123.780971:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395123.780976:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780982:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316a442 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.780995:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781001:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781006:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781011:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395123.781014:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781029:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781036:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x18cfedbe (ffff89a4fbb8e100) 00010000:00010000:0.0:1789395123.781038:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395123.781041:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781046:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a449 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781090:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014600/0xff35729af316a43b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d72 expref: 30 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781103:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d72 expref: 29 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.781110:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a4fbb8ef00) 00010000:00010000:0.0:1789395123.781113:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395123.781116:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:0.0:1789395123.781221:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:17655:x1876316231702272:12345-192.168.203.54@tcp:101:ls.0 Request processed in 983us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.781230:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23430 00000100:00100000:0.0:1789395123.785061:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.785158:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231702528 00000100:00100000:3.0:1789395123.785167:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231702528 00000100:00100000:3.0:1789395123.785254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23431 00000100:00100000:3.0:1789395123.785264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:17655:x1876316231702528:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.785285:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.785306:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316a457 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d79 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.785827:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13d0:0x0]: returning size 4096 00010000:00010000:2.0:1789395123.786124:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316a457 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d79 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.786146:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a3ca35fb00) 00010000:00010000:2.0:1789395123.786149:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.786153:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316a457 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d79 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.786171:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a000, rc 0) 00000100:00100000:2.0:1789395123.786235:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:17655:x1876316231702528:12345-192.168.203.54@tcp:101:ls.0 Request processed in 973us (1182us total) trans 4294983470 rc 301/301 00000100:00100000:2.0:1789395123.786242:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23431 00000100:00100000:1.0:1789395123.791040:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.791204:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231702656 00000100:00100000:3.0:1789395123.791214:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231702656 00000100:00100000:3.0:1789395123.791273:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23432 00000100:00100000:3.0:1789395123.791283:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:17655:x1876316231702656:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:3.0:1789395123.791305:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.791328:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a465 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d80 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.791710:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a46c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.791725:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a46c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.791736:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a46c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.791824:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13d0:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.791829:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1789395123.791862:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a46c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.791887:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a465 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d80 expref: 42 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.791910:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a46c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d80 expref: 41 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.791919:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:3.0:1789395123.791923:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395123.791926:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23bc00, rc 0) 00000100:00100000:3.0:1789395123.791986:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:17655:x1876316231702656:12345-192.168.203.54@tcp:101:ls.0 Request processed in 704us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.791993:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23432 00000100:00100000:1.0:1789395123.799138:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.799742:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231702784 00000100:00100000:2.0:1789395123.799752:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231702784 00000100:00100000:2.0:1789395123.799814:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23433 00000100:00100000:2.0:1789395123.799824:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:17655:x1876316231702784:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.799845:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.799868:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a473 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d87 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.799926:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.799940:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.799951:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.799995:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x26:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.800001:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1789395123.800050:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a473 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 43 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.800069:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 42 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.800077:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x26:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:2.0:1789395123.800080:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395123.800084:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd000, rc 0) 00000100:00100000:2.0:1789395123.800143:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17655:x1876316231702784:12345-192.168.203.54@tcp:101:ls.0 Request processed in 321us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.800150:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23433 00000100:00100000:0.0:1789395123.804608:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.804742:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231702912 00000100:00100000:2.0:1789395123.804753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231702912 00000100:00100000:2.0:1789395123.804817:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23434 00000100:00100000:2.0:1789395123.804828:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:17655:x1876316231702912:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395123.804858:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.804883:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a481 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.804948:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.804962:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.804974:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.805033:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x26:0x0]: returning size 4096 00000004:00200000:2.0:1789395123.805037:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1789395123.805074:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a481 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.805092:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.805102:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x26:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:2.0:1789395123.805105:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395123.805108:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd200, rc 0) 00000100:00100000:2.0:1789395123.805165:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231702912:12345-192.168.203.54@tcp:101:ls.0 Request processed in 340us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.805172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23434 00000100:00100000:1.0:1789395123.812599:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.812736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231703040 00000100:00100000:2.0:1789395123.812746:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231703040 00000100:00100000:2.0:1789395123.812800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5039 00000100:00100000:2.0:1789395123.812811:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17655:x1876316231703040:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:2.0:1789395123.817113:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17655:x1876316231703040:12345-192.168.203.54@tcp:37:ls.0 Request processed in 4295us (4514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.817127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5039 00000100:00100000:0.0:1789395123.822597:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.822748:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231703168 00000100:00100000:1.0:1789395123.822757:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231703168 00000100:00100000:1.0:1789395123.822815:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5040 00000100:00100000:1.0:1789395123.822825:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231703168:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:0.0:1789395123.828449:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:17655:x1876316231703168:12345-192.168.203.54@tcp:37:ls.0 Request processed in 5562us (5797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.828463:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5040 00000100:00100000:0.0:1789395123.833756:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.833894:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231703424 00000100:00100000:2.0:1789395123.833904:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231703424 00000100:00100000:2.0:1789395123.833958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5041 00000100:00100000:2.0:1789395123.833968:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17655:x1876316231703424:12345-192.168.203.54@tcp:35:ls.0 00000040:00080000:2.0:1789395123.834228:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].387, 344 off586800 00000040:00080000:2.0:1789395123.834268:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].385, 424 off639736 00000004:00080000:2.0:1789395123.834273:0:6514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4c4f4d0c0 with version 732 00000004:00080000:0.0:1789395123.834336:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 732 rpc_version 732 00000020:00100000:0.0:1789395123.834366:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395123.834374:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c8852680 x1876316239637248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395123.834440:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8852680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239637248:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395123.834500:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395123.834688:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239637248 00000100:00100000:1.0:1789395123.834694:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239637248 00000100:00100000:1.0:1789395123.834731:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1789395123.834738:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239637248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395123.834950:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.837407:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239637248:12345-0@lo:1000:osp_up1-0.0 Request processed in 2641us (2879us total) trans 4294968426 rc 0/0 00000100:00100000:1.0:1789395123.837424:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:0.0:1789395123.838888:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8852680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239637248:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395123.839134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17655:x1876316231703424:12345-192.168.203.54@tcp:35:ls.0 Request processed in 5164us (5384us total) trans 4294983471 rc 0/0 00000100:00100000:2.0:1789395123.839143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5041 00000100:00100000:1.0:1789395123.861668:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.861900:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231703680 00000100:00100000:3.0:1789395123.861910:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231703680 00000100:00100000:3.0:1789395123.861973:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23435 00000100:00100000:3.0:1789395123.861988:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231703680:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:3.0:1789395123.862012:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.862046:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a48f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d95 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.862206:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1502:0x0]: returning size 4096 00010000:00010000:3.0:1789395123.862303:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a48f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d95 expref: 45 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.862333:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:3.0:1789395123.862337:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395123.862343:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316a48f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d95 expref: 45 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.862357:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a200, rc 0) 00000100:00100000:3.0:1789395123.862458:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231703680:12345-192.168.203.54@tcp:101:rm.0 Request processed in 471us (797us total) trans 4294983472 rc 301/301 00000100:00100000:3.0:1789395123.862465:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23435 00000100:00100000:1.0:1789395123.864124:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395123.867245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231703808 00000100:00100000:3.0:1789395123.867260:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231703808 00000100:00100000:3.0:1789395123.867340:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3150 00000100:00100000:3.0:1789395123.867351:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231703808:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:3.0:1789395123.867419:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.867440:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a49d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105da3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.867498:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395123.867664:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.868002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231703936 00000100:00100000:0.0:1789395123.868008:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231703936 00000100:00100000:0.0:1789395123.868057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3151 00000100:00100000:0.0:1789395123.868065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2395:x1876316231703936:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:0.0:1789395123.868084:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.868096:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316a4ab lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105d9c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868125:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868136:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868147:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868162:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868169:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868176:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868232:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316a4c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868245:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316a4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.868251:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316a4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868659:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868671:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868685:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868693:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868699:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868736:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316a4ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868745:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316a4ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868752:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316a4ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395123.868809:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x25:0x0]: returning size 4096 00000004:00200000:3.0:1789395123.868814:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1789395123.868855:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316a4ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868868:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868875:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868882:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868889:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395123.868893:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868901:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868914:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:3.0:1789395123.868917:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395123.868921:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868927:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316a4a4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868940:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868946:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868952:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868956:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395123.868959:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868965:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868971:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5fcc6f89 (ffff89a4d3f0b500) 00010000:00010000:3.0:1789395123.868973:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395123.868976:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.868986:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a4c7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.869018:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a000/0xff35729af316a49d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105da3 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.869043:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316a4ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105da3 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.869051:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:3.0:1789395123.869053:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395123.869056:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:3.0:1789395123.869123:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:2395:x1876316231703808:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 1774us (5005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.869131:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3150 00000004:00200000:0.0:1789395123.869256:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00000004:00200000:0.0:1789395123.869260:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1789395123.869292:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316a4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869302:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869307:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869325:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869330:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395123.869333:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869339:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869348:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395123.869351:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395123.869354:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869364:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316a4b2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869374:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869379:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869408:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869414:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395123.869417:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869422:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869429:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf404c279 (ffff89a4fbb8e100) 00010000:00010000:0.0:1789395123.869431:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395123.869433:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869439:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316a4b9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869464:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316a4ab lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d9c expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869476:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316a4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d9c expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.869483:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff89a3ca35fd00) 00010000:00010000:0.0:1789395123.869496:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789395123.869499:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:0.0:1789395123.870609:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:2395:x1876316231703936:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 2540us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.870618:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3151 00000100:00100000:2.0:1789395123.871230:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.872041:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231704192 00000100:00100000:0.0:1789395123.872051:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231704192 00000100:00100000:0.0:1789395123.872101:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5042 00000100:00100000:0.0:1789395123.872110:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231704192:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:0.0:1789395123.872323:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231704192:12345-192.168.203.54@tcp:35:rm.0 Request processed in 202us (1083us total) trans 4294983473 rc 0/0 00000100:00100000:0.0:1789395123.872331:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5042 00000100:00100000:2.0:1789395123.881527:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.881890:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231704320 00000100:00100000:0.0:1789395123.881902:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231704320 00000100:00100000:0.0:1789395123.881969:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1291 00000100:00100000:0.0:1789395123.881979:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:2397:x1876316231704320:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:0.0:1789395123.881995:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395123.882017:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a3a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d2c expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.882047:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a3ca2fb700) 00010000:00010000:0.0:1789395123.882057:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395123.882122:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2397:x1876316231704320:12345-192.168.203.54@tcp:103:rm.0 Request processed in 143us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.882129:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1291 00000100:00100000:1.0:1789395123.889457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.889700:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231704576 00000100:00100000:0.0:1789395123.889710:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231704576 00000100:00100000:0.0:1789395123.889772:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23436 00000100:00100000:0.0:1789395123.889783:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231704576:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395123.889866:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395123.889892:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316a3c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1502:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d3a expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.889911:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a4fbb8ed00) 00010000:00010000:0.0:1789395123.889922:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395123.889974:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.889982:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.889992:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.890014:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239637376:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395123.890072:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.890130:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395123.890444:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239637760:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.890476:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890709:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239637504:0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.890747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890771:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239638016:0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.890798:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890813:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239638528:0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.890835:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890858:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789395123.890864:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239637632:0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.890886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890903:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239638144:0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.890923:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890941:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239638656:0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.890960:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.890987:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239637760 00000100:00100000:2.0:1789395123.890991:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239637760 00000100:00100000:2.0:1789395123.891037:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239637632 00000100:00100000:2.0:1789395123.891040:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239637632 00000100:00100000:2.0:1789395123.891060:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1789395123.891066:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239637760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.891104:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239637760:12345-0@lo:400:kworker.0 Request processed in 39us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.891111:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1789395123.891125:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1789395123.891131:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239637632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395123.891160:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239637632:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.891165:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:2.0:1789395123.891179:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395123.891206:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239637632:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.891277:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239637760:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.891283:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239638272:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.891304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.891332:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789395123.891338:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239637888:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.891360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.891373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239638400:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.892104:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.892144:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638016 00000100:00100000:3.0:1789395123.892149:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638016 00000100:00100000:3.0:1789395123.892183:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638528 00000100:00100000:3.0:1789395123.892186:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638528 00000100:00100000:3.0:1789395123.892201:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638144 00000100:00100000:3.0:1789395123.892203:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638144 00000100:00100000:3.0:1789395123.892218:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638656 00000100:00100000:3.0:1789395123.892220:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638656 00000100:00100000:3.0:1789395123.892236:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789395123.892243:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239638016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.892279:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239638016:12345-0@lo:400:kworker.0 Request processed in 36us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.892284:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789395123.892295:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789395123.892299:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239638528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.892322:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239638528:12345-0@lo:400:kworker.0 Request processed in 23us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.892328:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789395123.892339:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789395123.892344:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239638144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.892367:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239638144:12345-0@lo:400:kworker.0 Request processed in 24us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.892372:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789395123.892382:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789395123.892421:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239638656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.892448:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239638656:12345-0@lo:400:kworker.0 Request processed in 28us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.892457:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00080000:3.0:1789395123.892498:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395123.892501:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395123.892609:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239637504 00000100:00100000:1.0:1789395123.892614:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239637504 00000100:00100000:1.0:1789395123.892645:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789395123.892652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395123.892686:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239637504:12345-0@lo:400:kworker.0 Request processed in 35us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.892692:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789395123.892728:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239637376 00000100:00100000:1.0:1789395123.892732:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239637376 00000100:00100000:1.0:1789395123.892759:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:1.0:1789395123.892766:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6511:x1876316239637376:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395123.892780:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395123.892800:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a4d5 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.892825:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.892834:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.892876:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.892890:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 29 pid: 6511 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395123.892903:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:11908:1876316239638784:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395123.892961:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.892978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638272 00000100:00100000:1.0:1789395123.892982:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638272 00000100:00100000:1.0:1789395123.893009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239637888 00000100:00100000:1.0:1789395123.893012:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239637888 00000100:00100000:1.0:1789395123.893039:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638400 00000100:00100000:1.0:1789395123.893042:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638400 00000100:00100000:1.0:1789395123.893056:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1789395123.893062:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239638272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395123.893097:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239638272:12345-0@lo:400:kworker.0 Request processed in 35us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.893103:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1789395123.893114:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1789395123.893120:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239637888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395123.893144:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239637888:12345-0@lo:400:kworker.0 Request processed in 25us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.893150:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1789395123.893160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1789395123.893166:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239638400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395123.893192:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239638400:12345-0@lo:400:kworker.0 Request processed in 26us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.893200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00080000:1.0:1789395123.893213:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789395123.893216:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395123.895120:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239638144:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895140:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239638656:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895150:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239637504:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895162:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239638016:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895173:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239638528:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895237:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239637888:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895250:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239638400:0@lo:400:kworker.0 00000100:00100000:3.0:1789395123.895261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239638272:0@lo:400:kworker.0 00000100:00100000:1.0:1789395123.898951:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.899202:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:11908:1876316239638784:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395123.899234:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899247:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:2.0:1789395123.899251:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.899254:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899263:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417e00, rc 0) 00000100:00100000:2.0:1789395123.899323:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239637376:12345-0@lo:101:mdt00_000.0 Request processed in 6556us (9249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.899331:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00000100:00100000:3.0:1789395123.899417:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231704704 00000100:00100000:3.0:1789395123.899424:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231704704 00010000:00010000:3.0:1789395123.899454:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 30 pid: 6511 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395123.899495:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1537 00000100:00100000:3.0:1789395123.899502:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2396:x1876316231704704:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395123.899522:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395123.899527:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 30 pid: 6511 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.899543:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 30 pid: 6511 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.899562:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417800/0xff35729af316a1a2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c61 expref: 30 pid: 6511 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.899574:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:3.0:1789395123.899579:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.899588:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.899597:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.899627:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395123.899639:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239638912:0@lo:105: 00000100:00100000:3.0:1789395123.899673:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.899711:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca0c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.899762:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239638912 00000100:00100000:2.0:1789395123.899767:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239638912 00000100:00100000:2.0:1789395123.899805:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1789395123.899813:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239638912:12345-0@lo:105: 00010000:00010000:2.0:1789395123.899823:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899832:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899841:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899848:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899855:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899863:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.899876:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca015a00) 00000100:00100000:2.0:1789395123.899910:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239638912:12345-0@lo:105: Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.899917:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1789395123.899944:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239638912:0@lo:105: 00010000:00010000:2.0:1789395123.899955:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395123.899992:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:2396:x1876316231704704:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 489us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.900000:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1537 00000100:00100000:0.0:1789395123.900209:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239637376:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395123.900224:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395123.900243:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395123.900275:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.900282:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.900290:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.900303:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639040:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395123.900331:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.900346:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.900414:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239639040 00000100:00100000:2.0:1789395123.900418:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239639040 00000100:00100000:2.0:1789395123.900446:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:2.0:1789395123.900453:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6511:x1876316239639040:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1789395123.900466:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.900481:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc000/0xff35729af316a4ea lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a4e3 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.900500:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc000/0xff35729af316a4ea lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a4e3 expref: 13 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.900523:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc000/0xff35729af316a4ea lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a4e3 expref: 13 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.900531:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x3873ad72 (ffff89a3ca2fb700) 00010000:00010000:2.0:1789395123.900533:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.900536:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc000, rc 0) 00000100:00100000:2.0:1789395123.900571:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6511:x1876316239639040:12345-0@lo:101:mdt00_000.0 Request processed in 118us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.900577:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:3.0:1789395123.900663:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639040:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395123.900674:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.900686:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395123.900696:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:3.0:1789395123.900729:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639168:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395123.900754:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.900768:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395123.900869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239639168 00000100:00100000:0.0:1789395123.900873:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239639168 00000100:00100000:0.0:1789395123.900908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1789395123.900914:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6511:x1876316239639168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395123.900976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6511:x1876316239639168:12345-0@lo:1000:mdt00_000.0 Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.900981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1789395123.901006:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639168:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395123.901057:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639296:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395123.901081:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.901096:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395123.901106:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239639296 00000100:00100000:0.0:1789395123.901110:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239639296 00000100:00100000:0.0:1789395123.901129:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1789395123.901133:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6511:x1876316239639296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395123.901200:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6511:x1876316239639296:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (118us total) trans 0 rc 1/1 00000100:00100000:0.0:1789395123.901206:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1789395123.901231:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639296:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789395123.901270:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901278:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901286:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.901297:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639424:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395123.901318:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.901331:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395123.901341:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239639424 00000100:00100000:0.0:1789395123.901344:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239639424 00000100:00100000:0.0:1789395123.901364:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:0.0:1789395123.901370:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6511:x1876316239639424:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395123.901377:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395123.901416:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a4f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a4f1 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901431:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a4f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a4f1 expref: 14 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901443:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a4f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a4f1 expref: 14 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901455:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a4fbb8e900) 00010000:00010000:0.0:1789395123.901457:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395123.901460:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014200, rc 0) 00000100:00100000:0.0:1789395123.901487:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6511:x1876316239639424:12345-0@lo:101:mdt00_000.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.901493:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:0.0:1789395123.901532:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639424:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395123.901543:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901552:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901575:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901584:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901591:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901607:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901617:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 45 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901629:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901649:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 45 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.901661:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 45 pid: 10512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.901672:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1876316239639552:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395123.901714:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.906439:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.906536:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231704832 00000100:00100000:2.0:1789395123.906546:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231704832 00010000:00010000:2.0:1789395123.906585:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 46 pid: 10512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395123.906623:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1538 00000100:00100000:2.0:1789395123.906634:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:2396:x1876316231704832:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395123.906649:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395123.906656:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 46 pid: 10512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.906669:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 46 pid: 10512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.906690:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbf:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395123.906695:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.906704:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.906712:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.906729:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395123.906784:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:2396:x1876316231704832:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 151us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.906792:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1538 00010000:00010000:0.0:1789395123.908200:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316a3d2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d41 expref: 45 pid: 10512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.908222:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1876316239639552:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395123.908244:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.908253:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.908259:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.908306:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.908314:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.908324:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.908343:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639680:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395123.908694:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.908722:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.908994:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239639680 00000100:00100000:1.0:1789395123.909001:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239639680 00000100:00100000:1.0:1789395123.909060:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1789395123.909070:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6511:x1876316239639680:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395123.909086:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395123.909100:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a50d expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.909123:0:20561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.909133:0:20561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.909156:0:20561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.909169:0:20561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 28 pid: 6512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395123.909181:0:20561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239639808:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395123.909253:0:20561:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.915817:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.916114:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231704960 00000100:00100000:2.0:1789395123.916124:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231704960 00010000:00010000:2.0:1789395123.916166:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 29 pid: 6512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395123.916214:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1539 00000100:00100000:2.0:1789395123.916224:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:2395:x1876316231704960:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395123.916239:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395123.916246:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 29 pid: 6512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.916260:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 29 pid: 6512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.916281:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbf:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395123.916287:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.916299:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.916308:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.916343:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395123.916356:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239639936:0@lo:105: 00000100:00100000:2.0:1789395123.916452:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.916489:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c300 going to sleep for 11 seconds 00010000:00010000:0.0:1789395123.917017:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316a3e0 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d48 expref: 29 pid: 6512 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.917046:0:20561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239639808:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395123.917068:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.917075:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbf:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:0.0:1789395123.917078:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395123.917082:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416400, rc 0) 00000100:00100000:0.0:1789395123.917125:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6511:x1876316239639680:12345-0@lo:101:mdt00_000.0 Request processed in 8056us (8432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.917132:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:2.0:1789395123.917265:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239639680:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1789395123.917283:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.917301:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395123.917361:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239639936 00000100:00100000:1.0:1789395123.917367:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239639936 00000100:00100000:1.0:1789395123.917437:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1789395123.917444:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:16674:x1876316239639936:12345-0@lo:105: 00010000:00010000:1.0:1789395123.917453:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.917462:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.917470:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.917478:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.917496:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.917505:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.917524:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2aaa00) 00000100:00100000:1.0:1789395123.917678:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:16674:x1876316239639936:12345-0@lo:105: Request processed in 234us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.917685:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00010000:00010000:0.0:1789395123.920224:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.920243:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.920952:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239640064:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1789395123.921049:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.921088:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395123.921754:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640064 00000100:00100000:2.0:1789395123.921764:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640064 00000100:00100000:2.0:1789395123.921809:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:2.0:1789395123.921818:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6511:x1876316239640064:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1789395123.924979:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6511:x1876316239640064:12345-0@lo:403:mdt00_000.0 Request processed in 3154us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.924992:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:3.0:1789395123.927726:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239639936:0@lo:105: 00010000:00010000:3.0:1789395123.927753:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395123.928111:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:2395:x1876316231704960:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 11885us (12299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.928124:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1539 00000100:00100000:0.0:1789395123.930826:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239640064:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1789395123.933008:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].388, 952 off587752 00000040:00080000:1.0:1789395123.933210:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].386, 1032 off640768 00000004:00080000:1.0:1789395123.933216:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca06a6c0 with version 733 00000004:00080000:3.0:1789395123.938881:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 733 rpc_version 733 00000020:00100000:3.0:1789395123.938934:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395123.938945:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f5c00 x1876316239640320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395123.938971:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239640320:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395123.939048:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.939126:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395123.939176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640320 00000100:00100000:0.0:1789395123.939183:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640320 00000100:00100000:0.0:1789395123.939272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:0.0:1789395123.939282:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239640320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395123.939768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239640320:12345-0@lo:1000:osp_up1-0.0 Request processed in 486us (718us total) trans 4294968427 rc 0/0 00000100:00100000:0.0:1789395123.939776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:3.0:1789395123.939974:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239640320:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1789395123.940117:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1502:0x0]: returning size 4096 00010000:00010000:2.0:1789395123.940141:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940151:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940158:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940164:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.940168:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940177:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940191:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbf:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395123.940194:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395123.940198:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940204:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316a506 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940223:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940230:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940236:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940262:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395123.940270:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xbf:0x0] 00010000:00010000:2.0:1789395123.940279:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940284:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940290:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940295:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395123.940298:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940304:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940312:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a4fbb8e400) 00010000:00010000:2.0:1789395123.940314:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395123.940317:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940322:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a4ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940336:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940343:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940350:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940366:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1789395123.940376:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1789395123.940416:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395123.940421:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940428:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395123.940432:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395123.940444:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940471:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.940478:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395123.940569:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395123.940574:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.940581:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395123.940585:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395123.940596:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.940616:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.940622:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395123.940639:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.940646:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca014600/0xff35729af316a4f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.940660:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395123.940662:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395123.940663:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395123.940671:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395123.940683:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239640576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395123.940720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.940757:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640576 00000100:00100000:3.0:1789395123.940762:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640576 00000100:00100000:3.0:1789395123.940800:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1789395123.940808:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+16:3639:x1876316239640576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395123.940822:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395123.940837:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014200/0xff35729af316a4f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a4f1 expref: 16 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.940853:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff89a4fbb8e900) 00010000:00010000:3.0:1789395123.940860:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395123.940886:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3639:x1876316239640576:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.940892:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1789395123.940919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239640576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395123.941035:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 1/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.941044:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aaa00/0xff35729af316a50d lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a514 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.941057:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395123.941058:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395123.941060:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395123.941070:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.941079:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.941086:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.941098:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395123.941103:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1789395123.941108:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.941115:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395123.941179:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231704576:12345-192.168.203.54@tcp:36:rm.0 Request processed in 51396us (51728us total) trans 4294983474 rc 0/0 00000100:00100000:2.0:1789395123.941186:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23436 00000100:00100000:3.0:1789395123.942126:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239640448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395123.942168:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789395123.942212:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395123.942218:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942226:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395123.942233:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395123.942241:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942269:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942276:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395123.942301:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942313:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015a00/0xff35729af316a4d5 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942332:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395123.942334:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395123.942335:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395123.942358:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239640704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395123.942418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395123.942451:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640448 00000100:00100000:3.0:1789395123.942457:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640448 00000100:00100000:3.0:1789395123.942647:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640704 00000100:00100000:3.0:1789395123.942651:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640704 00000100:00100000:3.0:1789395123.942676:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1789395123.942684:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+16:3639:x1876316239640448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395123.942694:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395123.942709:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a514 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a50d expref: 16 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942721:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbf:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:3.0:1789395123.942730:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395123.942759:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+15:3639:x1876316239640448:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.942765:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1789395123.942778:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1789395123.942783:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+14:3636:x1876316239640704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395123.942790:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395123.942800:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a4dc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a4d5 expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.942810:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:3.0:1789395123.942816:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395123.942839:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+13:3636:x1876316239640704:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.942845:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1789395123.942900:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239640448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395123.942923:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239640704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395123.953778:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395123.960747:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.960843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231705216 00000100:00100000:2.0:1789395123.960853:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231705216 00000100:00100000:2.0:1789395123.960916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23437 00000100:00100000:2.0:1789395123.960927:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231705216:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1789395123.960951:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.960971:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a51b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105daa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395123.961129:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13d0:0x0]: returning size 4096 00010000:00010000:2.0:1789395123.961220:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a51b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105daa expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.961234:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395123.961237:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.961243:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a51b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105daa expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.961257:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3ccc00, rc 0) 00000100:00100000:2.0:1789395123.961321:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231705216:12345-192.168.203.54@tcp:101:rm.0 Request processed in 396us (583us total) trans 4294983475 rc 301/301 00000100:00100000:2.0:1789395123.961332:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23437 00000100:00100000:2.0:1789395123.972479:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.972579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231705472 00000100:00100000:1.0:1789395123.972589:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231705472 00000100:00100000:1.0:1789395123.972636:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5043 00000100:00100000:1.0:1789395123.972646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231705472:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:1.0:1789395123.972868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:17656:x1876316231705472:12345-192.168.203.54@tcp:35:rm.0 Request processed in 222us (396us total) trans 4294983476 rc 0/0 00000100:00100000:1.0:1789395123.972876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5043 00000100:00100000:1.0:1789395123.978540:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395123.978583:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395123.978666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231705856 00000100:00100000:2.0:1789395123.978675:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231705856 00000100:00100000:2.0:1789395123.978733:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23438 00000100:00100000:2.0:1789395123.978744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:17656:x1876316231705856:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395123.978797:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395123.978822:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316a46c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d80 expref: 47 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.978843:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395123.978867:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395123.978915:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.978924:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.978934:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395123.978954:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239640832:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1789395123.979001:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395123.979067:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395123.979318:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231705600 00000100:00100000:3.0:1789395123.979323:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231705600 00000100:00100000:3.0:1789395123.979367:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1295 00000100:00100000:3.0:1789395123.979375:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:2396:x1876316231705600:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:3.0:1789395123.979424:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395123.979438:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014e00/0xff35729af316a450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d72 expref: 28 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.979451:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a4fbb8ef00) 00010000:00010000:3.0:1789395123.979461:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395123.979514:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2396:x1876316231705600:12345-192.168.203.54@tcp:103:rm.0 Request processed in 140us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.979522:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1295 00000100:00100000:1.0:1789395123.979672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640832 00000100:00100000:1.0:1789395123.979677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640832 00000100:00100000:1.0:1789395123.979717:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:1.0:1789395123.979724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6512:x1876316239640832:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395123.979737:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395123.979753:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a530 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a529 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.979774:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a530 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a529 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.979786:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a530 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a529 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.979793:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8900) 00010000:00010000:1.0:1789395123.979797:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395123.979799:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417200, rc 0) 00000100:00100000:1.0:1789395123.979852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:6512:x1876316239640832:12345-0@lo:101:mdt00_001.0 Request processed in 122us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.979858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:0.0:1789395123.979929:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239640832:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395123.979944:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.979954:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395123.979972:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395123.979996:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.980003:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.980011:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.980036:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239640960:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395123.980064:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.980096:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.980189:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239640960 00000100:00100000:1.0:1789395123.980193:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239640960 00000100:00100000:1.0:1789395123.980225:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:1.0:1789395123.980232:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6512:x1876316239640960:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395123.980240:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395123.980252:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a53e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a537 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.980268:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a53e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a537 expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.980278:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a53e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a537 expref: 15 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.980285:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x18cfedbe (ffff89a4c3ab8300) 00010000:00010000:1.0:1789395123.980287:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395123.980290:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417e00, rc 0) 00000100:00100000:1.0:1789395123.980322:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239640960:12345-0@lo:101:mdt00_001.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395123.980328:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:1.0:1789395123.980354:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239640960:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395123.980365:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.980374:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395123.980413:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395123.980444:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641088:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395123.980471:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.980573:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239641088 00000100:00100000:0.0:1789395123.980578:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239641088 00000100:00100000:0.0:1789395123.980603:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:0.0:1789395123.980610:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239641088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395123.980666:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239641088:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395123.980673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00100000:1.0:1789395123.980724:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.980740:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641088:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395123.980778:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641216:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395123.980800:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395123.980820:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.980835:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239641216 00000100:00100000:1.0:1789395123.980838:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239641216 00000100:00100000:1.0:1789395123.981038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:1.0:1789395123.981046:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239641216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395123.983949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239641216:12345-0@lo:1000:mdt00_001.0 Request processed in 2893us (3136us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395123.983963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:0.0:1789395123.984048:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641216:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789395123.984132:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.984143:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.984152:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.984170:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641344:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395123.984214:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.984291:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395123.984332:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239641344 00000100:00100000:3.0:1789395123.984339:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239641344 00000100:00100000:2.0:1789395123.984708:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:2.0:1789395123.984719:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6512:x1876316239641344:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395123.984734:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395123.984751:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316a54c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a545 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.984778:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316a54c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a545 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.984792:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316a54c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a545 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395123.984800:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:2.0:1789395123.984803:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395123.984807:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3ccc00, rc 0) 00000100:00100000:2.0:1789395123.984842:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:6512:x1876316239641344:12345-0@lo:101:mdt00_001.0 Request processed in 125us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395123.984912:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00100000:1.0:1789395123.984974:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641344:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395123.984990:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985000:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985041:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985049:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985057:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985076:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985086:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 46 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985094:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 4/0,1 mode: --/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985117:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 46 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395123.985131:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 46 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395123.985143:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1876316239641472:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395123.985214:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395123.995124:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395123.995220:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1876316239641472:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395123.995246:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395123.995664:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231705984 00000100:00100000:3.0:1789395123.995671:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231705984 00010000:00010000:3.0:1789395123.995709:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 47 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395123.995750:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1540 00000100:00100000:3.0:1789395123.995759:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:2395:x1876316231705984:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395123.995774:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395123.995780:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 47 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.995793:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 47 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.995816:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316a47a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d87 expref: 47 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.995832:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x26:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:3.0:1789395123.995837:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.995857:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.995864:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.995888:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395123.995940:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:2395:x1876316231705984:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 183us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395123.995947:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1540 00010000:00010000:0.0:1789395123.996050:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.996062:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.996113:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.996121:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395123.996130:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395123.996147:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641600:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395123.996187:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395123.996217:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395123.996919:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239641600 00000100:00100000:3.0:1789395123.996926:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239641600 00000100:00100000:3.0:1789395123.996968:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:3.0:1789395123.996975:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6512:x1876316239641600:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395123.996991:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395123.997005:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a561 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.997038:0:20561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.997047:0:20561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 17 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.997079:0:20561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395123.997092:0:20561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 26 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395123.997103:0:20561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239641728:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395123.997153:0:20561:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.010546:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.010715:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231706112 00000100:00100000:2.0:1789395124.010726:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231706112 00010000:00010000:2.0:1789395124.010767:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.010816:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1541 00000100:00100000:2.0:1789395124.010827:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2395:x1876316231706112:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.010842:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.010849:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.010864:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.010890:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x26:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:2.0:1789395124.010896:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 17 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.010906:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 17 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.010914:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 17 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.010948:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 17 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.010961:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239641856:0@lo:105: 00000100:00100000:2.0:1789395124.011007:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.011057:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cf00 going to sleep for 11 seconds 00010000:00010000:3.0:1789395124.011217:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd200/0xff35729af316a488 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d8e expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.011232:0:20561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239641728:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395124.011258:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 17 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.011266:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x26:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:3.0:1789395124.011269:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395124.011272:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c200, rc 0) 00000100:00100000:3.0:1789395124.011323:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6512:x1876316239641600:12345-0@lo:101:mdt00_001.0 Request processed in 14347us (15134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.011331:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1789395124.011422:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641600:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395124.011438:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.011448:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.011615:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239641856 00000100:00100000:1.0:1789395124.011620:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239641856 00000100:00100000:1.0:1789395124.011700:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1789395124.011708:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:16674:x1876316239641856:12345-0@lo:105: 00010000:00010000:1.0:1789395124.011718:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.011727:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.011735:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.011742:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.011749:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.011756:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.011780:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2ab000) 00000100:00100000:1.0:1789395124.011817:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:16674:x1876316239641856:12345-0@lo:105: Request processed in 111us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.011824:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00010000:00010000:0.0:1789395124.012044:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.012053:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.012845:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641984:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1789395124.012896:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.012919:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.013048:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:16674:1876316239641856:0@lo:105: 00010000:00010000:3.0:1789395124.013063:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.013117:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2395:x1876316231706112:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 2291us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.013128:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1541 00000100:00100000:1.0:1789395124.014768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239641984 00000100:00100000:1.0:1789395124.014779:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239641984 00000100:00100000:1.0:1789395124.014843:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:1.0:1789395124.014852:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6512:x1876316239641984:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395124.026365:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6512:x1876316239641984:12345-0@lo:403:mdt00_001.0 Request processed in 11503us (13457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.026381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1789395124.026775:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239641984:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1789395124.030331:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].389, 952 off588704 00000040:00080000:0.0:1789395124.030769:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].387, 1032 off641800 00000004:00080000:0.0:1789395124.030778:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca181240 with version 734 00000004:00080000:3.0:1789395124.030873:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 734 rpc_version 734 00000020:00100000:3.0:1789395124.030908:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395124.030918:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f5880 x1876316239642240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395124.030941:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239642240:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395124.031006:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.031047:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.031101:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239642240 00000100:00100000:1.0:1789395124.031120:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239642240 00000100:00100000:1.0:1789395124.031167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:1.0:1789395124.031176:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239642240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.032886:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:7874:x1876316239642240:12345-0@lo:1000:osp_up1-0.0 Request processed in 1704us (1873us total) trans 4294968428 rc 0/0 00000100:00100000:1.0:1789395124.032899:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1789395124.033139:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239642240:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1789395124.033231:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13d0:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.033255:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033265:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033273:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033279:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.033283:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033291:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033307:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x26:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:0.0:1789395124.033310:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.033315:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 2/0,0 mode: --/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033321:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a55a lrc: 0/0,0 mode: --/EX res: [0x200000400:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033341:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033350:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033357:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.033381:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395124.033593:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395124.033600:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.033608:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.033613:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 5/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.033622:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 5/0,0 mode: EX/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.033654:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.033661:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.033687:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.033696:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.033698:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.033699:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395124.033742:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395124.033758:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239642368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395124.033825:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.033869:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239642368 00000100:00100000:2.0:1789395124.033875:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239642368 00000100:00100000:2.0:1789395124.033917:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1789395124.033926:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+18:3636:x1876316239642368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.033938:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.033954:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316a568 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a561 expref: 18 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.033966:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x26:0x0].0x0 (ffff89a3ca2fb400) 00010000:00010000:2.0:1789395124.033974:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.034005:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+17:3636:x1876316239642368:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.034012:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1789395124.034052:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239642368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.034229:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab000/0xff35729af316a561 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a568 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395124.034248:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x26:0x0] 00010000:00010000:0.0:1789395124.034257:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034263:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034269:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034274:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.034277:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034284:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034293:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a4c3ab8d00) 00010000:00010000:0.0:1789395124.034296:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395124.034299:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034305:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a553 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034318:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034325:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034331:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034352:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.034363:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395124.034367:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034374:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.034380:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.034790:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395124.034797:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.034805:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395124.034809:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395124.034816:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.034839:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.034851:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789395124.034891:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239642496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.034925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395124.034970:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.034978:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab800/0xff35729af316a545 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a54c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.034993:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395124.034995:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395124.034997:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395124.035009:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239642496 00000100:00100000:2.0:1789395124.035014:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239642496 00000100:00100000:2.0:1789395124.035059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1789395124.035066:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+17:3638:x1876316239642496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.035075:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.035087:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316a54c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a545 expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.035099:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13d0:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:2.0:1789395124.035118:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395124.036118:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.036138:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395124.036146:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.036155:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.036229:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231705856:12345-192.168.203.54@tcp:36:rm.0 Request processed in 57485us (57642us total) trans 4294983477 rc 0/0 00000100:00100000:0.0:1789395124.036241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23438 00010000:00010000:3.0:1789395124.037092:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395124.037101:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.037110:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.037116:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.037125:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.037157:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.037164:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789395124.040777:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+16:3638:x1876316239642496:12345-0@lo:103:ldlm_bl.0 Request processed in 5699us (5839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.040795:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1789395124.040855:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239642624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395124.040919:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.041097:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239642496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.041419:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.041432:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a529 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a530 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.041455:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.041457:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.041459:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395124.041682:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239642624 00000100:00100000:0.0:1789395124.041690:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239642624 00000100:00100000:0.0:1789395124.041746:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1789395124.041755:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+16:3639:x1876316239642624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.041767:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.041787:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a530 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a529 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.041803:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8900) 00010000:00010000:0.0:1789395124.041812:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395124.041921:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+15:3639:x1876316239642624:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.041929:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1789395124.042047:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239642624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395124.049244:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.049313:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231706368 00000100:00100000:2.0:1789395124.049324:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231706368 00000100:00100000:2.0:1789395124.049416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23439 00000100:00100000:2.0:1789395124.049426:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231706368:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1789395124.049449:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.049470:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a56f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105db1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395124.049763:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00010000:00010000:2.0:1789395124.049853:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a56f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105db1 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.049869:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff89a3ca35fd00) 00010000:00010000:2.0:1789395124.049872:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395124.049877:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a56f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105db1 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.049892:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd400, rc 0) 00000100:00100000:2.0:1789395124.049957:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:17656:x1876316231706368:12345-192.168.203.54@tcp:101:rm.0 Request processed in 532us (722us total) trans 4294983478 rc 301/301 00000100:00100000:2.0:1789395124.049965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23439 00000100:00100000:0.0:1789395124.062001:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.062069:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231706624 00000100:00100000:3.0:1789395124.062079:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231706624 00000100:00100000:3.0:1789395124.062137:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5044 00000100:00100000:3.0:1789395124.062147:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:17656:x1876316231706624:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:3.0:1789395124.062349:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:17656:x1876316231706624:12345-192.168.203.54@tcp:35:rm.0 Request processed in 203us (357us total) trans 4294983479 rc 0/0 00000100:00100000:3.0:1789395124.062357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5044 00000100:00100000:0.0:1789395124.069005:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.069100:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231706880 00000100:00100000:2.0:1789395124.069111:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231706880 00000100:00100000:2.0:1789395124.069174:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23440 00000100:00100000:2.0:1789395124.069185:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:17656:x1876316231706880:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395124.069242:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789395124.069268:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316a4c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d9c expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069296:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316a2d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cd8 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069309:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff89a3ca35fd00) 00010000:00010000:2.0:1789395124.069325:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316a194 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c5a expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069335:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395124.069340:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395124.069363:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069375:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069434:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069450:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xf404c279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069457:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069464:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069727:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069740:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069747:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069765:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069774:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069782:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069813:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.069826:0:7813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 45 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.069839:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239642752:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.069970:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.072546:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239642752:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395124.072573:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.074882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.075769:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231707008 00000100:00100000:2.0:1789395124.075779:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231707008 00010000:00010000:2.0:1789395124.075817:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 46 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.075869:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1542 00000100:00100000:2.0:1789395124.075879:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6281850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:2395:x1876316231707008:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.075893:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.075900:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 46 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.075913:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 46 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.075934:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316a2e4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cdf expref: 46 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.075948:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa7:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:2.0:1789395124.075953:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.075962:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.075969:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.076000:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.076126:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6281850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:2395:x1876316231707008:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 248us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.076134:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1542 00010000:00010000:3.0:1789395124.076267:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.076275:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.076321:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.076329:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.076339:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.076357:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239642880:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1789395124.076420:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.076447:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.076666:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239642880 00000100:00100000:2.0:1789395124.076671:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239642880 00000100:00100000:2.0:1789395124.076700:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:2.0:1789395124.076707:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:7813:x1876316239642880:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789395124.076725:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.076739:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a599 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.076759:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 25 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.076768:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.076788:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 25 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.076800:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 25 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.076809:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:11908:1876316239643008:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.077049:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.084287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.084416:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:11908:1876316239643008:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395124.084449:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.084463:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff89a3ca2fba00) 00010000:00010000:1.0:1789395124.084466:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.084469:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.084484:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.084491:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc800, rc 0) 00000100:00100000:1.0:1789395124.084552:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:7813:x1876316239642880:12345-0@lo:101:mdt00_003.0 Request processed in 7844us (8130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.084560:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:0.0:1789395124.084650:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239642880:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789395124.084667:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.084677:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.084759:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231707136 00000100:00100000:3.0:1789395124.084767:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231707136 00010000:00010000:3.0:1789395124.084794:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 26 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.084828:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1543 00000100:00100000:3.0:1789395124.084836:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2395:x1876316231707136:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.084910:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.084917:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 26 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.084930:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 26 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.084950:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316a2f2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ce6 expref: 26 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.084963:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff89a3ca2fba00) 00010000:00010000:3.0:1789395124.084968:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.084983:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.084991:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085030:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.085043:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239643136:0@lo:105: 00000100:00100000:3.0:1789395124.085078:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.085108:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.085128:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789395124.085139:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239643136 00000100:00100000:3.0:1789395124.085142:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239643136 00000100:00100000:3.0:1789395124.085169:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1789395124.085176:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca5e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239643136:12345-0@lo:105: 00010000:00010000:3.0:1789395124.085185:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085194:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085202:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085209:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085216:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085223:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085239:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca10c000) 00000100:00100000:3.0:1789395124.085270:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca5e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239643136:12345-0@lo:105: Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.085276:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1789395124.085322:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239643136:0@lo:105: 00010000:00010000:3.0:1789395124.085332:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.085369:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:2395:x1876316231707136:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 534us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.085376:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1543 00010000:00010000:3.0:1789395124.085413:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.085422:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.087123:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239643264:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1789395124.087178:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.087244:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.087279:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239643264 00000100:00100000:0.0:1789395124.087286:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239643264 00000100:00100000:0.0:1789395124.087367:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:0.0:1789395124.087376:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7813:x1876316239643264:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1789395124.089031:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7813:x1876316239643264:12345-0@lo:403:mdt00_003.0 Request processed in 1640us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.089043:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:3.0:1789395124.089171:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239643264:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1789395124.090071:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].390, 952 off589656 00000040:00080000:3.0:1789395124.090258:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].388, 1032 off642832 00000004:00080000:3.0:1789395124.090264:0:7813:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4c4f5b6c0 with version 735 00000004:00080000:2.0:1789395124.090593:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 735 rpc_version 735 00000020:00100000:2.0:1789395124.090622:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395124.090630:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6680 x1876316239643520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395124.090652:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239643520:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395124.090699:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.090979:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.091045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239643520 00000100:00100000:1.0:1789395124.091051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239643520 00000100:00100000:1.0:1789395124.091100:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:1.0:1789395124.091108:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239643520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.091282:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239643520:12345-0@lo:1000:osp_up1-0.0 Request processed in 175us (582us total) trans 4294968429 rc 0/0 00000100:00100000:1.0:1789395124.091290:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:1.0:1789395124.091340:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239643520:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1789395124.091362:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00010000:00010000:1.0:1789395124.091379:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091406:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091414:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091420:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cdc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395124.091425:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091435:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091448:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa7:0x0].0x0 (ffff89a3ca2fb100) 00010000:00010000:1.0:1789395124.091451:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.091456:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091462:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a592 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091483:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091491:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091499:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091515:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395124.091522:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xa7:0x0] 00010000:00010000:1.0:1789395124.091529:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091535:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091541:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091550:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395124.091554:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091560:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091567:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff89a3ca2fb500) 00010000:00010000:1.0:1789395124.091570:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.091573:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091578:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a58b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091594:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091601:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091607:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091612:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091617:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395124.091620:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091629:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091636:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:1.0:1789395124.091639:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.091642:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091647:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a57d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.091659:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfb80399 reply state 00000000430fb4ad transno 4294983480 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091670:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091676:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf404c279 (ffff89a3ca2fb400) 00010000:00010000:1.0:1789395124.091679:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395124.091681:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395124.091735:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:17656:x1876316231706880:12345-192.168.203.54@tcp:36:rm.0 Request processed in 22550us (22738us total) trans 4294983480 rc 0/0 00000100:00100000:1.0:1789395124.091742:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23440 00010000:00010000:1.0:1789395124.091762:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395124.091767:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091775:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395124.091779:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.091787:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091808:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091815:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395124.091831:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091839:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c000/0xff35729af316a599 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5a0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.091852:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395124.091854:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395124.091855:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395124.091862:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395124.091871:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239643648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.091898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.091927:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239643648 00000100:00100000:1.0:1789395124.091931:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239643648 00000100:00100000:1.0:1789395124.091959:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1789395124.091966:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+17:3637:x1876316239643648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.091975:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.091989:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316a5a0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a599 expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.092004:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff89a3ca2fba00) 00010000:00010000:1.0:1789395124.092011:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.092053:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+16:3637:x1876316239643648:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.092059:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1789395124.092086:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239643648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395124.101936:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.104092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231707392 00000100:00100000:2.0:1789395124.104104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231707392 00000100:00100000:2.0:1789395124.104174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23441 00000100:00100000:2.0:1789395124.104184:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:17656:x1876316231707392:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1789395124.104205:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.104226:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316a5a7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105db8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395124.104377:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x9c:0x0]: returning size 4096 00010000:00010000:2.0:1789395124.104737:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316a5a7 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105db8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.104751:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395124.104754:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395124.104760:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316a5a7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105db8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.104776:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cde00, rc 0) 00000100:00100000:2.0:1789395124.104853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17656:x1876316231707392:12345-192.168.203.54@tcp:101:rm.0 Request processed in 670us (2925us total) trans 4294968430 rc 301/301 00000100:00100000:2.0:1789395124.104860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23441 00000100:00100000:1.0:1789395124.111773:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.111835:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231707648 00000100:00100000:0.0:1789395124.111845:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231707648 00000100:00100000:0.0:1789395124.111896:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5045 00000100:00100000:0.0:1789395124.111907:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17656:x1876316231707648:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:0.0:1789395124.112127:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17656:x1876316231707648:12345-192.168.203.54@tcp:35:rm.0 Request processed in 221us (362us total) trans 4294968431 rc 0/0 00000100:00100000:0.0:1789395124.112135:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5045 00000100:00100000:0.0:1789395124.116370:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.116509:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.116564:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231707776 00000100:00100000:2.0:1789395124.116573:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231707776 00000100:00100000:2.0:1789395124.116632:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1300 00000100:00100000:2.0:1789395124.116642:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:2395:x1876316231707776:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:2.0:1789395124.116657:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.116681:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316a1be lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c68 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.116709:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:2.0:1789395124.116720:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.116777:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:2395:x1876316231707776:12345-192.168.203.54@tcp:103:rm.0 Request processed in 136us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.116784:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1300 00000100:00100000:1.0:1789395124.118416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231708032 00000100:00100000:1.0:1789395124.118425:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231708032 00000100:00100000:2.0:1789395124.118953:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23442 00000100:00100000:2.0:1789395124.118965:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17656:x1876316231708032:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395124.119014:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.119048:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316a1da lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c76 expref: 27 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.119066:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395124.119075:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395124.119119:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.119128:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.119138:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.119166:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239643776:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1789395124.119216:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.119256:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.119432:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239643776 00000100:00100000:1.0:1789395124.119437:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239643776 00000100:00100000:1.0:1789395124.119471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:1.0:1789395124.119479:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:6513:x1876316239643776:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395124.119492:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.119509:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316a5bc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a5b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.119533:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316a5bc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a5b5 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.119547:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316a5bc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5b5 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.119555:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c3ab8700) 00010000:00010000:1.0:1789395124.119558:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.119560:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417200, rc 0) 00000100:00100000:1.0:1789395124.119613:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+26:6513:x1876316239643776:12345-0@lo:101:mdt00_002.0 Request processed in 135us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.119619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1789395124.119759:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239643776:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395124.119776:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.119789:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395124.119807:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1789395124.119830:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.119838:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.119845:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.119858:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239643904:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1789395124.119885:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.119913:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.119962:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239643904 00000100:00100000:2.0:1789395124.119968:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239643904 00000100:00100000:2.0:1789395124.120002:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1789395124.120009:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:6513:x1876316239643904:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395124.120030:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.120044:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a5ca lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a5c3 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.120061:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a5ca lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a5c3 expref: 27 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.120072:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a5ca lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5c3 expref: 27 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.120079:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8b6906c (ffff89a3ca2fba00) 00010000:00010000:2.0:1789395124.120082:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395124.120084:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc800, rc 0) 00000100:00100000:2.0:1789395124.120120:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:6513:x1876316239643904:12345-0@lo:101:mdt00_002.0 Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.120126:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:3.0:1789395124.120199:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239643904:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395124.120211:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.120220:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395124.120233:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1789395124.120323:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644032:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395124.120352:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.120377:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.120449:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239644032 00000100:00100000:1.0:1789395124.120454:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239644032 00000100:00100000:1.0:1789395124.120490:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173 00000100:00100000:1.0:1789395124.120498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+27:6513:x1876316239644032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395124.120564:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+27:6513:x1876316239644032:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.120570:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173 00000100:00100000:2.0:1789395124.120621:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395124.120661:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644160:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395124.120686:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.120708:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.120818:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239644160 00000100:00100000:3.0:1789395124.120823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239644160 00000100:00100000:3.0:1789395124.120858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:3.0:1789395124.120864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:6513:x1876316239644160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395124.122053:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:6513:x1876316239644160:12345-0@lo:1000:mdt00_002.0 Request processed in 1153us (1330us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395124.122063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000100:00100000:0.0:1789395124.124884:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644160:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789395124.124977:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.124989:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.125000:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.125037:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644288:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395124.125095:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.125131:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.125586:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239644288 00000100:00100000:1.0:1789395124.125593:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239644288 00000100:00100000:1.0:1789395124.125647:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:1.0:1789395124.125656:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+27:6513:x1876316239644288:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395124.125670:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.125686:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a5d8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a5d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.125711:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a5d8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a5d1 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.125723:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a5d8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5d1 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.125730:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a4c3ab8800) 00010000:00010000:1.0:1789395124.125733:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395124.125736:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416400, rc 0) 00000100:00100000:1.0:1789395124.125785:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+28:6513:x1876316239644288:12345-0@lo:101:mdt00_002.0 Request processed in 130us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.125792:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00100000:2.0:1789395124.126057:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644288:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395124.126072:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126087:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126112:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126120:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126127:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126145:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126154:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126161:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126184:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.126195:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 26 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.126206:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239644416:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.126273:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.131911:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.132172:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239644416:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395124.132197:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.132702:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231708160 00000100:00100000:1.0:1789395124.132710:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231708160 00010000:00010000:1.0:1789395124.132748:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.132920:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1544 00000100:00100000:1.0:1789395124.132931:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2395:x1876316231708160:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.132947:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.132954:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.132968:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.132989:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23aa00/0xff35729af316a1e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x51:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c7d expref: 27 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.133003:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x51:0x0].0x0 (ffff89a3ca35f900) 00010000:00010000:1.0:1789395124.133008:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.133032:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.133040:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.133072:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.133129:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2395:x1876316231708160:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 199us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.133137:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1544 00010000:00010000:0.0:1789395124.133315:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133325:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133370:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133378:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133427:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.133447:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644544:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395124.133497:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.133521:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.133536:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239644544 00000100:00100000:0.0:1789395124.133540:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239644544 00000100:00100000:0.0:1789395124.133567:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1789395124.133574:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+28:6513:x1876316239644544:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395124.133589:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395124.133603:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a5ed expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133622:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133631:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133654:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.133667:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 44 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.133677:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239644672:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395124.133728:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.140785:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.140954:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239644672:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395124.140990:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.141005:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:2.0:1789395124.141008:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395124.141013:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.141033:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.141040:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa200, rc 0) 00000100:00100000:2.0:1789395124.141102:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:6513:x1876316239644544:12345-0@lo:101:mdt00_002.0 Request processed in 7528us (7604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.141110:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1789395124.141202:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644544:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395124.141219:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 4/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.141231:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 4/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.142343:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231708288 00000100:00100000:1.0:1789395124.142353:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231708288 00010000:00010000:1.0:1789395124.142558:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 45 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.142643:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1545 00000100:00100000:1.0:1789395124.142654:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:2397:x1876316231708288:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.142673:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.142681:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 45 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.142694:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 45 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.142714:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316a1f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c84 expref: 45 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.142730:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:1.0:1789395124.142735:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 28 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.142746:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 28 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.142756:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 28 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.142791:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 28 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.142805:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239644800:0@lo:105: 00000100:00100000:1.0:1789395124.142867:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.142913:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.143028:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239644800 00000100:00100000:3.0:1789395124.143033:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239644800 00000100:00100000:3.0:1789395124.143073:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1789395124.143081:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239644800:12345-0@lo:105: 00010000:00010000:3.0:1789395124.143090:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 5/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.143099:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 5/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.143107:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 5/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.143113:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.143120:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.143131:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.143155:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2aae00) 00000100:00100000:3.0:1789395124.143191:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239644800:12345-0@lo:105: Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.143198:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1789395124.143282:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239644800:0@lo:105: 00010000:00010000:1.0:1789395124.143296:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.143342:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2397:x1876316231708288:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 690us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.143350:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1545 00010000:00010000:0.0:1789395124.143406:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.143416:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.144013:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644928:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395124.144070:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.144092:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.144864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239644928 00000100:00100000:0.0:1789395124.144871:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239644928 00000100:00100000:0.0:1789395124.144952:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:0.0:1789395124.144962:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:6513:x1876316239644928:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395124.148250:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:6513:x1876316239644928:12345-0@lo:403:mdt00_002.0 Request processed in 3281us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.148265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:2.0:1789395124.148916:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239644928:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1789395124.150079:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].386, 952 off578272 00000040:00080000:2.0:1789395124.150324:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].386, 1032 off632040 00000004:00080000:2.0:1789395124.150331:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca35cc00 with version 732 00000004:00080000:1.0:1789395124.150548:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 732 rpc_version 732 00000020:00100000:1.0:1789395124.150580:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395124.150589:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d8356a00 x1876316239645184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395124.150611:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239645184:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395124.150663:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.150735:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.150775:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645184 00000100:00100000:0.0:1789395124.150782:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645184 00000100:00100000:0.0:1789395124.150917:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00000100:00100000:0.0:1789395124.150927:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:7455:x1876316239645184:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395124.151283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+30:7455:x1876316239645184:12345-0@lo:1000:osp_up0-1.0 Request processed in 358us (618us total) trans 4294983481 rc 0/0 00000100:00100000:0.0:1789395124.151291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:1.0:1789395124.152069:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239645184:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1789395124.152118:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x9c:0x0]: returning size 4096 00010000:00010000:2.0:1789395124.152137:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152151:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152158:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152164:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395124.152168:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152175:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152188:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x51:0x0].0x0 (ffff89a3ca35f900) 00010000:00010000:2.0:1789395124.152191:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395124.152196:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152202:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a5e6 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152221:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152239:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152247:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152274:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395124.152280:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x51:0x0] 00010000:00010000:2.0:1789395124.152289:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152294:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152299:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152303:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395124.152306:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152311:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152318:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:2.0:1789395124.152320:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395124.152323:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a5df lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152339:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152345:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152352:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152372:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1789395124.152380:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1789395124.152403:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152410:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152417:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152428:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1789395124.152431:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1789395124.152435:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.152442:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152603:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789395124.152609:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152616:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aae00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.152620:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.152626:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152651:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152657:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.152672:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 1/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152678:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aae00/0xff35729af316a5ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152695:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789395124.152699:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152704:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aba00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.152707:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.152713:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152726:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152731:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.152741:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152747:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316a5d1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152757:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395124.152760:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152766:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.152769:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.152776:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152789:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152794:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.152799:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152816:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cde00/0xff35729af316a5b5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.152827:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.152828:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.152830:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.152836:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395124.152938:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239645312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.152974:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.153010:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239645440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.153046:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.153066:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395124.153071:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239645568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.153090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789395124.153113:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395124.153123:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645312 00000100:00100000:1.0:1789395124.153128:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645312 00000100:00100000:1.0:1789395124.153161:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645440 00000100:00100000:1.0:1789395124.153164:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645440 00000100:00100000:1.0:1789395124.153182:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645568 00000100:00100000:1.0:1789395124.153184:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645568 00000100:00100000:1.0:1789395124.153198:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1789395124.153205:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+32:3637:x1876316239645312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.153215:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.153241:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316a5f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a5ed expref: 32 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.153253:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff89a4fbb8e700) 00010000:00010000:1.0:1789395124.153261:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.153289:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+31:3637:x1876316239645312:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.153295:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1789395124.153308:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1789395124.153313:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6283850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+30:3638:x1876316239645440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.153320:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.153331:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316a5d8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a5d1 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.153344:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9c:0x0].0x0 (ffff89a4c3ab8800) 00010000:00010000:1.0:1789395124.153349:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.153374:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6283850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+29:3638:x1876316239645440:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.153380:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1789395124.153440:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1789395124.153447:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+28:3638:x1876316239645568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.153453:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.153463:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316a5bc lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a5b5 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.153473:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a4c3ab8700) 00010000:00010000:1.0:1789395124.153479:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.153609:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+27:3638:x1876316239645568:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.153615:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1789395124.153646:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239645312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.153670:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239645568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.153676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239645440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395124.153767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17656:x1876316231708032:12345-192.168.203.54@tcp:36:rm.0 Request processed in 34802us (37403us total) trans 4294968432 rc 0/0 00000100:00100000:2.0:1789395124.153775:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23442 00000100:00100000:0.0:1789395124.171577:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.171958:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231708544 00000100:00100000:1.0:1789395124.171968:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231708544 00000100:00100000:1.0:1789395124.172090:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23443 00000100:00100000:1.0:1789395124.172101:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:17656:x1876316231708544:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:1.0:1789395124.172127:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.172148:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a5fb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105dbf expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395124.172293:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x166:0x0]: returning size 4096 00010000:00010000:1.0:1789395124.172426:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a5fb lrc: 1/0,0 mode: --/CR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dbf expref: 28 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.172442:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a4fbb8ea00) 00010000:00010000:1.0:1789395124.172445:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395124.172451:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a5fb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dbf expref: 28 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.172464:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417200, rc 0) 00000100:00100000:1.0:1789395124.172540:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17656:x1876316231708544:12345-192.168.203.54@tcp:101:rm.0 Request processed in 441us (971us total) trans 4294968433 rc 301/301 00000100:00100000:1.0:1789395124.172548:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23443 00000100:00100000:1.0:1789395124.184118:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.184203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231708800 00000100:00100000:3.0:1789395124.184214:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231708800 00000100:00100000:3.0:1789395124.184266:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5046 00000100:00100000:3.0:1789395124.184275:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17656:x1876316231708800:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:3.0:1789395124.184529:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17656:x1876316231708800:12345-192.168.203.54@tcp:35:rm.0 Request processed in 255us (420us total) trans 4294968434 rc 0/0 00000100:00100000:3.0:1789395124.184537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5046 00000100:00100000:3.0:1789395124.196046:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.196087:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.196165:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231709184 00000100:00100000:1.0:1789395124.196175:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231709184 00000100:00100000:2.0:1789395124.196276:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231708928 00000100:00100000:2.0:1789395124.196280:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231708928 00000100:00100000:2.0:1789395124.196324:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1304 00000100:00100000:2.0:1789395124.196332:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2396:x1876316231708928:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:2.0:1789395124.196346:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.196368:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a30e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ced expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.196438:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:2.0:1789395124.196450:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.196493:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:2396:x1876316231708928:12345-192.168.203.54@tcp:103:rm.0 Request processed in 162us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.196499:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1304 00000100:00100000:1.0:1789395124.196590:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23444 00000100:00100000:1.0:1789395124.196598:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17656:x1876316231709184:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:1.0:1789395124.196650:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.196665:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316a32a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cfb expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.196677:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a4fbb8ea00) 00010000:00010000:1.0:1789395124.196686:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395124.196733:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.196742:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.196751:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.196770:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239645696:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1789395124.196809:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.196853:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.197045:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645696 00000100:00100000:2.0:1789395124.197050:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645696 00000100:00100000:2.0:1789395124.197085:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:2.0:1789395124.197091:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:6511:x1876316239645696:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1789395124.197103:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.197115:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a610 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a609 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.197135:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a610 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a609 expref: 28 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.197147:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a610 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a609 expref: 28 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.197154:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:2.0:1789395124.197157:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395124.197160:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd400, rc 0) 00000100:00100000:2.0:1789395124.197200:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+28:6511:x1876316239645696:12345-0@lo:101:mdt00_000.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.197205:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:3.0:1789395124.197274:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239645696:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395124.197289:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.197299:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395124.197317:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1789395124.197340:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.197347:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.197353:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.197365:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239645824:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789395124.197418:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.197436:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.197497:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645824 00000100:00100000:1.0:1789395124.197501:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645824 00000100:00100000:1.0:1789395124.197535:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:1.0:1789395124.197542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+28:6511:x1876316239645824:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395124.197550:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.197563:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a61e lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a617 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.197577:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a61e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a617 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.197588:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a61e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a617 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.197595:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xef411af6 (ffff89a4c3ab8800) 00010000:00010000:1.0:1789395124.197598:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.197600:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417800, rc 0) 00000100:00100000:1.0:1789395124.197626:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:6511:x1876316239645824:12345-0@lo:101:mdt00_000.0 Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.197632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00100000:3.0:1789395124.197964:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239645824:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395124.197975:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.197985:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395124.197997:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1789395124.198043:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239645952:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395124.198072:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.198102:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca35c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.198117:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239645952 00000100:00100000:3.0:1789395124.198121:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239645952 00000100:00100000:3.0:1789395124.198180:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:3.0:1789395124.198187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:6511:x1876316239645952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395124.198255:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:6511:x1876316239645952:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.198263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00100000:0.0:1789395124.198341:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239645952:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395124.198415:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646080:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395124.198442:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.198517:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.198665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239646080 00000100:00100000:1.0:1789395124.198671:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239646080 00000100:00100000:1.0:1789395124.198693:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182 00000100:00100000:1.0:1789395124.198700:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:6511:x1876316239646080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395124.198775:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:6511:x1876316239646080:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (332us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395124.198781:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182 00000100:00100000:0.0:1789395124.198845:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646080:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789395124.198888:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.198895:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.198903:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.198914:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646208:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395124.198936:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.198957:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.199003:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239646208 00000100:00100000:1.0:1789395124.199007:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239646208 00000100:00100000:1.0:1789395124.199078:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183 00000100:00100000:1.0:1789395124.199085:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:6511:x1876316239646208:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395124.199094:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.199107:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a62c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a625 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.199127:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a62c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a625 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.199137:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a62c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a625 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.199145:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a4c3ab8100) 00010000:00010000:1.0:1789395124.199147:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395124.199150:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416600, rc 0) 00000100:00100000:1.0:1789395124.199180:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+30:6511:x1876316239646208:12345-0@lo:101:mdt00_000.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.199189:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183 00000100:00100000:0.0:1789395124.199240:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646208:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395124.199253:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199262:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199284:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199291:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199298:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199313:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199324:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199331:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 4/0,1 mode: --/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199351:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.199364:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 27 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.199374:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239646336:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395124.199588:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.201752:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239646336:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395124.201777:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.202524:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.202829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231709312 00000100:00100000:2.0:1789395124.202837:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231709312 00010000:00010000:2.0:1789395124.202872:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 28 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.202908:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1546 00000100:00100000:2.0:1789395124.202918:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:2395:x1876316231709312:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.202932:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.202938:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 28 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.202949:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 28 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.202969:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc200/0xff35729af316a338 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d02 expref: 28 pid: 6513 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.202990:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb6:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:2.0:1789395124.202995:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203004:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203012:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203050:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.203109:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2395:x1876316231709312:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 192us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.203117:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1546 00010000:00010000:0.0:1789395124.203186:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.203194:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.203237:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.203245:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.203254:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.203268:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646464:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395124.203302:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.203518:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.203751:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239646464 00000100:00100000:2.0:1789395124.203756:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239646464 00000100:00100000:2.0:1789395124.203783:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:2.0:1789395124.203791:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+30:6511:x1876316239646464:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1789395124.203806:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.203821:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a641 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203843:0:20561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 42 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203852:0:20561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203874:0:20561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 42 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.203888:0:20561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 42 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.203898:0:20561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20561:1876316239646592:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.203952:0:20561:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.207571:0:20561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20561:1876316239646592:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395124.207604:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.207615:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb6:0x0].0x0 (ffff89a4fbb8e500) 00010000:00010000:2.0:1789395124.207618:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395124.207622:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.207631:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.207637:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd600, rc 0) 00000100:00100000:2.0:1789395124.207685:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+31:6511:x1876316239646464:12345-0@lo:101:mdt00_000.0 Request processed in 3895us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.207694:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00100000:0.0:1789395124.208668:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646464:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395124.208691:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.209183:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.212581:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.212732:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231709440 00000100:00100000:0.0:1789395124.212742:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231709440 00010000:00010000:0.0:1789395124.212777:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.212810:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1547 00000100:00100000:0.0:1789395124.212819:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:2396:x1876316231709440:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.212833:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.212839:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.212851:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.212878:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316a346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d09 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.212894:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb6:0x0].0x0 (ffff89a4fbb8e500) 00010000:00010000:0.0:1789395124.212901:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 30 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.212912:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 30 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.212922:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 30 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.212956:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 30 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.212969:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6497:1876316239646720:0@lo:105: 00000100:00100000:0.0:1789395124.213012:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.213474:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239646720 00000100:00100000:3.0:1789395124.213479:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239646720 00000100:00100000:0.0:1789395124.213569:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.213639:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1789395124.213646:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6497:x1876316239646720:12345-0@lo:105: 00010000:00010000:3.0:1789395124.213656:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.213667:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.213675:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.213683:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.213691:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.213700:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.213753:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2abc00) 00000100:00100000:3.0:1789395124.213803:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6497:x1876316239646720:12345-0@lo:105: Request processed in 157us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.213810:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1789395124.214138:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6497:1876316239646720:0@lo:105: 00010000:00010000:1.0:1789395124.214155:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.214202:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:2396:x1876316231709440:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1379us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.214209:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1547 00010000:00010000:0.0:1789395124.214568:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.214579:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.215275:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646848:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1789395124.215332:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.215363:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.215716:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239646848 00000100:00100000:1.0:1789395124.215723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239646848 00000100:00100000:1.0:1789395124.215763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:1.0:1789395124.215771:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+31:6511:x1876316239646848:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1789395124.219355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+31:6511:x1876316239646848:12345-0@lo:403:mdt00_000.0 Request processed in 3577us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.219368:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1789395124.220364:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239646848:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1789395124.223821:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].387, 952 off579224 00000040:00080000:0.0:1789395124.223995:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].387, 1032 off633072 00000004:00080000:0.0:1789395124.224002:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca181180 with version 733 00000004:00080000:1.0:1789395124.236215:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 733 rpc_version 733 00000020:00100000:1.0:1789395124.236265:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395124.236277:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d8355880 x1876316239647104/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395124.236299:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239647104:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395124.236359:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.236403:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.236487:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239647104 00000100:00100000:0.0:1789395124.236494:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239647104 00000100:00100000:0.0:1789395124.236548:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:0.0:1789395124.236577:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+31:7455:x1876316239647104:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395124.236984:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:7455:x1876316239647104:12345-0@lo:1000:osp_up0-1.0 Request processed in 408us (623us total) trans 4294983482 rc 0/0 00000100:00100000:0.0:1789395124.236993:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:1.0:1789395124.237349:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239647104:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1789395124.237453:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x166:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.237474:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237484:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237492:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237498:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.237502:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237510:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237530:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb6:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:0.0:1789395124.237533:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.237537:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 2/0,0 mode: --/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237544:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316a63a lrc: 0/0,0 mode: --/EX res: [0x240000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237563:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237571:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237578:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237632:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.237640:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xb6:0x0] 00010000:00010000:0.0:1789395124.237649:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237656:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237661:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237666:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.237670:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237681:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237689:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395124.237692:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395124.237695:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237701:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316a633 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237713:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237721:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.237729:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237757:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789395124.237762:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237775:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abc00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395124.237779:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.237787:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237811:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237817:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395124.237846:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237854:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316a641 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a648 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237867:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395124.237870:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237877:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395124.237882:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.237886:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00010000:1.0:1789395124.237889:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.237902:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239647232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.237912:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237919:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395124.237926:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 3/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.237939:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395124.237942:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395124.237947:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395124.237948:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.237956:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395124.237971:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239647360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.237973:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239647232 00000100:00100000:1.0:1789395124.237980:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239647232 00000100:00100000:2.0:1789395124.238010:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395124.238049:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789395124.238055:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab000/0xff35729af316a625 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a62c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395124.238075:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395124.238080:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.238087:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.238095:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.238105:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.238109:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1789395124.238114:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.238123:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.238129:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395124.238136:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.238145:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.238150:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.238158:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.238180:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.238187:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17656:x1876316231709184:12345-192.168.203.54@tcp:36:rm.0 Request processed in 41586us (42146us total) trans 4294968435 rc 0/0 00010000:00010000:3.0:1789395124.238194:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789395124.238200:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23444 00010000:00010000:3.0:1789395124.238218:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.238227:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca417200/0xff35729af316a609 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a610 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.238247:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.238249:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.238251:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.238257:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395124.238266:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239647488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.238293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.238437:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239647360 00000100:00100000:1.0:1789395124.238442:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239647360 00000100:00100000:2.0:1789395124.238454:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1789395124.238465:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+33:3637:x1876316239647232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.238482:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239647488 00000100:00100000:1.0:1789395124.238487:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239647488 00000100:00100000:2.0:1789395124.238491:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1789395124.238501:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+34:3636:x1876316239647360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.238510:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395124.238511:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1789395124.238518:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:1.0:1789395124.238525:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6282450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+34:3638:x1876316239647488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.238529:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:2.0:1789395124.238532:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316a62c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x166:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a625 expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.238540:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.238556:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x166:0x0].0x0 (ffff89a4c3ab8100) 00010000:00010000:1.0:1789395124.238557:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a610 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a609 expref: 33 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.238567:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395124.238574:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca2fb000) 00010000:00010000:1.0:1789395124.238584:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.238608:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+32:3636:x1876316239647360:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.238616:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1789395124.238629:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6282450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+31:3638:x1876316239647488:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.238639:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1789395124.238648:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239647488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395124.238655:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239647360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.238678:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.238702:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a648 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a641 expref: 30 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.238713:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb6:0x0].0x0 (ffff89a4fbb8e500) 00010000:00010000:2.0:1789395124.238720:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.238749:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+29:3637:x1876316239647232:12345-0@lo:103:ldlm_bl.0 Request processed in 288us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.238755:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1789395124.239092:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239647232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.243705:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.243891:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231709696 00000100:00100000:2.0:1789395124.243901:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231709696 00000100:00100000:2.0:1789395124.244070:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23445 00000100:00100000:2.0:1789395124.244081:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:17656:x1876316231709696:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1789395124.244109:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.244129:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316a64f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105dc6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395124.244279:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x25:0x0]: returning size 4096 00010000:00010000:2.0:1789395124.244371:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316a64f lrc: 1/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dc6 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.245126:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:2.0:1789395124.245133:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395124.245140:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316a64f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dc6 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.245155:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd600, rc 0) 00000100:00100000:2.0:1789395124.245217:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17656:x1876316231709696:12345-192.168.203.54@tcp:101:rm.0 Request processed in 1138us (1518us total) trans 4294968436 rc 301/301 00000100:00100000:2.0:1789395124.245225:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23445 00000100:00100000:0.0:1789395124.253056:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.253116:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231709952 00000100:00100000:1.0:1789395124.253219:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231709952 00000100:00100000:1.0:1789395124.253271:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5047 00000100:00100000:1.0:1789395124.253281:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17656:x1876316231709952:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:1.0:1789395124.253530:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:17656:x1876316231709952:12345-192.168.203.54@tcp:35:rm.0 Request processed in 249us (483us total) trans 4294968437 rc 0/0 00000100:00100000:1.0:1789395124.253538:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5047 00000100:00100000:3.0:1789395124.256728:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.256904:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231710208 00000100:00100000:1.0:1789395124.256913:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231710208 00000100:00100000:1.0:1789395124.257005:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23446 00000100:00100000:1.0:1789395124.257015:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:17656:x1876316231710208:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:1.0:1789395124.257101:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789395124.257136:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316a4ce lrc: 0/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105da3 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257164:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316a370 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d17 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257176:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:1.0:1789395124.257186:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395124.257207:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257219:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257227:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257238:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257246:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257252:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257313:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257320:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257327:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257343:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257352:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 27 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257359:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257440:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 27 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.257454:0:7813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 27 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.257473:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239647616:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395124.257548:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.270000:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.270123:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239647616:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.270151:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231710336 00010000:00010000:1.0:1789395124.270151:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.270169:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231710336 00010000:00010000:2.0:1789395124.270205:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 28 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.270242:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1548 00000100:00100000:2.0:1789395124.270250:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:2395:x1876316231710336:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.270263:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.270269:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 28 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270282:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 28 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270302:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ae00/0xff35729af316a37e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d1e expref: 28 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270323:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x16:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:2.0:1789395124.270328:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270337:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270345:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270371:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.270467:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2395:x1876316231710336:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 217us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.270475:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1548 00010000:00010000:3.0:1789395124.270527:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.270535:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.270578:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.270586:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.270597:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.270618:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6407480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239647744:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1789395124.270657:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.270684:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.270726:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239647744 00000100:00100000:2.0:1789395124.270730:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239647744 00000100:00100000:2.0:1789395124.270834:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:2.0:1789395124.270841:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:7813:x1876316239647744:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789395124.270858:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.270871:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a679 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270889:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270898:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 30 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270923:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.270935:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 41 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.270947:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239647872:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.270984:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.273711:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239647872:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395124.273740:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 30 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.273752:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:3.0:1789395124.273755:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395124.273759:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 30 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.273769:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 30 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.273777:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc200, rc 0) 00000100:00100000:3.0:1789395124.273857:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+30:7813:x1876316239647744:12345-0@lo:101:mdt00_003.0 Request processed in 3015us (3199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.273864:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00100000:1.0:1789395124.273924:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6407480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239647744:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395124.273941:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.273952:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.275850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.275922:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231710464 00000100:00100000:2.0:1789395124.275930:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231710464 00010000:00010000:2.0:1789395124.275966:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 42 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.276007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1549 00000100:00100000:2.0:1789395124.276028:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:2396:x1876316231710464:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.276042:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.276048:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 42 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.276060:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 42 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.276081:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316a38c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d25 expref: 42 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.276096:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:2.0:1789395124.276103:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.276113:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.276122:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.276151:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.276163:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239648000:0@lo:105: 00000100:00100000:2.0:1789395124.276202:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.276303:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.276825:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239648000 00000100:00100000:3.0:1789395124.276830:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239648000 00000100:00100000:3.0:1789395124.276895:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1789395124.276903:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239648000:12345-0@lo:105: 00010000:00010000:3.0:1789395124.276914:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.276929:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.276938:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.276945:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.276953:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.276961:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.276993:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca10cc00) 00000100:00100000:3.0:1789395124.277047:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6496:x1876316239648000:12345-0@lo:105: Request processed in 145us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.277054:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00010000:00010000:2.0:1789395124.277100:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.277110:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.277127:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6496:1876316239648000:0@lo:105: 00010000:00010000:0.0:1789395124.277143:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395124.277374:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:2396:x1876316231710464:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1357us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.277400:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1549 00000100:00100000:2.0:1789395124.277702:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239648128:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1789395124.277742:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.277765:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.277778:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239648128 00000100:00100000:0.0:1789395124.277784:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239648128 00000100:00100000:0.0:1789395124.277852:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188 00000100:00100000:0.0:1789395124.277860:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+30:7813:x1876316239648128:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1789395124.279359:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+30:7813:x1876316239648128:12345-0@lo:403:mdt00_003.0 Request processed in 1497us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.279371:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188 00000100:00100000:2.0:1789395124.279545:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239648128:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1789395124.280685:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].388, 952 off580176 00000040:00080000:2.0:1789395124.280843:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].388, 1032 off634104 00000004:00080000:2.0:1789395124.280848:0:7813:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca356f00 with version 734 00000004:00080000:1.0:1789395124.280925:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 734 rpc_version 734 00000020:00100000:1.0:1789395124.280951:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395124.280959:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d8354a80 x1876316239648384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395124.280979:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239648384:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395124.281039:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.281106:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.281141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239648384 00000100:00100000:3.0:1789395124.281147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239648384 00000100:00100000:3.0:1789395124.281190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:3.0:1789395124.281198:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+30:7455:x1876316239648384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395124.281365:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+31:7455:x1876316239648384:12345-0@lo:1000:osp_up0-1.0 Request processed in 163us (322us total) trans 4294983483 rc 0/0 00000100:00100000:3.0:1789395124.281373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:1.0:1789395124.281447:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239648384:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1789395124.281482:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x25:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.281503:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281514:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281522:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281528:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.281533:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281542:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281556:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x16:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:0.0:1789395124.281560:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.281565:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281572:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416400/0xff35729af316a672 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281594:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281603:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281617:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281642:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.281649:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x16:0x0] 00010000:00010000:2.0:1789395124.281658:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395124.281661:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281666:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281669:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281682:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395124.281685:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281689:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281697:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.281707:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395124.281708:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281721:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281732:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff89a4c3ab8600) 00010000:00010000:0.0:1789395124.281735:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.281738:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281740:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281750:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416600/0xff35729af316a66b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281754:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395124.281772:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281780:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281787:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281793:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.281798:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789395124.281799:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.281804:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281810:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281815:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281818:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c3ab8b00) 00010000:00010000:0.0:1789395124.281825:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395124.281830:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.281831:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10cc00/0xff35729af316a679 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a680 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281847:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca416c00/0xff35729af316a65d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395124.281858:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000835bdff7 reply state 0000000057cac4a4 transno 4294968438 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281869:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.281876:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5fcc6f89 (ffff89a4c3ab8400) 00010000:00010000:0.0:1789395124.281879:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395124.281881:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395124.281940:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:17656:x1876316231710208:12345-192.168.203.54@tcp:36:rm.0 Request processed in 24925us (25218us total) trans 4294968438 rc 0/0 00000100:00100000:0.0:1789395124.281947:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23446 00000100:00100000:3.0:1789395124.281992:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239648512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.282032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.282095:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239648512 00000100:00100000:0.0:1789395124.282101:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239648512 00010000:00010000:2.0:1789395124.282102:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395124.282105:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395124.282107:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395124.282140:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1789395124.282148:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+31:3638:x1876316239648512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.282164:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.282179:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a680 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a679 expref: 31 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.282192:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:0.0:1789395124.282198:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395124.282229:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+30:3638:x1876316239648512:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.282235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1789395124.282260:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239648512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.286102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.286135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231710720 00000100:00100000:0.0:1789395124.286145:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231710720 00000100:00100000:0.0:1789395124.286201:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23447 00000100:00100000:0.0:1789395124.286210:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:17656:x1876316231710720:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1789395124.286231:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395124.286250:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105dcd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395124.286430:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x142e:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.286515:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a687 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dcd expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.286531:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:0.0:1789395124.286534:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395124.286540:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dcd expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.286552:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aac00, rc 0) 00000100:00100000:0.0:1789395124.286613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17656:x1876316231710720:12345-192.168.203.54@tcp:101:rm.0 Request processed in 405us (520us total) trans 4294983484 rc 301/301 00000100:00100000:0.0:1789395124.286620:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23447 00000100:00100000:2.0:1789395124.291742:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.291823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231710976 00000100:00100000:1.0:1789395124.291832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231710976 00000100:00100000:1.0:1789395124.291917:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5048 00000100:00100000:1.0:1789395124.291928:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17656:x1876316231710976:12345-192.168.203.54@tcp:35:rm.0 00000040:00080000:1.0:1789395124.292476:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].392, 344 off590168 00000040:00080000:1.0:1789395124.292531:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].389, 424 off643256 00000004:00080000:1.0:1789395124.292537:0:6514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca181e40 with version 736 00000004:00080000:2.0:1789395124.293026:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 736 rpc_version 736 00000020:00100000:2.0:1789395124.293055:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395124.293064:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d4000 x1876316239648768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395124.294064:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239648768:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395124.294129:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.294167:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.294198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239648768 00000100:00100000:1.0:1789395124.294206:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239648768 00000100:00100000:1.0:1789395124.294255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:1.0:1789395124.294263:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239648768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.294538:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239648768:12345-0@lo:1000:osp_up1-0.0 Request processed in 275us (408us total) trans 4294968439 rc 0/0 00000100:00100000:1.0:1789395124.294546:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:2.0:1789395124.296874:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239648768:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.297241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231710976:12345-192.168.203.54@tcp:35:rm.0 Request processed in 5312us (5505us total) trans 4294983485 rc 0/0 00000100:00100000:1.0:1789395124.297252:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5048 00000100:00100000:1.0:1789395124.300701:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.300778:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231711104 00000100:00100000:3.0:1789395124.300788:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231711104 00000100:00100000:3.0:1789395124.300847:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1309 00000100:00100000:3.0:1789395124.300856:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:2395:x1876316231711104:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:3.0:1789395124.300870:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.300891:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316a220 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c8b expref: 28 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.300909:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:3.0:1789395124.300919:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.300972:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2395:x1876316231711104:12345-192.168.203.54@tcp:103:rm.0 Request processed in 117us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.300979:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1309 00000100:00100000:3.0:1789395124.303473:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.304455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231711360 00000100:00100000:2.0:1789395124.304466:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231711360 00000100:00100000:2.0:1789395124.304535:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23448 00000100:00100000:2.0:1789395124.304546:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231711360:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395124.304603:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.304626:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316a23c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x142e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105c99 expref: 43 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.304647:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395124.304658:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395124.304702:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.304711:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.304720:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.304750:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239648896:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1789395124.304801:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.304833:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.304840:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239648896 00000100:00100000:3.0:1789395124.305029:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239648896 00000100:00100000:3.0:1789395124.305109:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:3.0:1789395124.305117:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6513:x1876316239648896:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395124.305128:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395124.305143:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316a69c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a695 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.305164:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316a69c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a695 expref: 18 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.305179:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316a69c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a695 expref: 18 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.305187:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:3.0:1789395124.305190:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395124.305192:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d000, rc 0) 00000100:00100000:3.0:1789395124.305234:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:6513:x1876316239648896:12345-0@lo:101:mdt00_002.0 Request processed in 118us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.305241:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:2.0:1789395124.305268:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239648896:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395124.305284:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.305301:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395124.305317:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1789395124.305335:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.305343:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.305350:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.305361:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649024:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1789395124.305418:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.305436:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.305440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239649024 00000100:00100000:1.0:1789395124.305446:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239649024 00000100:00100000:1.0:1789395124.305470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:1.0:1789395124.305489:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:6513:x1876316239649024:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395124.305498:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.305511:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316a6aa lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a6a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.305526:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316a6aa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a6a3 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.305536:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316a6aa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6a3 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.305544:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xa04846ca (ffff89a4c3ab8a00) 00010000:00010000:1.0:1789395124.305546:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.305548:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0600, rc 0) 00000100:00100000:1.0:1789395124.305583:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6513:x1876316239649024:12345-0@lo:101:mdt00_002.0 Request processed in 103us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.305589:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00100000:2.0:1789395124.305679:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649024:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395124.305692:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.305701:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395124.305713:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1789395124.305740:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649152:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395124.305794:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.305815:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.305853:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239649152 00000100:00100000:1.0:1789395124.305858:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239649152 00000100:00100000:1.0:1789395124.305886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193 00000100:00100000:1.0:1789395124.305892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6513:x1876316239649152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395124.305952:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6513:x1876316239649152:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.305959:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193 00000100:00100000:2.0:1789395124.305991:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649152:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395124.306036:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649280:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395124.306056:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.306111:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.306152:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239649280 00000100:00100000:0.0:1789395124.306157:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239649280 00000100:00100000:0.0:1789395124.306190:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3194 00000100:00100000:0.0:1789395124.306196:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6513:x1876316239649280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395124.306309:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6513:x1876316239649280:12345-0@lo:1000:mdt00_002.0 Request processed in 112us (251us total) trans 0 rc 1/1 00000100:00100000:0.0:1789395124.306317:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3194 00000100:00100000:2.0:1789395124.306523:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649280:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789395124.306564:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.306571:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.306579:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.306589:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649408:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1789395124.306611:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.306627:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.306995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239649408 00000100:00100000:3.0:1789395124.307000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239649408 00000100:00100000:3.0:1789395124.307039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:3.0:1789395124.307046:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6513:x1876316239649408:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395124.307055:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395124.307068:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a6b8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a6b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.307086:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a6b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a6b1 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.307097:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a6b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6b1 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.307105:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:3.0:1789395124.307107:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395124.307110:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ce00, rc 0) 00000100:00100000:3.0:1789395124.307152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:6513:x1876316239649408:12345-0@lo:101:mdt00_002.0 Request processed in 106us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.307166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00100000:2.0:1789395124.307259:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649408:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395124.307273:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307283:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307304:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307312:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307320:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307336:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307347:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 42 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307356:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307374:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 42 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.307407:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 42 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.307419:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239649536:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.307475:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.310205:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239649536:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395124.310231:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.311537:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.311615:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231711488 00000100:00100000:1.0:1789395124.311622:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231711488 00010000:00010000:1.0:1789395124.311656:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.311726:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1550 00000100:00100000:1.0:1789395124.311734:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:2395:x1876316231711488:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.311747:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.311754:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.311766:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.311786:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316a24a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca0 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.311800:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x55:0x0].0x0 (ffff89a4fbb8ec00) 00010000:00010000:1.0:1789395124.311805:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.311814:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.311821:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.311853:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.311903:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:2395:x1876316231711488:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 169us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.311910:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1550 00010000:00010000:2.0:1789395124.312061:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.312070:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.312109:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 3/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.312116:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 3/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.312125:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 3/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.312141:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649664:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1789395124.312178:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.312207:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.312527:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239649664 00000100:00100000:3.0:1789395124.312532:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239649664 00000100:00100000:3.0:1789395124.312571:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:3.0:1789395124.312578:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:6513:x1876316239649664:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395124.312591:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395124.312605:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a6cd expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.312625:0:20561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.312634:0:20561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.312654:0:20561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.312665:0:20561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 26 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.312676:0:20561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239649792:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395124.312721:0:20561:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.315597:0:20561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239649792:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395124.315629:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.315642:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x55:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:0.0:1789395124.315646:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.315649:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.315660:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.315668:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:0.0:1789395124.315723:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6513:x1876316239649664:12345-0@lo:101:mdt00_002.0 Request processed in 3146us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.315732:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:2.0:1789395124.315814:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239649664:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395124.315830:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 4/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.315842:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 4/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.318310:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.318807:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231711616 00000100:00100000:0.0:1789395124.318816:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231711616 00010000:00010000:0.0:1789395124.318907:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 27 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.318975:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1551 00000100:00100000:0.0:1789395124.318985:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2396:x1876316231711616:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.318999:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.319005:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 27 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319028:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 27 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319049:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316a258 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ca7 expref: 27 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319071:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x55:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:0.0:1789395124.319077:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 20 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319088:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 20 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319098:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 20 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319128:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 20 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.319140:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a48e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239649920:0@lo:105: 00000100:00100000:0.0:1789395124.319184:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.319224:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d3dfb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.319273:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239649920 00000100:00100000:2.0:1789395124.319277:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239649920 00000100:00100000:2.0:1789395124.319313:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1789395124.319320:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239649920:12345-0@lo:105: 00010000:00010000:2.0:1789395124.319329:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 5/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.319339:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 5/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.319348:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 5/0,1 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.319356:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.319363:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.319370:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.319416:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3cd000) 00000100:00100000:2.0:1789395124.319453:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6497:x1876316239649920:12345-0@lo:105: Request processed in 134us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.319459:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1789395124.319499:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a48e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6497:1876316239649920:0@lo:105: 00010000:00010000:2.0:1789395124.319518:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.319555:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2396:x1876316231711616:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 572us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.319562:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1551 00010000:00010000:0.0:1789395124.319614:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.319624:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.320375:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239650048:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395124.320448:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.320469:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d3dfb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.320697:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650048 00000100:00100000:2.0:1789395124.320703:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650048 00000100:00100000:2.0:1789395124.320743:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1789395124.320751:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6513:x1876316239650048:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1789395124.322280:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6513:x1876316239650048:12345-0@lo:403:mdt00_002.0 Request processed in 1526us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.322290:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:0.0:1789395124.323359:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239650048:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1789395124.324584:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].393, 952 off591120 00000040:00080000:0.0:1789395124.324812:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].390, 1032 off644288 00000004:00080000:0.0:1789395124.324818:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4d3dfb0c0 with version 737 00000004:00080000:2.0:1789395124.325044:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 737 rpc_version 737 00000020:00100000:2.0:1789395124.325074:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395124.325083:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6d80 x1876316239650304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395124.325105:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239650304:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395124.325159:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.325193:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.325268:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650304 00000100:00100000:1.0:1789395124.325275:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650304 00000100:00100000:1.0:1789395124.325321:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1789395124.325329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:7874:x1876316239650304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.325767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:7874:x1876316239650304:12345-0@lo:1000:osp_up1-0.0 Request processed in 438us (607us total) trans 4294968440 rc 0/0 00000100:00100000:1.0:1789395124.325776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:2.0:1789395124.326027:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239650304:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1789395124.326130:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x142e:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.326150:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326161:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326169:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326176:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.326181:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326189:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326204:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x55:0x0].0x0 (ffff89a4fbb8ec00) 00010000:00010000:0.0:1789395124.326207:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.326212:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326219:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316a6c6 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326241:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326249:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326257:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326278:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.326285:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x55:0x0] 00010000:00010000:0.0:1789395124.326292:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326298:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326304:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326310:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.326313:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326318:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326326:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a3ca2fb300) 00010000:00010000:0.0:1789395124.326328:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395124.326331:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326337:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a6bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326349:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326357:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326364:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326592:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1789395124.326602:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395124.326608:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326616:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.326622:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326712:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789395124.326719:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326726:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.326731:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.326740:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326766:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 2/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326772:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.326797:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 1/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326805:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316a6cd lrc: 0/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326820:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789395124.326823:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326829:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.326833:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.326840:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326863:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326869:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.326874:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326881:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316a6b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326893:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395124.326896:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326902:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cdc00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395124.326905:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395124.326911:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326923:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326929:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395124.326945:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.326958:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.326960:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395124.326962:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395124.326973:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239650560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.327013:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.327052:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395124.327058:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239650432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.327077:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.327099:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650560 00000100:00100000:3.0:1789395124.327103:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650560 00000100:00100000:3.0:1789395124.327131:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650432 00000100:00100000:3.0:1789395124.327134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650432 00000100:00100000:3.0:1789395124.327148:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1789395124.327154:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6283050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+23:3637:x1876316239650560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.327164:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.327179:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a6b8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x142e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a6b1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.327189:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x142e:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:3.0:1789395124.327197:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.327221:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6283050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+22:3637:x1876316239650560:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.327227:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1789395124.327259:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1789395124.327265:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+21:3637:x1876316239650432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.327271:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.327280:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6d4 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a6cd expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.327288:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x55:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:3.0:1789395124.327294:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.327311:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+20:3637:x1876316239650432:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.327317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1789395124.327340:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239650432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395124.327353:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239650560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.327792:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395124.327802:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789395124.327810:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:1.0:1789395124.327813:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239650688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.327819:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cdc00/0xff35729af316a695 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a69c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395124.327843:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395124.327848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.327905:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650688 00000100:00100000:0.0:1789395124.327911:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650688 00010000:00010000:3.0:1789395124.327945:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395124.327952:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:0.0:1789395124.327960:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239650688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.327969:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.327982:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316a69c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a695 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.327995:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:0.0:1789395124.328003:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395124.328050:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+19:3639:x1876316239650688:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.328058:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1789395124.328077:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239650688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.328082:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.328093:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.328293:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17656:x1876316231711360:12345-192.168.203.54@tcp:36:rm.0 Request processed in 23612us (24689us total) trans 4294983486 rc 0/0 00000100:00100000:0.0:1789395124.328302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23448 00000100:00100000:3.0:1789395124.335167:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.335227:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231711872 00000100:00100000:0.0:1789395124.335237:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231711872 00000100:00100000:0.0:1789395124.335294:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23449 00000100:00100000:0.0:1789395124.335303:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:17656:x1876316231711872:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1789395124.335329:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395124.335349:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a6db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105dd4 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395124.335532:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x146e:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.335618:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a6db lrc: 1/0,0 mode: --/CR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dd4 expref: 44 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.335639:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a3ca2fbe00) 00010000:00010000:0.0:1789395124.335642:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395124.335648:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316a6db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dd4 expref: 44 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.335661:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa400, rc 0) 00000100:00100000:0.0:1789395124.335722:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231711872:12345-192.168.203.54@tcp:101:rm.0 Request processed in 420us (565us total) trans 4294983487 rc 301/301 00000100:00100000:0.0:1789395124.335730:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23449 00000100:00100000:3.0:1789395124.348658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.348810:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231712128 00000100:00100000:1.0:1789395124.348820:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231712128 00000100:00100000:1.0:1789395124.348957:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5049 00000100:00100000:1.0:1789395124.348966:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231712128:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:1.0:1789395124.349192:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231712128:12345-192.168.203.54@tcp:35:rm.0 Request processed in 226us (542us total) trans 4294983488 rc 0/0 00000100:00100000:1.0:1789395124.349199:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5049 00000100:00100000:2.0:1789395124.357782:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.357858:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231712256 00000100:00100000:3.0:1789395124.357868:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231712256 00000100:00100000:3.0:1789395124.357926:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1313 00000100:00100000:3.0:1789395124.357936:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2395:x1876316231712256:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:3.0:1789395124.357950:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.357972:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316a274 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cae expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.357991:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a3ca2fbc00) 00010000:00010000:3.0:1789395124.358001:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.358068:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:2395:x1876316231712256:12345-192.168.203.54@tcp:103:rm.0 Request processed in 133us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.358075:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1313 00000100:00100000:0.0:1789395124.359592:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.359647:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231712512 00000100:00100000:2.0:1789395124.359655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231712512 00000100:00100000:2.0:1789395124.359710:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23450 00000100:00100000:2.0:1789395124.359718:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231712512:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395124.359766:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.359786:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316a290 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cbc expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.359803:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a3ca2fbe00) 00010000:00010000:2.0:1789395124.359811:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395124.359852:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.359860:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.359869:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.359888:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239650816:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1789395124.359929:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.359955:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.360044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650816 00000100:00100000:3.0:1789395124.360049:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650816 00000100:00100000:3.0:1789395124.360084:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:3.0:1789395124.360091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6512:x1876316239650816:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395124.360104:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395124.360119:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6f0 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a6e9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.360141:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6f0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a6e9 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.360154:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6f0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6e9 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.360162:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:3.0:1789395124.360165:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395124.360168:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:3.0:1789395124.360209:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:6512:x1876316239650816:12345-0@lo:101:mdt00_001.0 Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.360215:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:2.0:1789395124.360806:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239650816:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395124.360822:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.360833:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395124.360852:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1789395124.360872:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.360879:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.360887:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.360899:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239650944:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1789395124.360924:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.360947:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.361804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239650944 00000100:00100000:1.0:1789395124.361810:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239650944 00000100:00100000:1.0:1789395124.361845:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1789395124.361851:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:6512:x1876316239650944:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395124.361862:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.361877:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316a6fe lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a6f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.361897:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316a6fe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a6f7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.361908:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316a6fe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a6f7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.361916:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x55d495e6 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395124.361919:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.361922:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395124.361968:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6512:x1876316239650944:12345-0@lo:101:mdt00_001.0 Request processed in 117us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.361974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:2.0:1789395124.362047:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239650944:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395124.362060:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.362074:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395124.362090:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1789395124.362122:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651072:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395124.362148:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.362170:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.362287:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239651072 00000100:00100000:0.0:1789395124.362292:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239651072 00000100:00100000:0.0:1789395124.362323:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:0.0:1789395124.362329:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6512:x1876316239651072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395124.362413:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6512:x1876316239651072:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.362420:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:2.0:1789395124.362486:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651072:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395124.362521:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651200:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395124.362543:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.362564:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.362606:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239651200 00000100:00100000:0.0:1789395124.362610:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239651200 00000100:00100000:0.0:1789395124.362637:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202 00000100:00100000:0.0:1789395124.362643:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6512:x1876316239651200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395124.362723:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6512:x1876316239651200:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (180us total) trans 0 rc 1/1 00000100:00100000:0.0:1789395124.362730:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202 00000100:00100000:0.0:1789395124.362752:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651200:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789395124.362790:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.362798:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.362806:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.362815:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651328:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395124.362836:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.362848:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.362858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239651328 00000100:00100000:0.0:1789395124.362861:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239651328 00000100:00100000:0.0:1789395124.362875:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:0.0:1789395124.362879:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6512:x1876316239651328:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395124.362886:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395124.362897:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316a70c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a705 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.362912:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316a70c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a705 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.362922:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316a70c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a705 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.362929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395124.362932:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395124.362935:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa400, rc 0) 00000100:00100000:0.0:1789395124.362958:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:6512:x1876316239651328:12345-0@lo:101:mdt00_001.0 Request processed in 78us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.362964:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:0.0:1789395124.362983:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651328:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395124.362993:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363001:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363031:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363040:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363048:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363062:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363073:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 43 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363082:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 4/0,1 mode: --/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363100:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 43 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.363117:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.363127:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1876316239651456:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395124.363178:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.372609:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.372676:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231712640 00000100:00100000:1.0:1789395124.372685:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231712640 00010000:00010000:1.0:1789395124.372730:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 44 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.372772:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1552 00000100:00100000:1.0:1789395124.372781:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2395:x1876316231712640:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.372794:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.372800:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 44 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.372813:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 44 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.372834:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x75:0x0].0x0 (ffff89a4fbb8e600) 00010000:00010000:1.0:1789395124.372839:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.372849:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.372856:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.372874:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.372925:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2395:x1876316231712640:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 145us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.372933:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1552 00010000:00010000:2.0:1789395124.373068:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316a29e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cc3 expref: 43 pid: 7813 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.373084:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1876316239651456:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395124.373105:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.373114:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.373120:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.373157:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.373169:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.373178:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.373194:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651584:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1789395124.373230:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.373261:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.373300:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239651584 00000100:00100000:1.0:1789395124.373304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239651584 00000100:00100000:1.0:1789395124.373335:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1789395124.373342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:6512:x1876316239651584:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395124.373354:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.373367:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a721 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.373418:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.373428:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.373449:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.373462:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 24 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.373473:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8357800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6517:1876316239651712:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395124.373508:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.376253:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8357800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6517:1876316239651712:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395124.376287:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.376306:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x75:0x0].0x0 (ffff89a4fbb8e300) 00010000:00010000:1.0:1789395124.376309:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.376313:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.376323:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.376330:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0e00, rc 0) 00000100:00100000:1.0:1789395124.376382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:6512:x1876316239651584:12345-0@lo:101:mdt00_001.0 Request processed in 3040us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.376435:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:2.0:1789395124.376546:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651584:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395124.376563:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.376573:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.378949:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.379027:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231712768 00000100:00100000:2.0:1789395124.379036:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231712768 00010000:00010000:2.0:1789395124.379072:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 25 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.379112:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1553 00000100:00100000:2.0:1789395124.379121:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:2396:x1876316231712768:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.379134:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.379141:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 25 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.379159:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 25 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.379179:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316a2ac lrc: 0/0,0 mode: --/PR res: [0x240000401:0x75:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105cca expref: 25 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.379195:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x75:0x0].0x0 (ffff89a4fbb8e300) 00010000:00010000:2.0:1789395124.379202:0:20671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.379214:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.379222:0:20671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.379252:0:20671:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.379265:0:20671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:20671:1876316239651840:0@lo:105: 00000100:00100000:2.0:1789395124.379304:0:20671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.379340:0:20671:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.379612:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239651840 00000100:00100000:3.0:1789395124.379617:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239651840 00000100:00100000:3.0:1789395124.379647:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1789395124.379654:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:20671:x1876316239651840:12345-0@lo:105: 00010000:00010000:3.0:1789395124.379665:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.379674:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.379684:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.379957:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.379967:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.379976:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.379999:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3cd600) 00010000:00010000:2.0:1789395124.380099:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.380109:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.380719:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651968:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1789395124.380761:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.380779:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.380980:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:20671:x1876316239651840:12345-0@lo:105: Request processed in 1325us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.380989:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1789395124.381091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239651968 00000100:00100000:1.0:1789395124.381097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239651968 00000100:00100000:1.0:1789395124.381132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205 00000100:00100000:1.0:1789395124.381140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+23:6512:x1876316239651968:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395124.382586:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+23:6512:x1876316239651968:12345-0@lo:403:mdt00_001.0 Request processed in 1443us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.382595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205 00000100:00100000:2.0:1789395124.387006:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239651968:0@lo:403:mdt00_001.0 00000040:00080000:2.0:1789395124.387892:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].394, 952 off592072 00000040:00080000:2.0:1789395124.388065:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].391, 1032 off645320 00000004:00080000:2.0:1789395124.388071:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34fd80 with version 738 00000004:00080000:1.0:1789395124.389795:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 738 rpc_version 738 00000020:00100000:1.0:1789395124.389834:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395124.389843:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d8357800 x1876316239652224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395124.389867:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8357800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239652224:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.389927:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.389958:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.390519:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652224 00000100:00100000:2.0:1789395124.390528:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652224 00000100:00100000:2.0:1789395124.390584:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:2.0:1789395124.390592:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+23:7874:x1876316239652224:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395124.390763:0:20671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:20671:1876316239651840:0@lo:105: 00010000:00010000:0.0:1789395124.390795:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395124.390854:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2396:x1876316231712768:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 11731us (11911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.390865:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1553 00000100:00100000:2.0:1789395124.394124:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+24:7874:x1876316239652224:12345-0@lo:1000:osp_up1-0.0 Request processed in 3525us (4188us total) trans 4294968441 rc 0/0 00000100:00100000:2.0:1789395124.394139:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:3.0:1789395124.399050:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8357800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239652224:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1789395124.400516:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x146e:0x0]: returning size 4096 00010000:00010000:2.0:1789395124.400547:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400558:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400565:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400570:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395124.400574:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400586:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400601:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x75:0x0].0x0 (ffff89a4fbb8e600) 00010000:00010000:2.0:1789395124.400605:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395124.400609:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 2/0,0 mode: --/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400614:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316a71a lrc: 0/0,0 mode: --/EX res: [0x200000400:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400640:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400648:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400654:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400693:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395124.400703:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x75:0x0] 00010000:00010000:2.0:1789395124.400714:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400720:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400726:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400737:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395124.400740:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400746:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400755:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:2.0:1789395124.400757:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395124.400760:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400766:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316a713 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400786:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400794:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400801:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400823:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1789395124.400835:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1789395124.400840:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400851:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400858:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400886:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1789395124.400890:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1789395124.400895:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.400903:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.400997:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231712512:12345-192.168.203.54@tcp:36:rm.0 Request processed in 41276us (41409us total) trans 4294983489 rc 0/0 00000100:00100000:2.0:1789395124.401006:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23450 00010000:00010000:0.0:1789395124.401070:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789395124.401078:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401088:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395124.401093:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395124.401102:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401135:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401147:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395124.401175:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401183:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd600/0xff35729af316a721 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a728 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.401192:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239652352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.401198:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395124.401203:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401210:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395124.401214:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395124.401221:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401238:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401245:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789395124.401253:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395124.401258:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401268:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab400/0xff35729af316a705 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a70c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401287:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395124.401290:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401297:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc200 already unused, calling callback (ffffffffc1969ee0) 00000100:00100000:2.0:1789395124.401299:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239652480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.401302:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395124.401312:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401328:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401336:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789395124.401339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395124.401344:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.401352:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316a6e9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6f0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.401363:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789395124.401365:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395124.401369:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395124.401371:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395124.401373:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239652608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.401517:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395124.401531:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652352 00000100:00100000:3.0:1789395124.401538:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652352 00000100:00100000:3.0:1789395124.401581:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652480 00000100:00100000:3.0:1789395124.401583:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652480 00000100:00100000:3.0:1789395124.401601:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1789395124.401608:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+25:3639:x1876316239652352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.401620:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.401635:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316a728 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a721 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.401647:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x75:0x0].0x0 (ffff89a4fbb8e300) 00010000:00010000:3.0:1789395124.401655:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.401685:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+24:3639:x1876316239652352:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.401702:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1789395124.401715:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1789395124.401721:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6283450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+23:3636:x1876316239652480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.401728:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.401736:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316a70c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a705 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.401746:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:3.0:1789395124.401752:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395124.401771:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6283450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+22:3636:x1876316239652480:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.401777:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00010000:00010000:1.0:1789395124.401909:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395124.402441:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239652736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395124.402453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.402478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.402512:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239652480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.402528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652736 00000100:00100000:1.0:1789395124.402533:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652736 00000100:00100000:2.0:1789395124.402569:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239652352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.402575:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:1.0:1789395124.402585:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:3638:x1876316239652736:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395124.402595:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652608 00000100:00100000:2.0:1789395124.402600:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652608 00000004:00000024:1.0:1789395124.402616:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395124.402636:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1789395124.402645:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+23:3636:x1876316239652608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.402655:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395124.402657:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+23:3638:x1876316239652736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.402665:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00010000:00010000:2.0:1789395124.402673:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316a6f0 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a6e9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.402690:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4fbb8e800) 00010000:00010000:2.0:1789395124.402699:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.402710:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239652736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395124.402736:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+21:3636:x1876316239652608:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.402742:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1789395124.402768:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239652608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395124.403612:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395124.403623:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239652992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395124.403656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395124.403685:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652992 00000100:00100000:2.0:1789395124.403689:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652992 00000100:00100000:2.0:1789395124.403718:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789395124.403726:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239652992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395124.403747:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395124.403913:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239652992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.403921:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789395124.403958:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239652992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395124.404760:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239652864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395124.404794:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.404926:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395124.404933:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239653248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395124.404940:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239653120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395124.404965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.404985:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.405000:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239652864 00000100:00100000:1.0:1789395124.405005:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239652864 00000100:00100000:1.0:1789395124.405039:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653248 00000100:00100000:1.0:1789395124.405042:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653248 00000100:00100000:1.0:1789395124.405051:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653120 00000100:00100000:1.0:1789395124.405053:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653120 00000100:00100000:1.0:1789395124.405063:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789395124.405069:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239652864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395124.405090:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395124.405117:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239652864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.405124:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789395124.405135:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789395124.405140:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239653248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395124.405148:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395124.405181:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239653248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.405186:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789395124.405195:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789395124.405201:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239653120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395124.405210:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395124.405233:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239653120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.405238:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789395124.405266:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239652864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395124.407129:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239653248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395124.407165:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239653120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395124.409104:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.409172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231713024 00000100:00100000:2.0:1789395124.409181:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231713024 00000100:00100000:2.0:1789395124.409232:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23451 00000100:00100000:2.0:1789395124.409241:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231713024:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1789395124.409262:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.409281:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a72f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ddb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395124.409444:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13c0:0x0]: returning size 4096 00010000:00010000:2.0:1789395124.409529:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a72f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ddb expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.409544:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f300) 00010000:00010000:2.0:1789395124.409548:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395124.409553:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a72f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ddb expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.409567:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd400, rc 0) 00000100:00100000:2.0:1789395124.409623:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231713024:12345-192.168.203.54@tcp:101:rm.0 Request processed in 383us (526us total) trans 4294983490 rc 301/301 00000100:00100000:2.0:1789395124.409630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23451 00000100:00100000:2.0:1789395124.422665:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.422831:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231713280 00000100:00100000:1.0:1789395124.422840:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231713280 00000100:00100000:1.0:1789395124.422991:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5050 00000100:00100000:1.0:1789395124.423001:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231713280:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:1.0:1789395124.423212:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231713280:12345-192.168.203.54@tcp:35:rm.0 Request processed in 212us (554us total) trans 4294983491 rc 0/0 00000100:00100000:1.0:1789395124.423220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5050 00000100:00100000:3.0:1789395124.428725:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395124.429081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.429522:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231713664 00000100:00100000:1.0:1789395124.429532:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231713664 00000100:00100000:1.0:1789395124.429624:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23452 00000100:00100000:1.0:1789395124.429634:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231713664:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:1.0:1789395124.429687:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.429711:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316a418 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d5d expref: 45 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.429731:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f300) 00010000:00010000:1.0:1789395124.429740:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395124.429787:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.429795:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.429805:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.429825:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653376:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1789395124.429869:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.429909:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349540 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.430054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653376 00000100:00100000:3.0:1789395124.430058:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653376 00000100:00100000:3.0:1789395124.430093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:3.0:1789395124.430100:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:7813:x1876316239653376:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789395124.430109:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395124.430123:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a744 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a73d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.430155:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a744 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a73d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.430168:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a744 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a73d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.430176:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363600) 00010000:00010000:3.0:1789395124.430179:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395124.430181:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ce00, rc 0) 00000100:00100000:3.0:1789395124.430216:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:7813:x1876316239653376:12345-0@lo:101:mdt00_003.0 Request processed in 117us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.430222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:1.0:1789395124.430463:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653376:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395124.430814:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.430828:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395124.430883:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395124.430907:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.430915:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.430927:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.430940:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653504:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1789395124.430965:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.430995:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.431010:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653504 00000100:00100000:1.0:1789395124.431013:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653504 00000100:00100000:1.0:1789395124.431052:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:1.0:1789395124.431058:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+22:7813:x1876316239653504:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395124.431066:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.431078:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a752 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a74b expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431092:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a752 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a74b expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431103:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a752 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a74b expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431111:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb228bbb0 (ffff89a4c7eb6e00) 00010000:00010000:1.0:1789395124.431113:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.431115:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1400, rc 0) 00000100:00100000:1.0:1789395124.431152:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+23:7813:x1876316239653504:12345-0@lo:101:mdt00_003.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.431158:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:1.0:1789395124.431181:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653504:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395124.431191:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431199:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395124.431210:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1789395124.431246:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653632:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395124.431268:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.431282:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.431294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653632 00000100:00100000:1.0:1789395124.431297:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653632 00000100:00100000:1.0:1789395124.431312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1789395124.431317:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:7813:x1876316239653632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395124.431366:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:7813:x1876316239653632:12345-0@lo:1000:mdt00_003.0 Request processed in 49us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.431373:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1789395124.431422:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653632:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395124.431453:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395124.431472:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.431501:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.431514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653760 00000100:00100000:1.0:1789395124.431517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653760 00000100:00100000:1.0:1789395124.431533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1789395124.431539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:7813:x1876316239653760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395124.431607:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:7813:x1876316239653760:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (134us total) trans 0 rc 1/1 00000100:00100000:1.0:1789395124.431614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1789395124.431634:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653760:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789395124.431666:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431673:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431681:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.431691:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653888:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1789395124.431709:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.431720:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.431729:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239653888 00000100:00100000:1.0:1789395124.431731:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239653888 00000100:00100000:1.0:1789395124.431745:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212 00000100:00100000:1.0:1789395124.431750:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:7813:x1876316239653888:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395124.431756:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.431765:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a759 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431781:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431790:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431814:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.431826:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 23 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.431836:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6517:1876316239654016:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395124.431884:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00010000:00010000:1.0:1789395124.434910:0:6517:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@0000000054948113 x1876316239654016) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 23 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.434934:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 23 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.434956:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316a3fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d4f expref: 23 pid: 6511 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.434972:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6517:1876316239654016:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395124.434991:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:1.0:1789395124.434997:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435007:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435035:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435068:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.435080:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6517:1876316239654144:0@lo:105: 00000100:00100000:1.0:1789395124.435119:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.435252:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349180 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.435328:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239654144 00000100:00100000:3.0:1789395124.435335:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239654144 00000100:00100000:3.0:1789395124.435439:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1789395124.435448:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6517:x1876316239654144:12345-0@lo:105: 00010000:00010000:3.0:1789395124.435459:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.435469:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.435486:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.435495:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.435502:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.435510:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.435523:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca0e1200) 00000100:00100000:3.0:1789395124.435561:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6517:x1876316239654144:12345-0@lo:105: Request processed in 114us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395124.435568:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1789395124.435626:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6517:1876316239654144:0@lo:105: 00010000:00010000:1.0:1789395124.435642:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435651:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:1.0:1789395124.435654:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395124.435656:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:1.0:1789395124.435687:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+24:7813:x1876316239653888:12345-0@lo:101:mdt00_003.0 Request processed in 3937us (3977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.435694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00000100:00100000:1.0:1789395124.435728:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239653888:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395124.435740:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435770:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435783:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435792:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435809:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: --/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435818:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435825:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 4/0,1 mode: --/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435845:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.435856:0:7813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 44 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.435867:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239654272:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395124.435910:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.437349:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231713408 00000100:00100000:0.0:1789395124.437359:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231713408 00000100:00100000:0.0:1789395124.438079:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1317 00000100:00100000:0.0:1789395124.438092:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2396:x1876316231713408:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:0.0:1789395124.438107:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.438110:0:6495:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ff35729af316a3fc) 00010000:00010000:0.0:1789395124.438112:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395124.438166:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2396:x1876316231713408:12345-192.168.203.54@tcp:103:rm.0 Request processed in 78us (9450us total) trans 0 rc 116/116 00000100:00100000:0.0:1789395124.438174:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1317 00000100:00100000:2.0:1789395124.446596:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395124.446733:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231713792 00000100:00100000:0.0:1789395124.446742:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231713792 00000100:00100000:1.0:1789395124.446744:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7813:1876316239654272:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395124.446772:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: --/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446790:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 45 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.446837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1554 00000100:00100000:0.0:1789395124.446847:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:2395:x1876316231713792:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.446862:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395124.446870:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 45 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446883:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 45 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446910:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316a426 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d64 expref: 45 pid: 6512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446924:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:0.0:1789395124.446929:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: --/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446938:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446946:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.446985:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395124.447034:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.447042:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.447096:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.447104:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.447114:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395124.447132:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239654400:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1789395124.447172:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.447299:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca349540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.447565:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2395:x1876316231713792:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 717us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395124.447576:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1554 00000100:00100000:3.0:1789395124.448678:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239654400 00000100:00100000:3.0:1789395124.448688:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239654400 00000100:00100000:2.0:1789395124.448813:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:2.0:1789395124.448822:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+24:7813:x1876316239654400:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789395124.448838:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395124.448865:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a775 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.448891:0:20561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 22 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.448900:0:20561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 4/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 25 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.448926:0:20561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 22 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.448938:0:20561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 22 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395124.448950:0:20561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239654528:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395124.449028:0:20561:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.454330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395124.454462:0:20561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20561:1876316239654528:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395124.454505:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 3/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 25 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.454519:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1e:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:1.0:1789395124.454522:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.454526:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 3/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 25 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.454537:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 3/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 25 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.454544:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd400, rc 0) 00000100:00100000:1.0:1789395124.454603:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+25:7813:x1876316239654400:12345-0@lo:101:mdt00_003.0 Request processed in 5782us (7430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.454611:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:0.0:1789395124.454663:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239654400:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789395124.454681:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.454693:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.454941:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231713920 00000100:00100000:3.0:1789395124.454949:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231713920 00010000:00010000:3.0:1789395124.454983:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 23 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.455028:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1555 00000100:00100000:3.0:1789395124.455037:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2395:x1876316231713920:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395124.455057:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395124.455069:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 23 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.455081:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 23 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.455105:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316a434 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105d6b expref: 23 pid: 10512 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.455118:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1e:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:3.0:1789395124.455123:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.455133:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.455142:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.455168:0:8441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.455181:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6406a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8441:1876316239654656:0@lo:105: 00000100:00100000:3.0:1789395124.455216:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.455253:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.455309:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789395124.455319:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239654656 00000100:00100000:2.0:1789395124.455323:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239654656 00000100:00100000:2.0:1789395124.455355:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1789395124.455362:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:8441:x1876316239654656:12345-0@lo:105: 00010000:00010000:2.0:1789395124.455372:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.455417:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.455425:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.455432:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.455439:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.455447:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.455463:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca0e1c00) 00000100:00100000:2.0:1789395124.455506:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:8441:x1876316239654656:12345-0@lo:105: Request processed in 144us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.455513:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1789395124.455560:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6406a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:8441:1876316239654656:0@lo:105: 00010000:00010000:2.0:1789395124.455572:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.455607:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231713920:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 572us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.455614:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1555 00010000:00010000:0.0:1789395124.456411:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.456429:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.457244:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239654784:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1789395124.457301:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.457624:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935540 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.458569:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239654784 00000100:00100000:3.0:1789395124.458579:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239654784 00000100:00100000:3.0:1789395124.458634:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1789395124.458644:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+25:7813:x1876316239654784:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1789395124.462868:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+25:7813:x1876316239654784:12345-0@lo:403:mdt00_003.0 Request processed in 4217us (5557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.462886:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:0.0:1789395124.463574:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7813:1876316239654784:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1789395124.465704:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].395, 952 off593024 00000040:00080000:1.0:1789395124.465883:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].392, 1032 off646352 00000004:00080000:1.0:1789395124.465890:0:7813:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca349180 with version 739 00000004:00080000:0.0:1789395124.466035:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 739 rpc_version 739 00000020:00100000:1.0:1789395124.466697:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395124.466709:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a49880 x1876316239655040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395124.466734:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239655040:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.466798:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.466835:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395124.466952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655040 00000100:00100000:0.0:1789395124.466960:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655040 00000100:00100000:0.0:1789395124.467025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:0.0:1789395124.467035:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+25:7874:x1876316239655040:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395124.467674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:7874:x1876316239655040:12345-0@lo:1000:osp_up1-0.0 Request processed in 639us (875us total) trans 4294968442 rc 0/0 00000100:00100000:0.0:1789395124.467682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00100000:1.0:1789395124.467909:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239655040:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1789395124.467962:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13c0:0x0]: returning size 4096 00010000:00010000:0.0:1789395124.467983:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.467991:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.467998:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468004:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.468008:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468029:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468043:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1e:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:0.0:1789395124.468046:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395124.468059:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 2/0,0 mode: --/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468065:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316a76e lrc: 0/0,0 mode: --/EX res: [0x200000400:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468082:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468090:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468096:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468117:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395124.468125:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x1e:0x0] 00010000:00010000:0.0:1789395124.468134:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468140:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468145:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468154:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395124.468157:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468163:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468170:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a4c7eb6000) 00010000:00010000:0.0:1789395124.468172:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395124.468175:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468180:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316a767 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468191:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468198:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468204:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468332:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1789395124.468342:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395124.468347:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468358:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.468364:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468678:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789395124.468685:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468691:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395124.468695:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.468702:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468730:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468736:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395124.468759:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468766:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1c00/0xff35729af316a775 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a77c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468779:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789395124.468782:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468787:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395124.468790:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.468796:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468810:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468814:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395124.468826:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468833:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1200/0xff35729af316a759 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a760 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468842:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395124.468844:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468854:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395124.468857:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.468863:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468875:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468880:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395124.468885:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.468891:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395124.468892:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395124.468894:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395124.468906:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239655296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.468943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.468968:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395124.468973:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239655424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.468990:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.469027:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655296 00000100:00100000:1.0:1789395124.469032:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655296 00000100:00100000:1.0:1789395124.469082:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655424 00000100:00100000:1.0:1789395124.469085:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655424 00000100:00100000:1.0:1789395124.469104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1789395124.469112:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+27:3636:x1876316239655296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.469123:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.469138:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a760 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13c0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a759 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.469149:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13c0:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:1.0:1789395124.469155:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.469182:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+26:3636:x1876316239655296:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.469188:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1789395124.469202:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1789395124.469207:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+25:3636:x1876316239655424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.469213:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.469233:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316a744 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a73d expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.469242:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a3ca363600) 00010000:00010000:1.0:1789395124.469248:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.469268:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+24:3636:x1876316239655424:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.469273:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1789395124.469302:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239655424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.469309:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239655296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.469630:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395124.469641:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239655168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395124.469669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395124.470404:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395124.470420:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655168 00000100:00100000:2.0:1789395124.470424:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655168 00000100:00100000:2.0:1789395124.470461:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1789395124.470468:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6281050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+24:3638:x1876316239655168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395124.470477:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395124.470648:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd400/0xff35729af316a77c lrc: 0/0,0 mode: --/EX res: [0x240000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a775 expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.470664:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1e:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:2.0:1789395124.470673:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395124.470717:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6281050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+23:3638:x1876316239655168:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.470724:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1789395124.470824:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239655168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395124.470952:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789395124.470960:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1600/0xff35729af316a73d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a744 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395124.470979:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1789395124.470988:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395124.470996:0:7813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395124.471215:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231713664:12345-192.168.203.54@tcp:36:rm.0 Request processed in 41580us (42132us total) trans 4294983492 rc 0/0 00000100:00100000:0.0:1789395124.471231:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23452 00010000:00010000:3.0:1789395124.471318:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395124.479352:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.479736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231714176 00000100:00100000:3.0:1789395124.479747:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231714176 00000100:00100000:3.0:1789395124.479842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5051 00000100:00100000:3.0:1789395124.479865:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:17656:x1876316231714176:12345-192.168.203.54@tcp:35:rm.0 00000040:00080000:3.0:1789395124.480125:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].396, 344 off593368 00000040:00080000:3.0:1789395124.480166:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].393, 424 off646776 00000004:00080000:3.0:1789395124.480172:0:6515:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34b480 with version 740 00000004:00080000:1.0:1789395124.480350:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 740 rpc_version 740 00000020:00100000:1.0:1789395124.480379:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395124.480415:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f4380 x1876316239655680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395124.480437:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239655680:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.480495:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.480523:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395124.480625:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655680 00000100:00100000:2.0:1789395124.480630:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655680 00000100:00100000:2.0:1789395124.480664:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:2.0:1789395124.480671:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:7874:x1876316239655680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395124.480805:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+24:7874:x1876316239655680:12345-0@lo:1000:osp_up1-0.0 Request processed in 134us (308us total) trans 4294968443 rc 0/0 00000100:00100000:2.0:1789395124.480812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:3.0:1789395124.480997:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239655680:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395124.481135:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231714176:12345-192.168.203.54@tcp:35:rm.0 Request processed in 1272us (1791us total) trans 4294983493 rc 0/0 00000100:00100000:2.0:1789395124.481142:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5051 00000100:00100000:1.0:1789395124.485302:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395124.485499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231714432 00000100:00100000:3.0:1789395124.485509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231714432 00000100:00100000:3.0:1789395124.485572:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23453 00000100:00100000:3.0:1789395124.485584:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:17656:x1876316231714432:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395124.485640:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789395124.485668:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af31570b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x138f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210229a expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485693:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376600/0xff35729af3156cd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021021cf expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485708:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af3156c98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021021b3 expref: 43 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485720:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138f:0x0].0x0 (ffff89a4c3ab8c00) 00010000:00010000:3.0:1789395124.485736:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af3156c7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021021ac expref: 42 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485745:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395124.485749:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395124.485769:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485782:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485792:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485806:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485813:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485819:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485904:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485912:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485920:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485938:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485945:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485952:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485984:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.485991:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.486000:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.486032:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6407b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239655808:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395124.486082:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.486106:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.486361:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655808 00000100:00100000:1.0:1789395124.486367:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655808 00000100:00100000:1.0:1789395124.486443:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217 00000100:00100000:1.0:1789395124.486451:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+24:6512:x1876316239655808:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395124.486465:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395124.486491:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a7a6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a79f expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.486512:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a7a6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a79f expref: 25 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.486524:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a7a6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a79f expref: 25 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.486531:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:1.0:1789395124.486535:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.486537:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:1.0:1789395124.486574:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+25:6512:x1876316239655808:12345-0@lo:101:mdt00_001.0 Request processed in 124us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.486582:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217 00000100:00100000:3.0:1789395124.487160:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6407b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239655808:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395124.487178:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395124.487188:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395124.488222:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6407b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239655936:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1789395124.488332:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395124.488366:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395124.488618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239655936 00000100:00100000:3.0:1789395124.488625:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239655936 00000100:00100000:3.0:1789395124.488666:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:3.0:1789395124.488675:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+25:6512:x1876316239655936:12345-0@lo:403:mdt00_001.0 00000100:00100000:2.0:1789395124.491181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+25:6512:x1876316239655936:12345-0@lo:403:mdt00_001.0 Request processed in 2498us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395124.491194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00100000:0.0:1789395124.491236:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6407b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1876316239655936:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1789395124.494187:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].397, 936 off594304 00000040:00080000:1.0:1789395124.494644:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].394, 1016 off647792 00000004:00080000:1.0:1789395124.494652:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c80b3e40 with version 741 00000004:00080000:0.0:1789395124.494764:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 741 rpc_version 741 00000020:00100000:0.0:1789395124.494801:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395124.494812:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a49f80 x1876316239656192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395124.494837:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239656192:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395124.494973:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395124.495048:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395124.495098:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239656192 00000100:00100000:1.0:1789395124.495105:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239656192 00000100:00100000:1.0:1789395124.495163:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:1.0:1789395124.495172:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+25:7874:x1876316239656192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395124.496069:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+26:7874:x1876316239656192:12345-0@lo:1000:osp_up1-0.0 Request processed in 895us (1093us total) trans 4294968444 rc 0/0 00000100:00100000:1.0:1789395124.496078:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:0.0:1789395124.496198:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239656192:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1789395124.496311:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x138f:0x0]: returning size 4096 00010000:00010000:1.0:1789395124.496332:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.496342:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.496351:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.496357:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395124.496362:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.496370:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.498892:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff89a3ca363900) 00010000:00010000:1.0:1789395124.498901:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.498911:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.498923:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316a798 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.498955:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.498966:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.498974:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499010:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395124.499032:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1789395124.499041:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499049:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499060:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499066:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395124.499070:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499077:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499091:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138f:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:1.0:1789395124.499093:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395124.499097:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499103:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a791 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499123:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499129:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499135:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499142:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499147:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395124.499150:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499155:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499163:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395124.499166:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395124.499169:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499179:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a783 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395124.499189:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083cc598f reply state 00000000f54b5ab6 transno 4294983494 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499202:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.499209:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca5a1f93 (ffff89a3ca363c00) 00010000:00010000:1.0:1789395124.499211:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395124.499215:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395124.499353:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395124.499360:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.499368:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395124.499373:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395124.499381:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.499625:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.499632:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789395124.499685:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395124.499807:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:17656:x1876316231714432:12345-192.168.203.54@tcp:36:rm.0 Request processed in 14223us (14511us total) trans 4294983494 rc 0/0 00000100:00100000:1.0:1789395124.499817:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23453 00010000:00010000:2.0:1789395124.500341:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.500353:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10de00/0xff35729af316a79f lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a7a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395124.500372:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395124.500374:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395124.500376:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395124.503609:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239656320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395124.503684:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395124.503776:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239656320 00000100:00100000:1.0:1789395124.503785:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239656320 00000100:00100000:1.0:1789395124.503854:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1789395124.503863:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+26:3639:x1876316239656320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.503876:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395124.503898:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316a7a6 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a79f expref: 26 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395124.503915:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:1.0:1789395124.503925:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395124.503956:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+25:3639:x1876316239656320:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395124.503963:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1789395124.504100:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239656320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395124.979258:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395126.002231:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395126.081329:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395126.081348:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081404:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081411:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395126.081429:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c800/0xff35729af316a617 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a61e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081446:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395126.081453:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081465:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081479:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395126.081500:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316a5c3 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a5ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395126.081513:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968444 is committed 00000001:00080000:0.0:1789395126.081538:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968438 is committed 00000020:00080000:0.0:1789395126.081578:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 386 batchid updated 00000100:00100000:0.0:1789395126.081606:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239656448:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395126.081673:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395126.081892:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395126.081901:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239656576:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395126.081933:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395126.081965:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081974:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081981:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.081991:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395126.081996:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.082011:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.082022:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5fcc6f89 (ffff89a4c3ab8400) 00010000:00010000:0.0:1789395126.082026:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395126.082030:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395126.082040:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417200/0xff35729af316a664 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x5fcc6f89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395126.082066:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 386 00000100:00100000:2.0:1789395126.082070:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239656448 00000100:00100000:2.0:1789395126.082080:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239656448 00000100:00100000:2.0:1789395126.082178:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239656576 00000100:00100000:2.0:1789395126.082182:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239656576 00000100:00100000:2.0:1789395126.082209:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1789395126.082217:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+31:3639:x1876316239656448:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1789395126.082230:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395126.082247:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316a61e lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xef411af6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a617 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.082259:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xef411af6 (ffff89a4c3ab8800) 00010000:00010000:2.0:1789395126.082267:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395126.082308:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+30:3639:x1876316239656448:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 92us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395126.082315:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1789395126.082331:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1789395126.082338:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+29:3637:x1876316239656576:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1789395126.082345:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395126.082357:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a5ca lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8b6906c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a5c3 expref: 29 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.082368:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8b6906c (ffff89a3ca2fba00) 00010000:00010000:2.0:1789395126.082374:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1789395126.082602:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a4ff935300 with version 735 00000020:00080000:0.0:1789395126.082655:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 382 cancel update log [0x200000401:0x3:0x0].381: rc = 0 00000004:00080000:3.0:1789395126.082663:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 735 rpc_version 735 00000020:00100000:3.0:1789395126.082687:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395126.082695:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4f6406680 x1876316239656832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1789395126.082785:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 382 cancel update log [0x240000400:0x3:0x0].381: rc = 0 00000004:00080000:0.0:1789395126.082814:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a4ff935540 with version 736 00000020:00080000:0.0:1789395126.082818:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 385 cancel update log [0x200000401:0x3:0x0].382: rc = 0 00000020:00080000:0.0:1789395126.082840:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 385 cancel update log [0x240000400:0x3:0x0].382: rc = 0 00000020:00080000:0.0:1789395126.082847:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 386 00000100:00100000:3.0:1789395126.083073:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6406680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239656832:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395126.083220:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395126.083245:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789395126.083280:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+28:3637:x1876316239656576:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 942us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395126.083288:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1789395126.083330:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239656448:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395126.083559:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239656832 00000100:00100000:0.0:1789395126.083565:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239656832 00000100:00100000:0.0:1789395126.083607:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:0.0:1789395126.083614:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+28:7455:x1876316239656832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395126.085560:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:7455:x1876316239656832:12345-0@lo:1000:osp_up0-1.0 Request processed in 1939us (2332us total) trans 4294983495 rc 0/0 00000100:00100000:0.0:1789395126.085573:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00100000:0.0:1789395126.085638:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6406680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239656832:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1789395126.085760:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 736 rpc_version 736 00000020:00100000:0.0:1789395126.085784:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395126.085791:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a49500 x1876316239657088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395126.085811:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239657088:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395126.085853:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395126.086402:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395126.086617:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657088 00000100:00100000:2.0:1789395126.086624:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657088 00000100:00100000:2.0:1789395126.086668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00100000:2.0:1789395126.086677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:7455:x1876316239657088:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395126.086827:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+30:7455:x1876316239657088:12345-0@lo:1000:osp_up0-1.0 Request processed in 150us (973us total) trans 4294983496 rc 0/0 00000100:00100000:2.0:1789395126.086833:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00100000:0.0:1789395126.087072:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239657088:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1789395126.089540:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395126.089567:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089606:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089612:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395126.089630:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1000/0xff35729af316a74b lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a752 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089648:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395126.089656:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089673:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089686:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395126.089703:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cca00/0xff35729af316a6f7 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089717:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395126.089724:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089741:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089747:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395126.089753:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316a6a3 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a6aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089765:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395126.089773:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089790:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089796:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395126.089801:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316a537 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a53e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089813:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395126.089819:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089833:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.089839:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395126.089842:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca015000/0xff35729af316a4e3 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a4ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395126.089854:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983494 is committed 00000001:00080000:2.0:1789395126.089887:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983483 is committed 00000020:00080000:2.0:1789395126.089914:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 389 batchid updated 00000020:00080000:2.0:1789395126.089918:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 388 batchid updated 00000100:00100000:2.0:1789395126.089959:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239657344:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1789395126.090028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395126.090077:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395126.090083:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239657472:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1789395126.090497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395126.090540:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657344 00000100:00100000:2.0:1789395126.090546:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657344 00000100:00100000:2.0:1789395126.090588:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657472 00000100:00100000:2.0:1789395126.090591:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657472 00000100:00100000:2.0:1789395126.090613:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1789395126.090621:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+15:3638:x1876316239657344:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1789395126.090633:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395126.090651:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316a6fe lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x55d495e6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a6f7 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.090666:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x55d495e6 (ffff89a4c3ab8200) 00010000:00010000:2.0:1789395126.090676:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395126.090711:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+14:3638:x1876316239657344:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 91us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395126.090718:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1789395126.090735:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1789395126.090742:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+13:3638:x1876316239657472:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1789395126.090749:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395126.090760:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316a6aa lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xa04846ca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a6a3 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395126.090770:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xa04846ca (ffff89a4c3ab8a00) 00010000:00010000:2.0:1789395126.090776:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395126.090799:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239657472:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 58us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395126.090805:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1789395126.090841:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239657472:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1789395126.090850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239657344:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395126.091073:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239656576:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1789395126.091096:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091106:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091175:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091182:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395126.091186:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091194:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091204:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf404c279 (ffff89a3ca2fb400) 00010000:00010000:1.0:1789395126.091207:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395126.091210:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091216:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a584 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091235:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091241:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091251:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091257:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395126.091259:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091265:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091273:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca5a1f93 (ffff89a3ca363c00) 00010000:00010000:1.0:1789395126.091275:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395126.091278:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091284:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a78a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395126.091312:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239657600:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395126.091342:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789395126.091375:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.091573:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c80b3f00 with version 742 00000020:00080000:1.0:1789395126.091618:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 388 cancel update log [0x240000401:0x3:0x0].383: rc = 0 00000020:00080000:1.0:1789395126.091686:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 388 cancel update log [0x200000400:0x3:0x0].385: rc = 0 00000020:00080000:1.0:1789395126.091695:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000100:00100000:1.0:1789395126.091707:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657600 00000100:00100000:1.0:1789395126.091722:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657600 00000100:00100000:1.0:1789395126.091755:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1789395126.091762:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3636:x1876316239657600:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1789395126.091771:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395126.091784:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca417e00/0xff35729af316a53e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x18cfedbe bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a537 expref: 12 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.091797:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x18cfedbe (ffff89a4c3ab8300) 00010000:00010000:1.0:1789395126.091804:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395126.091833:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239657600:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 71us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395126.091840:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1789395126.091878:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239657600:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395126.091957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239657216:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395126.091982:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395126.091999:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657216 00000100:00100000:1.0:1789395126.092015:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657216 00000100:00100000:1.0:1789395126.092038:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1789395126.092044:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3637:x1876316239657216:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1789395126.092051:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395126.092061:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a752 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xb228bbb0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a74b expref: 11 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.092071:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xb228bbb0 (ffff89a4c7eb6e00) 00010000:00010000:1.0:1789395126.092077:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395126.092098:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3637:x1876316239657216:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395126.092104:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1789395126.092161:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239657216:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395126.092177:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239657728:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395126.092197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395126.092213:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657728 00000100:00100000:1.0:1789395126.092217:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657728 00000100:00100000:1.0:1789395126.092238:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1789395126.092244:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3637:x1876316239657728:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1789395126.092250:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395126.092259:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc000/0xff35729af316a4ea lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x3873ad72 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a4e3 expref: 10 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395126.092269:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x3873ad72 (ffff89a3ca2fb700) 00010000:00010000:1.0:1789395126.092276:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395126.092295:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239657728:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395126.092302:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1789395126.092325:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239657728:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:3.0:1789395126.092765:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 742 rpc_version 742 00000020:00100000:1.0:1789395126.092854:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395126.092863:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c79f6a00 x1876316239657984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395126.092881:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239657984:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395126.092910:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395126.092971:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395126.093685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239657984 00000100:00100000:3.0:1789395126.093692:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239657984 00000100:00100000:3.0:1789395126.093943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222 00000100:00100000:3.0:1789395126.093953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239657984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395126.094242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239657984:12345-0@lo:1000:osp_up1-0.0 Request processed in 291us (1330us total) trans 4294968445 rc 0/0 00000100:00100000:3.0:1789395126.094250:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222 00000100:00100000:1.0:1789395126.094303:0:7874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968444 gen 2 00000004:00080000:1.0:1789395126.094309:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968425 committed transno 4294968444 00000020:00080000:1.0:1789395126.094315:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca06acc0 refcount 2 committed 0 result 0 batchid 390 00000020:00080000:1.0:1789395126.094319:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca06a600 00000020:00080000:1.0:1789395126.094323:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].384 00000020:00080000:1.0:1789395126.094325:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7a5d000 00000020:00080000:1.0:1789395126.094329:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].386 00000020:00080000:2.0:1789395126.094362:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 390 committed batchid 389 00000020:00080000:2.0:1789395126.094515:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.094587:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968426 committed transno 4294968444 00000020:00080000:1.0:1789395126.094592:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca35c3c0 refcount 2 committed 0 result 0 batchid 391 00000020:00080000:1.0:1789395126.094595:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c5f21e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4c4f4d0c0 00000020:00080000:1.0:1789395126.094598:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].385 00000020:00080000:1.0:1789395126.094600:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c5f21000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca3d2c00 00000020:00080000:1.0:1789395126.094603:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].387 00000020:00080000:2.0:1789395126.094631:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 391 committed batchid 389 00000020:00080000:2.0:1789395126.094649:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.094681:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968427 committed transno 4294968444 00000020:00080000:1.0:1789395126.094685:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca06ae40 refcount 2 committed 0 result 0 batchid 392 00000020:00080000:1.0:1789395126.094688:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca06a6c0 00000020:00080000:1.0:1789395126.094691:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].386 00000020:00080000:1.0:1789395126.094693:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7a5cc00 00000020:00080000:1.0:1789395126.094695:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].388 00000020:00080000:2.0:1789395126.094723:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 392 committed batchid 389 00000020:00080000:2.0:1789395126.094738:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.094897:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968428 committed transno 4294968444 00000020:00080000:1.0:1789395126.094902:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca181780 refcount 2 committed 0 result 0 batchid 393 00000020:00080000:1.0:1789395126.094905:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca181240 00000020:00080000:1.0:1789395126.094908:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].387 00000020:00080000:1.0:1789395126.094910:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82ea600 00000020:00080000:1.0:1789395126.094913:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].389 00000020:00080000:2.0:1789395126.094939:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 393 committed batchid 389 00000020:00080000:2.0:1789395126.094956:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.094989:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968429 committed transno 4294968444 00000020:00080000:1.0:1789395126.094993:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4c4f5b000 refcount 2 committed 0 result 0 batchid 394 00000020:00080000:1.0:1789395126.094996:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4c4f5b6c0 00000020:00080000:1.0:1789395126.094999:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].388 00000020:00080000:1.0:1789395126.095001:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c79b8e00 00000020:00080000:1.0:1789395126.095012:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].390 00000020:00080000:2.0:1789395126.095037:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 394 committed batchid 389 00000020:00080000:2.0:1789395126.095052:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.095082:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968439 committed transno 4294968444 00000020:00080000:1.0:1789395126.095086:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca181300 refcount 2 committed 0 result 0 batchid 395 00000020:00080000:1.0:1789395126.095089:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c5f21100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca181e40 00000020:00080000:1.0:1789395126.095092:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].389 00000020:00080000:1.0:1789395126.095095:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c9120400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82f9800 00000020:00080000:1.0:1789395126.095097:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].392 00000020:00080000:2.0:1789395126.095177:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 395 committed batchid 389 00000020:00080000:2.0:1789395126.095197:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.095227:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968440 committed transno 4294968444 00000020:00080000:1.0:1789395126.095231:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4fedcd3c0 refcount 2 committed 0 result 0 batchid 396 00000020:00080000:1.0:1789395126.095234:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40d200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4d3dfb0c0 00000020:00080000:1.0:1789395126.095237:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].390 00000020:00080000:1.0:1789395126.095239:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4ff9da200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82d2400 00000020:00080000:1.0:1789395126.095241:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].393 00000020:00080000:2.0:1789395126.095266:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 396 committed batchid 389 00000020:00080000:2.0:1789395126.095280:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.095315:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968441 committed transno 4294968444 00000020:00080000:1.0:1789395126.095319:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca34f600 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:1.0:1789395126.095322:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4efda0000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca34fd80 00000020:00080000:1.0:1789395126.095325:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].391 00000020:00080000:1.0:1789395126.095327:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4efda0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0200 00000020:00080000:1.0:1789395126.095329:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].394 00000020:00080000:2.0:1789395126.095353:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 397 committed batchid 389 00000020:00080000:2.0:1789395126.095368:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000004:00080000:1.0:1789395126.095544:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968442 committed transno 4294968444 00000020:00080000:1.0:1789395126.095548:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca349300 refcount 2 committed 0 result 0 batchid 398 00000020:00080000:1.0:1789395126.095551:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c5f21b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca349180 00000020:00080000:1.0:1789395126.095554:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].392 00000020:00080000:1.0:1789395126.095557:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c5f21300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c823ee00 00000020:00080000:1.0:1789395126.095560:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].395 00000020:00080000:2.0:1789395126.095586:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 398 committed batchid 389 00000004:00080000:1.0:1789395126.097289:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968443 committed transno 4294968444 00000020:00080000:1.0:1789395126.097297:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca34b9c0 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:1.0:1789395126.097301:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca34b480 00000020:00080000:1.0:1789395126.097305:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].393 00000020:00080000:1.0:1789395126.097307:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c8bbb200 00000020:00080000:1.0:1789395126.097310:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].396 00000004:00080000:1.0:1789395126.097320:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968444 committed transno 4294968444 00000020:00080000:1.0:1789395126.097324:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c80b3c00 refcount 2 committed 0 result 0 batchid 400 00000020:00080000:1.0:1789395126.097327:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4ffb7b400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c80b3e40 00000020:00080000:1.0:1789395126.097330:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].394 00000020:00080000:1.0:1789395126.097332:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4ffb7bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82f9600 00000020:00080000:1.0:1789395126.097335:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].397 00000100:00100000:1.0:1789395126.097352:0:7874:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a3c79f6a00 x1876316239657984/t4294968445(4294968445) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395142 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789395126.097375:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239657984:0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1789395126.097800:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 400 committed batchid 389 00000020:00080000:2.0:1789395126.097827:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 389 00000100:00100000:3.0:1789395126.842555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395126.842642:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395126.842673:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395126.842697:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395126.842717:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395126.842768:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715072 00000100:00100000:3.0:1789395126.842776:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715072 00000100:00100000:2.0:1789395126.842875:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231714816 00000100:00100000:2.0:1789395126.842879:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231714816 00000100:00100000:2.0:1789395126.842928:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231714688 00000100:00100000:2.0:1789395126.842931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231714688 00000100:00100000:2.0:1789395126.842948:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 582 00000100:00100000:2.0:1789395126.842958:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231714816:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395126.843032:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231714816:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 76us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395126.843040:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 582 00000100:00100000:2.0:1789395126.843054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 583 00000100:00100000:2.0:1789395126.843060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231714688:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395126.843083:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231714688:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395126.843089:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 583 00000100:00080000:2.0:1789395126.843105:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395126.843109:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395126.843169:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231714944 00000100:00100000:1.0:1789395126.843173:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231714944 00000100:00100000:1.0:1789395126.843230:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 388 00000100:00100000:1.0:1789395126.843236:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231714944:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395126.843262:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231714944:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395126.843267:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 388 00000100:00080000:2.0:1789395126.844913:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789395126.846317:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789395126.846903:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 389 00000100:00100000:3.0:1789395126.846921:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231715072:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395126.847005:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231715072:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 80us (4320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395126.847014:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 389 00000100:00100000:0.0:1789395126.855063:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231714560 00000100:00100000:0.0:1789395126.855077:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231714560 00000100:00100000:0.0:1789395126.855212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 433 00000100:00100000:0.0:1789395126.855414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231714560:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395126.855503:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231714560:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 280us (12957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395126.855519:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 433 00010000:00010000:3.0:1789395127.026640:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395127.988460:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395127.988490:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239658112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395127.988577:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395127.988655:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658112 00000100:00100000:1.0:1789395127.988663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658112 00000100:00100000:1.0:1789395127.988714:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3223 00000100:00100000:1.0:1789395127.988723:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239658112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789395127.988767:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444069376 avail 1297829888 00000100:00100000:1.0:1789395127.988813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239658112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395127.988820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3223 00000100:00100000:1.0:1789395127.988866:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983483 gen 2 00000004:00080000:1.0:1789395127.988872:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983455 committed transno 4294983483 00000020:00080000:1.0:1789395127.988879:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca356b40 refcount 2 committed 0 result 0 batchid 387 00000020:00080000:1.0:1789395127.988883:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935eb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca356c00 00000020:00080000:1.0:1789395127.988887:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c935e300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c79b8c00 00000004:00080000:1.0:1789395127.988923:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983456 committed transno 4294983483 00000020:00080000:1.0:1789395127.988927:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca1cc780 refcount 2 committed 0 result 0 batchid 388 00000020:00080000:1.0:1789395127.988930:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4d0d9ca00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cc480 00000020:00080000:1.0:1789395127.988933:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].383 00000020:00080000:1.0:1789395127.988936:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4d0d9cf00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c83c2000 00000020:00080000:1.0:1789395127.988939:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].383 00000004:00080000:1.0:1789395127.988950:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983457 committed transno 4294983483 00000020:00080000:1.0:1789395127.988954:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca1cc6c0 refcount 2 committed 0 result 0 batchid 389 00000020:00080000:1.0:1789395127.988956:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4d0d9c200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cc0c0 00000020:00080000:1.0:1789395127.988959:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4d0d9c700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c83c3000 00000004:00080000:1.0:1789395127.988970:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983458 committed transno 4294983483 00000020:00080000:1.0:1789395127.988973:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca181840 refcount 2 committed 0 result 0 batchid 390 00000020:00080000:1.0:1789395127.988976:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca181000 00000020:00080000:1.0:1789395127.988979:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].384 00000020:00080000:1.0:1789395127.988981:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca289600 00000020:00080000:1.0:1789395127.988984:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].384 00000004:00080000:1.0:1789395127.989007:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983465 committed transno 4294983483 00000020:00080000:1.0:1789395127.989010:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca181d80 refcount 2 committed 0 result 0 batchid 391 00000020:00080000:1.0:1789395127.989013:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca181a80 00000020:00080000:1.0:1789395127.989015:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].385 00000020:00080000:1.0:1789395127.989018:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca093e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca289800 00000020:00080000:1.0:1789395127.989020:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].385 00000004:00080000:1.0:1789395127.989047:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983481 committed transno 4294983483 00000020:00080000:1.0:1789395127.989051:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca35cf00 refcount 2 committed 0 result 0 batchid 392 00000020:00080000:1.0:1789395127.989054:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c69f6100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca35cc00 00000020:00080000:1.0:1789395127.989057:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].386 00000020:00080000:1.0:1789395127.989059:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c69f6a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0000 00000020:00080000:1.0:1789395127.989062:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].386 00000004:00080000:1.0:1789395127.989081:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983482 committed transno 4294983483 00000020:00080000:1.0:1789395127.989085:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca1819c0 refcount 2 committed 0 result 0 batchid 393 00000020:00080000:1.0:1789395127.989087:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4ff9da600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca181180 00000020:00080000:1.0:1789395127.989090:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].387 00000020:00080000:1.0:1789395127.989093:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a5009e9700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82d3800 00000020:00080000:1.0:1789395127.989096:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].387 00000004:00080000:1.0:1789395127.989105:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983483 committed transno 4294983483 00000020:00080000:1.0:1789395127.989110:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca356180 refcount 2 committed 0 result 0 batchid 394 00000020:00080000:1.0:1789395127.989112:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c69f6900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca356f00 00000020:00080000:1.0:1789395127.989115:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].388 00000020:00080000:1.0:1789395127.989117:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c69f6e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0600 00000020:00080000:1.0:1789395127.989120:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].388 00000100:00100000:1.0:1789395127.989138:0:3639:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4f6406680 x1876316239656832/t4294983495(4294983495) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395142 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789395127.989157:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239658112:0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789395127.993491:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 394 committed batchid 386 00000020:00080000:2.0:1789395127.993586:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 386 00010000:00010000:3.0:1789395128.057724:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395129.009840:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239658496:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.009935:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395129.010020:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239659008:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395129.010071:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239659520:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010095:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395129.010129:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789395129.010135:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239658368:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010157:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395129.010174:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239658880:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395129.010217:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239659392:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395129.010272:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658496 00000100:00100000:2.0:1789395129.010281:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658496 00000100:00100000:2.0:1789395129.010342:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224 00000100:00100000:2.0:1789395129.010353:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239658496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010459:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239658496:12345-0@lo:400:kworker.0 Request processed in 106us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.010467:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224 00000100:00100000:2.0:1789395129.010495:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659008 00000100:00100000:2.0:1789395129.010499:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659008 00000100:00100000:2.0:1789395129.010530:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659520 00000100:00100000:2.0:1789395129.010533:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659520 00000100:00100000:2.0:1789395129.010549:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658368 00000100:00100000:2.0:1789395129.010551:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658368 00000100:00100000:2.0:1789395129.010561:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658880 00000100:00100000:2.0:1789395129.010563:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658880 00000100:00100000:2.0:1789395129.010576:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659392 00000100:00100000:2.0:1789395129.010578:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659392 00000100:00100000:2.0:1789395129.010592:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1789395129.010597:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239659008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239659008:12345-0@lo:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.010636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1789395129.010648:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1789395129.010654:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239659520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010680:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239659520:12345-0@lo:400:kworker.0 Request processed in 27us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.010685:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1789395129.010696:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1789395129.010702:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239658368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239658368:12345-0@lo:400:kworker.0 Request processed in 23us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.010734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1789395129.010744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1789395129.010749:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239658880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239658880:12345-0@lo:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.010781:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1789395129.010793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1789395129.010798:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239659392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010824:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239659392:12345-0@lo:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.010829:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00080000:2.0:1789395129.010857:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395129.010862:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395129.010911:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239658368:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010922:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239658880:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010933:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239659392:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010943:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239658496:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010951:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239659008:0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.010961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239659520:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011173:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239658240:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011216:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011254:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239658752:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011279:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011298:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239659264:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011320:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011336:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239659776:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011359:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011378:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789395129.011408:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239658624:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011446:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239659136:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011467:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011481:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239659648:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011502:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.011530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658624 00000100:00100000:1.0:1789395129.011536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658624 00000100:00100000:1.0:1789395129.011569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1789395129.011576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239658624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011616:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239658624:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395129.011623:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1789395129.011647:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658752 00000100:00100000:1.0:1789395129.011650:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658752 00000100:00100000:1.0:1789395129.011674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:1.0:1789395129.011680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:3639:x1876316239658752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:3639:x1876316239658752:12345-0@lo:400:kworker.0 Request processed in 36us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395129.011721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00000100:00100000:1.0:1789395129.011766:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239658624:0@lo:400:kworker.0 00000100:00100000:1.0:1789395129.011776:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239658752:0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012091:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659264 00000100:00100000:3.0:1789395129.012097:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659264 00000100:00100000:3.0:1789395129.012149:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659776 00000100:00100000:3.0:1789395129.012153:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659776 00000100:00100000:3.0:1789395129.012170:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659136 00000100:00100000:3.0:1789395129.012172:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659136 00000100:00100000:3.0:1789395129.012189:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659648 00000100:00100000:3.0:1789395129.012192:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659648 00000100:00100000:3.0:1789395129.012211:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789395129.012218:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239659264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012266:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239659264:12345-0@lo:400:kworker.0 Request processed in 49us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395129.012272:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789395129.012287:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789395129.012292:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239659776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012319:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239659776:12345-0@lo:400:kworker.0 Request processed in 28us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395129.012325:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789395129.012337:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789395129.012342:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239659136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012368:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239659136:12345-0@lo:400:kworker.0 Request processed in 26us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395129.012374:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789395129.012408:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789395129.012414:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239659648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012458:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239659648:12345-0@lo:400:kworker.0 Request processed in 44us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395129.012464:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789395129.012522:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239659136:0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012533:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239659648:0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012543:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239659264:0@lo:400:kworker.0 00000100:00100000:3.0:1789395129.012551:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239659776:0@lo:400:kworker.0 00000100:00080000:1.0:1789395129.013044:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395129.013050:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395129.013692:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239658240 00000100:00100000:2.0:1789395129.013703:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239658240 00000100:00100000:2.0:1789395129.015061:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1789395129.015086:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239658240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395129.015198:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239658240:12345-0@lo:400:kworker.0 Request processed in 122us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395129.015206:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1789395129.015530:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239658240:0@lo:400:kworker.0 00010000:00010000:1.0:1789395129.073702:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395129.522592:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395129.522612:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239659904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395129.522677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.522748:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239659904 00000100:00100000:1.0:1789395129.522756:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239659904 00000100:00100000:1.0:1789395129.522798:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226 00000100:00100000:1.0:1789395129.522807:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:3637:x1876316239659904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789395129.522839:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:1.0:1789395129.522883:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:3637:x1876316239659904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395129.522889:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226 00000100:00100000:1.0:1789395129.522938:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239659904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395129.523010:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239660032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395129.523034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.523066:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239660032 00000100:00100000:1.0:1789395129.523070:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239660032 00000100:00100000:1.0:1789395129.523098:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789395129.523105:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239660032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395129.523124:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395129.523156:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239660032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395129.523162:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789395129.523191:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239660032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395129.524517:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239660160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395129.524572:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.525011:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239660160 00000100:00100000:1.0:1789395129.525017:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239660160 00000100:00100000:1.0:1789395129.525061:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789395129.525070:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239660160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395129.525093:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395129.525130:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239660160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395129.525137:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789395129.525212:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239660160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395129.525548:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239660288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395129.525696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395129.525831:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239660288 00000100:00100000:1.0:1789395129.525835:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239660288 00000100:00100000:1.0:1789395129.525869:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789395129.525875:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239660288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395129.525890:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395129.525923:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239660288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395129.525930:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789395129.526090:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239660288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395129.530700:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395129.530723:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239660416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395129.530800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395129.530867:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239660416 00000100:00100000:0.0:1789395129.530875:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239660416 00000100:00100000:0.0:1789395129.530926:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789395129.530935:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239660416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395129.530958:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42257856 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395129.531018:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239660416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395129.531026:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789395129.531108:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239660416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789395130.100496:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395131.126555:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789395131.630891:0:20855:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 10:12:10 (1789395130) 00000100:00100000:1.0:1789395131.952843:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395131.952887:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395131.952916:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395131.952942:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395131.955192:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715200 00000100:00100000:0.0:1789395131.955206:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715200 00000100:00100000:0.0:1789395131.955278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 435 00000100:00100000:0.0:1789395131.955289:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231715200:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395131.955365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231715200:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 78us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395131.955373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 435 00000100:00100000:0.0:1789395131.956469:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715456 00000100:00100000:0.0:1789395131.956477:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715456 00000100:00100000:0.0:1789395131.956531:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715328 00000100:00100000:0.0:1789395131.956535:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715328 00000100:00100000:0.0:1789395131.956557:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 590 00000100:00100000:0.0:1789395131.956565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231715456:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395131.956610:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231715456:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 46us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395131.956616:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 590 00000100:00100000:0.0:1789395131.956629:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 591 00000100:00100000:0.0:1789395131.956635:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231715328:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395131.956657:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231715328:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 22us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395131.956662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 591 00000100:00100000:0.0:1789395131.956680:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715712 00000100:00100000:0.0:1789395131.956683:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715712 00000100:00100000:0.0:1789395131.956708:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 394 00000100:00100000:0.0:1789395131.956714:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231715712:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395131.956739:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231715712:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 25us (3822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395131.956759:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 394 00000100:00080000:0.0:1789395131.960610:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395131.960619:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789395131.960622:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395131.962699:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395131.962758:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715584 00000100:00100000:1.0:1789395131.962769:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715584 00000100:00100000:1.0:1789395131.962831:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 395 00000100:00100000:1.0:1789395131.962842:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231715584:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395131.962918:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231715584:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395131.962926:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 395 00000100:00080000:1.0:1789395131.963125:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1789395132.089205:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 400 batchid updated 00000020:00080000:1.0:1789395132.089221:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 398 batchid updated 00000020:00080000:1.0:1789395132.089224:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 397 batchid updated 00000020:00080000:1.0:1789395132.089227:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 396 batchid updated 00000020:00080000:1.0:1789395132.089229:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 395 batchid updated 00000020:00080000:1.0:1789395132.089232:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 394 batchid updated 00000020:00080000:1.0:1789395132.089235:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 393 batchid updated 00000020:00080000:1.0:1789395132.089237:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 392 batchid updated 00000020:00080000:1.0:1789395132.089239:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 391 batchid updated 00000020:00080000:1.0:1789395132.089242:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 390 batchid updated 00000001:00080000:1.0:1789395132.089264:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983496 is committed 00000020:00080000:2.0:1789395132.089620:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 400 00000004:00080000:2.0:1789395132.089708:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4ff935f00 with version 743 00000020:00080000:2.0:1789395132.089726:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 390 cancel update log [0x240000401:0x3:0x0].384: rc = 0 00000020:00080000:2.0:1789395132.089827:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 390 cancel update log [0x200000400:0x3:0x0].386: rc = 0 00000004:00080000:2.0:1789395132.089850:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca31b9c0 with version 744 00000020:00080000:2.0:1789395132.089854:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 391 cancel update log [0x240000401:0x3:0x0].385: rc = 0 00000020:00080000:2.0:1789395132.089870:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 391 cancel update log [0x200000400:0x3:0x0].387: rc = 0 00000004:00080000:2.0:1789395132.089888:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca31bf00 with version 745 00000020:00080000:2.0:1789395132.089890:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 392 cancel update log [0x240000401:0x3:0x0].386: rc = 0 00000020:00080000:2.0:1789395132.089907:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 392 cancel update log [0x200000400:0x3:0x0].388: rc = 0 00000004:00080000:2.0:1789395132.089926:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca31bd80 with version 746 00000020:00080000:2.0:1789395132.089928:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 393 cancel update log [0x240000401:0x3:0x0].387: rc = 0 00000020:00080000:2.0:1789395132.089944:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 393 cancel update log [0x200000400:0x3:0x0].389: rc = 0 00000004:00080000:2.0:1789395132.089979:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4c865af00 with version 747 00000020:00080000:2.0:1789395132.089982:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 394 cancel update log [0x240000401:0x3:0x0].388: rc = 0 00000020:00080000:2.0:1789395132.090000:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 394 cancel update log [0x200000400:0x3:0x0].390: rc = 0 00000004:00080000:2.0:1789395132.090036:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4c865a9c0 with version 748 00000020:00080000:2.0:1789395132.090039:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 395 cancel update log [0x240000401:0x3:0x0].389: rc = 0 00000020:00080000:2.0:1789395132.090056:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 395 cancel update log [0x200000400:0x3:0x0].392: rc = 0 00000004:00080000:2.0:1789395132.090078:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca6cd300 with version 749 00000020:00080000:2.0:1789395132.090081:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 396 cancel update log [0x240000401:0x3:0x0].390: rc = 0 00000020:00080000:2.0:1789395132.090097:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 396 cancel update log [0x200000400:0x3:0x0].393: rc = 0 00000004:00080000:2.0:1789395132.090117:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca6cdcc0 with version 750 00000020:00080000:2.0:1789395132.090121:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 397 cancel update log [0x240000401:0x3:0x0].391: rc = 0 00000020:00080000:2.0:1789395132.090147:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 397 cancel update log [0x200000400:0x3:0x0].394: rc = 0 00000004:00080000:2.0:1789395132.090168:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca6cdb40 with version 751 00000020:00080000:2.0:1789395132.090171:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 398 cancel update log [0x240000401:0x3:0x0].392: rc = 0 00000020:00080000:2.0:1789395132.090187:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 398 cancel update log [0x200000400:0x3:0x0].395: rc = 0 00000004:00080000:2.0:1789395132.090205:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca6cdf00 with version 752 00000020:00080000:2.0:1789395132.090208:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 399 cancel update log [0x240000401:0x3:0x0].393: rc = 0 00000020:00080000:2.0:1789395132.090222:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 399 cancel update log [0x200000400:0x3:0x0].396: rc = 0 00000004:00080000:2.0:1789395132.090237:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca6cdc00 with version 753 00000020:00080000:2.0:1789395132.090239:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 400 cancel update log [0x240000401:0x3:0x0].394: rc = 0 00000020:00080000:2.0:1789395132.090253:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 400 cancel update log [0x200000400:0x3:0x0].397: rc = 0 00000020:00080000:2.0:1789395132.090262:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 400 00000004:00080000:1.0:1789395132.090804:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 743 rpc_version 743 00000020:00100000:1.0:1789395132.090848:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395132.090861:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c904c000 x1876316239660672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395132.090889:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239660672:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395132.090980:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395132.091049:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:2.0:1789395132.093792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239660672 00000100:00100000:2.0:1789395132.093813:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239660672 00000100:00100000:2.0:1789395132.093888:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:2.0:1789395132.093898:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239660672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395132.094181:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239660672:12345-0@lo:1000:osp_up1-0.0 Request processed in 284us (3201us total) trans 4294968446 rc 0/0 00000100:00100000:2.0:1789395132.094189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1789395132.094652:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239660672:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1789395132.094671:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 744 rpc_version 744 00000020:00100000:0.0:1789395132.094701:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395132.094709:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a48a80 x1876316239660928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395132.094733:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a48a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239660928:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395132.094783:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395132.094828:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.095364:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239660928 00000100:00100000:3.0:1789395132.095372:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239660928 00000100:00100000:3.0:1789395132.095455:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:3.0:1789395132.095464:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239660928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.095621:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239660928:12345-0@lo:1000:osp_up1-0.0 Request processed in 158us (837us total) trans 4294968447 rc 0/0 00000100:00100000:3.0:1789395132.095630:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00000100:00100000:3.0:1789395132.095677:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a48a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239660928:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.095687:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 745 rpc_version 745 00000020:00100000:3.0:1789395132.095701:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.095707:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4f6404000 x1876316239661184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.095723:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661184:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.095757:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.095782:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.095794:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239661184 00000100:00100000:3.0:1789395132.095798:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239661184 00000100:00100000:3.0:1789395132.095822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229 00000100:00100000:3.0:1789395132.095828:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239661184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.095900:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239661184:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (143us total) trans 4294968448 rc 0/0 00000100:00100000:3.0:1789395132.095907:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:3.0:1789395132.095946:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661184:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.095952:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 746 rpc_version 746 00000020:00100000:3.0:1789395132.095974:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.095979:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4f6405880 x1876316239661440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.095991:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6405880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661440:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096017:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.096029:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.096039:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239661440 00000100:00100000:3.0:1789395132.096043:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239661440 00000100:00100000:3.0:1789395132.096061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230 00000100:00100000:3.0:1789395132.096067:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239661440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096134:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239661440:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (116us total) trans 4294968449 rc 0/0 00000100:00100000:3.0:1789395132.096155:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230 00000100:00100000:3.0:1789395132.096185:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6405880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661440:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.096192:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 747 rpc_version 747 00000020:00100000:3.0:1789395132.096203:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.096208:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a35c00 x1876316239661696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.096220:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661696:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096245:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.096257:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.096266:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239661696 00000100:00100000:3.0:1789395132.096269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239661696 00000100:00100000:3.0:1789395132.096288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231 00000100:00100000:3.0:1789395132.096294:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239661696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096357:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239661696:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (110us total) trans 4294968450 rc 0/0 00000100:00100000:3.0:1789395132.096364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231 00000100:00100000:3.0:1789395132.096426:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661696:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.096433:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 748 rpc_version 748 00000020:00100000:3.0:1789395132.096445:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.096450:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a37480 x1876316239661952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.096461:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a37480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661952:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096487:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.096506:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.096516:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239661952 00000100:00100000:3.0:1789395132.096520:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239661952 00000100:00100000:3.0:1789395132.096541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232 00000100:00100000:3.0:1789395132.096547:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239661952:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096613:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239661952:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (125us total) trans 4294968451 rc 0/0 00000100:00100000:3.0:1789395132.096620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232 00000100:00100000:3.0:1789395132.096648:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a37480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239661952:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.096655:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 749 rpc_version 749 00000020:00100000:3.0:1789395132.096666:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.096671:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a36d80 x1876316239662208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.096684:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662208:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096710:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.096724:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.096733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239662208 00000100:00100000:3.0:1789395132.096736:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239662208 00000100:00100000:3.0:1789395132.096754:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233 00000100:00100000:3.0:1789395132.096759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239662208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239662208:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (112us total) trans 4294968452 rc 0/0 00000100:00100000:3.0:1789395132.096830:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233 00000100:00100000:3.0:1789395132.096859:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662208:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.096866:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 750 rpc_version 750 00000020:00100000:3.0:1789395132.096878:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.096882:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a34a80 x1876316239662464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.096894:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662464:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.096919:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.096931:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.096940:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239662464 00000100:00100000:3.0:1789395132.096943:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239662464 00000100:00100000:3.0:1789395132.096976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3234 00000100:00100000:3.0:1789395132.096982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239662464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097048:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:7874:x1876316239662464:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (128us total) trans 4294968453 rc 0/0 00000100:00100000:3.0:1789395132.097054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3234 00000100:00100000:3.0:1789395132.097082:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662464:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.097089:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 751 rpc_version 751 00000020:00100000:3.0:1789395132.097099:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.097103:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a35500 x1876316239662720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.097115:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662720:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097144:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.097156:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.097166:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239662720 00000100:00100000:3.0:1789395132.097169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239662720 00000100:00100000:3.0:1789395132.097191:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1789395132.097196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:7874:x1876316239662720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:7874:x1876316239662720:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (113us total) trans 4294968454 rc 0/0 00000100:00100000:3.0:1789395132.097265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1789395132.097459:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662720:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.097466:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 752 rpc_version 752 00000020:00100000:3.0:1789395132.097476:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.097481:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a34e00 x1876316239662976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.097492:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662976:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097513:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.097532:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.097540:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239662976 00000100:00100000:3.0:1789395132.097542:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239662976 00000100:00100000:3.0:1789395132.097559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236 00000100:00100000:3.0:1789395132.097563:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:7874:x1876316239662976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:7874:x1876316239662976:12345-0@lo:1000:osp_up1-0.0 Request processed in 56us (106us total) trans 4294968455 rc 0/0 00000100:00100000:3.0:1789395132.097627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236 00000100:00100000:3.0:1789395132.097650:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239662976:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395132.097656:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 753 rpc_version 753 00000020:00100000:3.0:1789395132.097665:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395132.097669:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a35f80 x1876316239663232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395132.097680:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239663232:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097699:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395132.097709:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.097717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239663232 00000100:00100000:3.0:1789395132.097720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239663232 00000100:00100000:3.0:1789395132.097734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:3.0:1789395132.097739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:7874:x1876316239663232:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395132.097791:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:7874:x1876316239663232:12345-0@lo:1000:osp_up1-0.0 Request processed in 51us (90us total) trans 4294968456 rc 0/0 00000100:00100000:3.0:1789395132.097797:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00100000:3.0:1789395132.097820:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239663232:0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1789395132.098681:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 394 batchid updated 00000001:00080000:2.0:1789395132.098702:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968445 is committed 00000020:00080000:0.0:1789395132.099581:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 394 00000004:00080000:0.0:1789395132.099666:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b3cc0 with version 737 00000020:00080000:0.0:1789395132.099688:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 388 cancel update log [0x200000401:0x3:0x0].383: rc = 0 00000020:00080000:0.0:1789395132.099764:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 388 cancel update log [0x240000400:0x3:0x0].383: rc = 0 00000004:00080000:0.0:1789395132.099788:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b39c0 with version 738 00000020:00080000:0.0:1789395132.099791:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 390 cancel update log [0x200000401:0x3:0x0].384: rc = 0 00000020:00080000:0.0:1789395132.099809:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 390 cancel update log [0x240000400:0x3:0x0].384: rc = 0 00000004:00080000:0.0:1789395132.099828:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b33c0 with version 739 00000020:00080000:0.0:1789395132.099831:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 391 cancel update log [0x200000401:0x3:0x0].385: rc = 0 00000020:00080000:0.0:1789395132.099848:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 391 cancel update log [0x240000400:0x3:0x0].385: rc = 0 00000004:00080000:0.0:1789395132.099866:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b3240 with version 740 00000020:00080000:0.0:1789395132.099869:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 392 cancel update log [0x200000401:0x3:0x0].386: rc = 0 00000020:00080000:0.0:1789395132.099884:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 392 cancel update log [0x240000400:0x3:0x0].386: rc = 0 00000004:00080000:0.0:1789395132.099905:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b3000 with version 741 00000020:00080000:0.0:1789395132.099908:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 393 cancel update log [0x200000401:0x3:0x0].387: rc = 0 00000020:00080000:0.0:1789395132.099932:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 393 cancel update log [0x240000400:0x3:0x0].387: rc = 0 00000004:00080000:0.0:1789395132.099951:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b3c00 with version 742 00000020:00080000:0.0:1789395132.099955:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 394 cancel update log [0x200000401:0x3:0x0].388: rc = 0 00000020:00080000:0.0:1789395132.099985:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 394 cancel update log [0x240000400:0x3:0x0].388: rc = 0 00000020:00080000:0.0:1789395132.099990:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 394 00000004:00080000:2.0:1789395132.103271:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 737 rpc_version 737 00000020:00100000:2.0:1789395132.103345:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395132.103360:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4ff86d880 x1876316239663488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395132.103459:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239663488:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395132.103555:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395132.103608:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395132.104082:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239663488 00000100:00100000:3.0:1789395132.104092:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239663488 00000100:00100000:3.0:1789395132.104256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238 00000100:00100000:3.0:1789395132.104269:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:7455:x1876316239663488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395132.105268:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239663488:12345-0@lo:1000:osp_up0-1.0 Request processed in 997us (1708us total) trans 4294983497 rc 0/0 00000100:00100000:3.0:1789395132.105280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238 00000100:00100000:1.0:1789395132.105433:0:7455:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983496 gen 2 00000004:00080000:1.0:1789395132.105441:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983495 committed transno 4294983496 00000004:00080000:1.0:1789395132.105467:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983496 committed transno 4294983496 00000100:00100000:1.0:1789395132.105483:0:7455:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4ff86d880 x1876316239663488/t4294983497(4294983497) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395148 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789395132.105513:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239663488:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395132.105527:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 738 rpc_version 738 00000020:00100000:1.0:1789395132.105552:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395132.105557:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f62a00 x1876316239663744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395132.105578:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239663744:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.105621:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395132.106775:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395132.106857:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239663744 00000100:00100000:0.0:1789395132.106867:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239663744 00000100:00100000:1.0:1789395132.108133:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1789395132.108162:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239663744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.108727:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7455:x1876316239663744:12345-0@lo:1000:osp_up0-1.0 Request processed in 572us (3102us total) trans 4294983498 rc 0/0 00000100:00100000:1.0:1789395132.108737:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1789395132.108822:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239663744:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395132.108841:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 739 rpc_version 739 00000020:00100000:1.0:1789395132.108869:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395132.108876:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f63100 x1876316239664000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395132.108899:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664000:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.108944:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395132.108991:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395132.109006:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239664000 00000100:00100000:1.0:1789395132.110250:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239664000 00000100:00100000:1.0:1789395132.110405:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:1.0:1789395132.110417:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7455:x1876316239664000:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.110741:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:7455:x1876316239664000:12345-0@lo:1000:osp_up0-1.0 Request processed in 325us (1794us total) trans 4294983499 rc 0/0 00000100:00100000:1.0:1789395132.110750:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00100000:1.0:1789395132.110818:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664000:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395132.110834:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 740 rpc_version 740 00000020:00100000:1.0:1789395132.110857:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395132.110863:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f60000 x1876316239664256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395132.110883:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664256:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.110918:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395132.110939:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395132.110952:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239664256 00000100:00100000:1.0:1789395132.110967:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239664256 00000100:00100000:1.0:1789395132.110988:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3241 00000100:00100000:1.0:1789395132.110994:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:7455:x1876316239664256:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.111082:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239664256:12345-0@lo:1000:osp_up0-1.0 Request processed in 87us (162us total) trans 4294983500 rc 0/0 00000100:00100000:1.0:1789395132.111088:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3241 00000100:00100000:1.0:1789395132.111117:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664256:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395132.111124:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 741 rpc_version 741 00000020:00100000:1.0:1789395132.111137:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395132.111142:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4e7f63480 x1876316239664512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395132.111154:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664512:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.111178:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395132.111192:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395132.111202:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239664512 00000100:00100000:1.0:1789395132.111206:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239664512 00000100:00100000:1.0:1789395132.111222:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3242 00000100:00100000:1.0:1789395132.111228:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239664512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.111294:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239664512:12345-0@lo:1000:osp_up0-1.0 Request processed in 65us (115us total) trans 4294983501 rc 0/0 00000100:00100000:1.0:1789395132.111300:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3242 00000100:00100000:1.0:1789395132.111328:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664512:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1789395132.112764:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 742 rpc_version 742 00000020:00100000:1.0:1789395132.112793:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395132.112801:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca142300 x1876316239664768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395132.112821:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664768:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395132.112875:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395132.112914:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395132.113037:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239664768 00000100:00100000:0.0:1789395132.113045:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239664768 00000100:00100000:0.0:1789395132.113091:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3243 00000100:00100000:0.0:1789395132.113099:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239664768:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395132.113242:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:7455:x1876316239664768:12345-0@lo:1000:osp_up0-1.0 Request processed in 143us (365us total) trans 4294983502 rc 0/0 00000100:00100000:0.0:1789395132.113249:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3243 00000100:00100000:1.0:1789395132.113668:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239664768:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1789395132.147222:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395133.108235:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395133.108264:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239664896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395133.108354:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.109492:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239664896 00000100:00100000:1.0:1789395133.109507:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239664896 00000100:00100000:1.0:1789395133.109575:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244 00000100:00100000:1.0:1789395133.109586:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:3636:x1876316239664896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789395133.109640:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444069376 avail 1297829888 00000100:00100000:1.0:1789395133.109725:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:3636:x1876316239664896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.109733:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244 00000100:00100000:1.0:1789395133.109975:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239664896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395133.151276:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.161318:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715840 00000100:00100000:2.0:1789395133.161351:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715840 00000100:00100000:2.0:1789395133.161461:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23454 00000100:00100000:2.0:1789395133.161475:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18245:x1876316231715840:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395133.161505:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.161536:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a7ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105de2 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.161627:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a7b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.161645:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.161662:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.161722:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:2.0:1789395133.161727:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395133.161752:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.161783:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316a7ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105de2 expref: 11 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.161805:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105de2 expref: 10 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.161816:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395133.161820:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395133.161824:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc600, rc 0) 00000100:00080000:0.0:1789395133.161872:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395133.162123:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18245:x1876316231715840:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 440us (10648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.162131:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23454 00000100:00100000:3.0:1789395133.169701:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395133.172268:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231715968 00000100:00100000:0.0:1789395133.172288:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231715968 00000100:00100000:0.0:1789395133.172378:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23455 00000100:00100000:0.0:1789395133.172410:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18245:x1876316231715968:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395133.172442:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395133.172471:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316a7bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105de9 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172562:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172586:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172598:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172616:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172623:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172630:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172700:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172709:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172717:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172724:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172730:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395133.172735:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172745:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172760:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395133.172764:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395133.172770:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172777:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316a7c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172791:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172797:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172802:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172807:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395133.172810:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172816:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172822:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395133.172824:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395133.172827:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172832:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316a7c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172873:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316a7bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105de9 expref: 11 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172885:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395133.172887:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395133.172892:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316a7bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105de9 expref: 11 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.172901:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa000, rc 0) 00000100:00100000:0.0:1789395133.173015:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18245:x1876316231715968:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 608us (3329us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395133.173024:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23455 00010000:00010000:2.0:1789395133.180160:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395133.183572:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395133.183725:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231716224 00000100:00100000:1.0:1789395133.183738:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231716224 00000100:00100000:1.0:1789395133.183803:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23456 00000100:00100000:1.0:1789395133.183815:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18245:x1876316231716224:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395133.183893:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395133.183937:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a7b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105de2 expref: 10 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.183965:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395133.183972:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395133.184066:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.184082:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.184098:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.184116:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.184123:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.184130:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:02000000:1.0:1789395133.184908:0:6513:0:(lod_object.c:4389:lod_xattr_set_lmv()) *** cfs_fail_loc=188, val=0*** 00000040:00080000:1.0:1789395133.196244:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].398, 1760 off596064 00000040:00080000:1.0:1789395133.202218:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].395, 1928 off649720 00000004:00080000:1.0:1789395133.202249:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4d92d3780 with version 754 00000004:00080000:1.0:1789395133.202285:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 754 rpc_version 754 00000020:00100000:1.0:1789395133.202338:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395133.202353:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4fef29180 x1876316239665152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395133.202382:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239665152:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395133.202488:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.202552:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.202874:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665152 00000100:00100000:3.0:1789395133.202884:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665152 00000100:00100000:3.0:1789395133.202970:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245 00000100:00100000:3.0:1789395133.202981:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:7874:x1876316239665152:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395133.203223:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:7874:x1876316239665152:12345-0@lo:1000:osp_up1-0.0 Request processed in 243us (734us total) trans 4294968457 rc 0/0 00000100:00100000:3.0:1789395133.203231:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245 00000100:00100000:3.0:1789395133.203302:0:7874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968445 gen 2 00000004:00080000:3.0:1789395133.203308:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968445 committed transno 4294968445 00000100:00100000:3.0:1789395133.203343:0:7874:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a3c904c000 x1876316239660672/t4294968446(4294968446) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395148 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789395133.203375:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239665152:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1789395133.210630:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210656:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210670:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210696:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210704:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210710:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210757:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210765:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.210776:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395133.210807:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239665280:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1789395133.210894:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.210990:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca4806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.211214:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665280 00000100:00100000:2.0:1789395133.211225:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665280 00000100:00100000:2.0:1789395133.211290:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:2.0:1789395133.211302:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6513:x1876316239665280:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395133.211328:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.211359:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a7f3 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a7ec expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.211407:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a7f3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a7ec expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.211421:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a7f3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a7ec expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.211431:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcc:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395133.211434:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.211438:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cca00, rc 0) 00000100:00100000:2.0:1789395133.211485:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+22:6513:x1876316239665280:12345-0@lo:101:mdt00_002.0 Request processed in 186us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.211492:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00100000:1.0:1789395133.211838:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239665280:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395133.211857:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.211868:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395133.211894:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b98a1ee reply state 000000001b72cc80 transno 4294983503 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.211996:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212006:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:1.0:1789395133.212009:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395133.212012:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395133.212020:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212028:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395133.212040:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xcc:0x0] 00000004:00010000:1.0:1789395133.212047:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b98a1ee reply state 000000001b72cc80 transno 4294983503 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212055:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212060:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:1.0:1789395133.212062:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395133.212064:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1789395133.212070:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00010000:00010000:1.0:1789395133.212082:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212088:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212094:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212102:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212108:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395133.212113:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212120:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212133:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395133.212136:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395133.212140:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212146:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316a7d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395133.212158:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b98a1ee reply state 000000001b72cc80 transno 4294983503 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212166:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.212172:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4c7eb6e00) 00010000:00010000:1.0:1789395133.212174:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395133.212176:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1789395133.212574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18245:x1876316231716224:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 28756us (29012us total) trans 4294983503 rc 0/0 00000100:00100000:1.0:1789395133.212583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23456 00000100:00100000:0.0:1789395133.240677:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.240771:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231716352 00000100:00100000:2.0:1789395133.240785:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231716352 00000100:00100000:2.0:1789395133.240867:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23457 00000100:00100000:2.0:1789395133.240880:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18090:x1876316231716352:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395133.240926:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.240965:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a7fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105df0 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.241058:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.241077:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.241091:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.241149:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:2.0:1789395133.241153:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395133.241178:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.241208:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a7fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105df0 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.241229:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105df0 expref: 12 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.241240:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395133.241244:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395133.241249:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd600, rc 0) 00000100:00100000:2.0:1789395133.241326:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18090:x1876316231716352:12345-192.168.203.54@tcp:101:bash.0 Request processed in 449us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.241334:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23457 00000100:00100000:2.0:1789395133.256598:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.256918:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231716480 00000100:00100000:3.0:1789395133.256931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231716480 00000100:00100000:3.0:1789395133.257018:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23458 00000100:00100000:3.0:1789395133.257031:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18090:x1876316231716480:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.257058:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.257083:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316a808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105df7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257167:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257184:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257198:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257211:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257219:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257225:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257321:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a81d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257336:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a81d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257344:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a81d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395133.257487:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00000004:00200000:3.0:1789395133.257493:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1789395133.257518:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a81d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257535:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257541:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257557:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257564:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257570:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395133.257575:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257585:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257600:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395133.257604:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.257610:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257617:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a80f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257634:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257640:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257646:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257652:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395133.257655:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257661:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257668:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4c7eb6e00) 00010000:00010000:3.0:1789395133.257670:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.257673:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257679:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257711:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316a808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105df7 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257732:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a81d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105df7 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.257740:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:3.0:1789395133.257743:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789395133.257746:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:3.0:1789395133.257832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231716480:12345-192.168.203.54@tcp:101:bash.0 Request processed in 803us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.257842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23458 00000100:00100000:1.0:1789395133.272907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.272993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231716608 00000100:00100000:2.0:1789395133.273006:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231716608 00000100:00100000:2.0:1789395133.273076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23459 00000100:00100000:2.0:1789395133.273089:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231716608:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395133.273116:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.273142:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a824 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105dfe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.273217:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a82b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.273234:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a82b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.273249:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a82b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.273313:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:2.0:1789395133.273320:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1789395133.273375:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a824 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dfe expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.273435:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a82b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dfe expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.273446:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:2.0:1789395133.273451:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395133.273456:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd400, rc 0) 00000100:00100000:2.0:1789395133.273525:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18090:x1876316231716608:12345-192.168.203.54@tcp:101:bash.0 Request processed in 439us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.273534:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23459 00000100:00100000:0.0:1789395133.293661:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.293773:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231716864 00000100:00100000:2.0:1789395133.293786:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231716864 00000100:00100000:2.0:1789395133.293860:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23460 00000100:00100000:2.0:1789395133.293872:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18090:x1876316231716864:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395133.293901:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.293905:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789395133.293940:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316a82b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105dfe expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.293968:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:2.0:1789395133.293974:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395133.293992:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a832 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e05 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294149:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294171:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294183:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294200:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294208:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294215:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395133.294750:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c8:0x0], index 1: 0 00010000:00010000:2.0:1789395133.294922:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a847 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294934:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294942:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.294994:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295002:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295010:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295018:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295024:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.295029:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295037:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295049:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:2.0:1789395133.295052:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.295056:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295063:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316a839 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395133.295076:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070313092 reply state 000000000f7e454b transno 4294983504 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295088:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295094:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a3ca366900) 00010000:00010000:2.0:1789395133.295097:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395133.295099:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395133.295130:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316a832 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e05 expref: 16 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295144:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e05 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.295153:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:2.0:1789395133.295155:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395133.295158:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc000, rc 0) 00000100:00100000:2.0:1789395133.295254:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231716864:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1384us (1608us total) trans 4294983504 rc 0/0 00000100:00100000:2.0:1789395133.295264:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23460 00000100:00100000:1.0:1789395133.302142:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.302209:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231716992 00000100:00100000:3.0:1789395133.302221:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231716992 00000100:00100000:3.0:1789395133.306208:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5191 00000100:00100000:3.0:1789395133.306233:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:18090:x1876316231716992:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.306261:0:14639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.306291:0:14639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e0c expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395133.306323:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395133.306354:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789395133.306359:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395133.306371:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 7 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.306409:0:14639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 7 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.306439:0:14639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d400, rc 0) 00000100:00100000:3.0:1789395133.306529:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18090:x1876316231716992:12345-192.168.203.54@tcp:101:bash.0 Request processed in 306us (4401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.306536:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5191 00000100:00080000:0.0:1789395133.310791:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789395133.313451:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.313602:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231717248 00000100:00100000:3.0:1789395133.313615:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231717248 00000100:00100000:3.0:1789395133.313679:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5052 00000100:00100000:3.0:1789395133.313691:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231717248:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395133.314102:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231717248:12345-192.168.203.54@tcp:35:bash.0 Request processed in 411us (664us total) trans 4294983505 rc 0/0 00000100:00100000:3.0:1789395133.314110:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5052 00000100:00100000:1.0:1789395133.332070:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.332156:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231717504 00000100:00100000:3.0:1789395133.332170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231717504 00000100:00100000:3.0:1789395133.332268:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23461 00000100:00100000:3.0:1789395133.332281:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231717504:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.332313:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.332350:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a85c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e13 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.332518:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.332537:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.332559:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.332578:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.332585:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.332592:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395133.335582:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c8:0x0], index 0: 0 00010000:00010000:3.0:1789395133.335865:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316a871 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335887:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316a871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335900:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316a871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335957:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335966:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335972:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335980:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.335986:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395133.335993:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336001:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336016:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:3.0:1789395133.336020:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.336026:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336033:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a863 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395133.336050:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082da8377 reply state 000000007b948d9a transno 4294983506 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336062:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336068:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a3ca363b00) 00010000:00010000:3.0:1789395133.336071:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395133.336074:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395133.336120:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a85c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e13 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336137:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316a871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e13 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.336145:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:3.0:1789395133.336147:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395133.336151:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10de00, rc 0) 00000100:00100000:3.0:1789395133.336250:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18090:x1876316231717504:12345-192.168.203.54@tcp:101:bash.0 Request processed in 3971us (4193us total) trans 4294983506 rc 0/0 00000100:00100000:3.0:1789395133.336259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23461 00000100:00100000:2.0:1789395133.365761:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395133.366882:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231717632 00000100:00100000:0.0:1789395133.366897:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231717632 00000100:00100000:0.0:1789395133.366989:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5192 00000100:00100000:0.0:1789395133.367003:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18090:x1876316231717632:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395133.367027:0:14652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395133.367057:0:14652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e1a expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395133.367088:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395133.367120:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=584s v=(0 0) 00010000:00010000:0.0:1789395133.367127:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395133.367139:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 8 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.367158:0:14652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 8 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.367173:0:14652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aaa00, rc 0) 00000100:00100000:0.0:1789395133.367252:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18090:x1876316231717632:12345-192.168.203.54@tcp:101:bash.0 Request processed in 253us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.367261:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5192 00000100:00080000:0.0:1789395133.367290:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395133.383373:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.383692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231717888 00000100:00100000:2.0:1789395133.383704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231717888 00000100:00100000:2.0:1789395133.383774:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5053 00000100:00100000:2.0:1789395133.383787:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18090:x1876316231717888:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:2.0:1789395133.384177:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18090:x1876316231717888:12345-192.168.203.54@tcp:35:bash.0 Request processed in 391us (818us total) trans 4294983507 rc 0/0 00000100:00100000:2.0:1789395133.384187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5053 00000100:00100000:0.0:1789395133.404315:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.404442:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231718144 00000100:00100000:3.0:1789395133.404456:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231718144 00000100:00100000:3.0:1789395133.404527:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23462 00000100:00100000:3.0:1789395133.404539:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18090:x1876316231718144:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.404573:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.404599:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a886 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e21 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.404735:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.404755:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.404768:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.404785:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.404793:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.404800:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395133.405215:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c9:0x0], index 1: 0 00010000:00010000:3.0:1789395133.405419:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a89b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405429:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405437:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405474:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405482:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405488:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405495:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405502:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395133.405507:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405516:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405530:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:3.0:1789395133.405533:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.405538:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405549:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a88d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395133.405564:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000934ccfb0 reply state 00000000afbbeca3 transno 4294983508 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405575:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405581:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca363a00) 00010000:00010000:3.0:1789395133.405583:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395133.405586:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395133.405618:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a886 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e21 expref: 24 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405635:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e21 expref: 23 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.405643:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395133.405645:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395133.405648:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d200, rc 0) 00000100:00100000:3.0:1789395133.405726:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:18090:x1876316231718144:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1189us (1426us total) trans 4294983508 rc 0/0 00000100:00100000:3.0:1789395133.405735:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23462 00000100:00100000:0.0:1789395133.413217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.413292:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231718272 00000100:00100000:3.0:1789395133.413304:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231718272 00000100:00100000:3.0:1789395133.413374:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5193 00000100:00100000:3.0:1789395133.413411:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18090:x1876316231718272:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.413442:0:14650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.413469:0:14650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e28 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395133.413500:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395133.413527:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789395133.413532:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395133.413542:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 8 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.413560:0:14650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 8 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.413574:0:14650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10dc00, rc 0) 00000100:00100000:3.0:1789395133.413634:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18090:x1876316231718272:12345-192.168.203.54@tcp:101:bash.0 Request processed in 250us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.413642:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5193 00000100:00100000:0.0:1789395133.423211:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.423293:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231718528 00000100:00100000:2.0:1789395133.423306:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231718528 00000100:00100000:2.0:1789395133.423377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5054 00000100:00100000:0.0:1789395133.423694:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:18090:x1876316231718528:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395133.424157:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18090:x1876316231718528:12345-192.168.203.54@tcp:35:bash.0 Request processed in 523us (958us total) trans 4294983509 rc 0/0 00000100:00100000:0.0:1789395133.424166:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5054 00000100:00100000:0.0:1789395133.435785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.435957:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231718784 00000100:00100000:3.0:1789395133.435971:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231718784 00000100:00100000:3.0:1789395133.436086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23463 00000100:00100000:3.0:1789395133.436098:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18090:x1876316231718784:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.436135:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.436165:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a8b0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e2f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.436315:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.436346:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.436360:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.436378:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.436422:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.436431:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395133.437005:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c9:0x0], index 0: 0 00010000:00010000:3.0:1789395133.437179:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316a8c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437189:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437196:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437234:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437242:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437248:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437256:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437262:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395133.437267:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437276:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437290:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:3.0:1789395133.437293:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.437299:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437307:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8b7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395133.437324:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007158f273 reply state 000000009d7565d5 transno 4294983510 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437336:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437343:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3ca363400) 00010000:00010000:3.0:1789395133.437346:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395133.437348:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395133.437450:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316a8b0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e2f expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437469:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316a8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e2f expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.437477:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:3.0:1789395133.437480:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395133.437482:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:3.0:1789395133.437573:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:18090:x1876316231718784:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1476us (1863us total) trans 4294983510 rc 0/0 00000100:00100000:3.0:1789395133.437582:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23463 00000100:00100000:0.0:1789395133.449817:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.449980:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231718912 00000100:00100000:3.0:1789395133.449993:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231718912 00000100:00100000:3.0:1789395133.450061:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5194 00000100:00100000:3.0:1789395133.450073:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18090:x1876316231718912:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.450099:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.450127:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e36 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395133.450160:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395133.450192:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789395133.450198:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395133.450209:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.450229:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.450244:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c600, rc 0) 00000100:00100000:3.0:1789395133.450315:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18090:x1876316231718912:12345-192.168.203.54@tcp:101:bash.0 Request processed in 245us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.450323:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5194 00000100:00100000:2.0:1789395133.472336:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.472456:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231719168 00000100:00100000:3.0:1789395133.472469:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231719168 00000100:00100000:3.0:1789395133.472555:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5055 00000100:00100000:3.0:1789395133.472568:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:18090:x1876316231719168:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395133.472971:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18090:x1876316231719168:12345-192.168.203.54@tcp:35:bash.0 Request processed in 403us (657us total) trans 4294983511 rc 0/0 00000100:00100000:3.0:1789395133.472979:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5055 00000100:00100000:1.0:1789395133.481115:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.481283:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231719424 00000100:00100000:3.0:1789395133.481298:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231719424 00000100:00100000:3.0:1789395133.481404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23464 00000100:00100000:3.0:1789395133.481611:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18090:x1876316231719424:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.481651:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.481678:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8da lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e3d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.482030:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.482050:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.482064:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.482083:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.482096:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.482103:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395133.484262:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ca:0x0], index 1: 0 00010000:00010000:0.0:1789395133.498488:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316a8ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498521:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316a8ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498680:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316a8ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498809:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498819:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498826:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498834:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.498841:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395133.499064:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499075:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499090:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:0.0:1789395133.499093:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395133.499098:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499106:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a8e1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395133.499128:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092c7184c reply state 00000000a9ceb9a3 transno 4294983512 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499142:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499148:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a3ca363100) 00010000:00010000:0.0:1789395133.499151:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395133.499155:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395133.499211:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a8da lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e3d expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499228:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316a8ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e3d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.499236:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:0.0:1789395133.499239:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395133.499241:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2abc00, rc 0) 00000100:00100000:0.0:1789395133.499345:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:18090:x1876316231719424:12345-192.168.203.54@tcp:101:bash.0 Request processed in 17930us (18245us total) trans 4294983512 rc 0/0 00000100:00100000:0.0:1789395133.499355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23464 00000100:00100000:1.0:1789395133.514247:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.514535:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231719552 00000100:00100000:3.0:1789395133.514619:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231719552 00000100:00100000:3.0:1789395133.514861:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5195 00000100:00100000:3.0:1789395133.514876:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18090:x1876316231719552:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395133.514903:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.514931:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e44 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395133.514974:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395133.515003:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789395133.515008:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395133.515019:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.515039:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.515054:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:3.0:1789395133.515139:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18090:x1876316231719552:12345-192.168.203.54@tcp:101:bash.0 Request processed in 267us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.515148:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5195 00000100:00100000:2.0:1789395133.524616:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395133.525233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231719808 00000100:00100000:1.0:1789395133.525248:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231719808 00000100:00100000:1.0:1789395133.525659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5056 00000100:00100000:1.0:1789395133.525673:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:18090:x1876316231719808:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395133.527109:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:18090:x1876316231719808:12345-192.168.203.54@tcp:35:bash.0 Request processed in 1429us (2497us total) trans 4294983513 rc 0/0 00000100:00100000:1.0:1789395133.527124:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5056 00000100:00100000:0.0:1789395133.533286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.533694:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231720064 00000100:00100000:2.0:1789395133.533826:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231720064 00000100:00100000:2.0:1789395133.534023:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23465 00000100:00100000:2.0:1789395133.534036:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:18090:x1876316231720064:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395133.534069:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.534099:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a904 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e4b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.534240:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.534258:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.534272:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.534290:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.534297:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.534304:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395133.535156:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ca:0x0], index 0: 0 00010000:00010000:2.0:1789395133.535706:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316a919 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.535838:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316a919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537047:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316a919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537128:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537142:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537150:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537165:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537172:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.537177:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537187:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537203:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:2.0:1789395133.537207:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.537213:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537221:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316a90b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395133.537242:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ca4005f reply state 00000000a3d0661b transno 4294983514 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537255:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.537262:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca366000) 00010000:00010000:2.0:1789395133.537266:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395133.537274:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395133.537827:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316a904 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e4b expref: 36 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.538220:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316a919 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e4b expref: 35 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.538232:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:2.0:1789395133.538234:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395133.538238:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc400, rc 0) 00000100:00100000:2.0:1789395133.538573:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:18090:x1876316231720064:12345-192.168.203.54@tcp:101:bash.0 Request processed in 4538us (5301us total) trans 4294983514 rc 0/0 00000100:00100000:2.0:1789395133.538585:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23465 00000100:00100000:3.0:1789395133.546722:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395133.547251:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231720192 00000100:00100000:1.0:1789395133.547264:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231720192 00000100:00100000:1.0:1789395133.547584:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5196 00000100:00100000:1.0:1789395133.547599:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18090:x1876316231720192:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395133.547623:0:14651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395133.547652:0:14651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e52 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395133.547684:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395133.547724:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1789395133.547730:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395133.547742:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 10 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.547926:0:14651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 10 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.547957:0:14651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395133.548039:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18090:x1876316231720192:12345-192.168.203.54@tcp:101:bash.0 Request processed in 443us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.548047:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5196 00000100:00100000:3.0:1789395133.554888:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395133.555129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231720448 00000100:00100000:1.0:1789395133.555144:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231720448 00000100:00100000:1.0:1789395133.555217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5057 00000100:00100000:1.0:1789395133.555229:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:18090:x1876316231720448:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395133.555885:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+37:18090:x1876316231720448:12345-192.168.203.54@tcp:35:bash.0 Request processed in 655us (1010us total) trans 4294983515 rc 0/0 00000100:00100000:1.0:1789395133.555896:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5057 00000100:00100000:0.0:1789395133.584933:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.585075:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231720704 00000100:00100000:3.0:1789395133.585088:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231720704 00000100:00100000:3.0:1789395133.585165:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23466 00000100:00100000:3.0:1789395133.585177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+37:18246:x1876316231720704:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395133.585210:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.585240:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a92e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e59 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.591841:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00010000:00010000:2.0:1789395133.592032:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a92e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e59 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.592054:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395133.592058:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395133.592065:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a92e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e59 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.592083:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:2.0:1789395133.592252:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:18246:x1876316231720704:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 7075us (7333us total) trans 4294983516 rc 301/301 00000100:00100000:2.0:1789395133.592263:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23466 00000100:00100000:2.0:1789395133.608549:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395133.608833:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231720832 00000100:00100000:1.0:1789395133.608856:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231720832 00000100:00100000:1.0:1789395133.608931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5058 00000100:00100000:1.0:1789395133.608943:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:18246:x1876316231720832:12345-192.168.203.54@tcp:33:lfs.0 00000004:00200000:1.0:1789395133.609141:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00000004:00200000:1.0:1789395133.609147:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1789395133.609304:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:18246:x1876316231720832:12345-192.168.203.54@tcp:33:lfs.0 Request processed in 361us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.609313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5058 00000100:00100000:2.0:1789395133.615986:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.616106:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231721088 00000100:00100000:3.0:1789395133.616119:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231721088 00000100:00100000:3.0:1789395133.616187:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5059 00000100:00100000:3.0:1789395133.616199:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:18246:x1876316231721088:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:2.0:1789395133.617242:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:18246:x1876316231721088:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 1037us (1262us total) trans 4294983517 rc 0/0 00000100:00100000:2.0:1789395133.617255:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5059 00000100:00100000:0.0:1789395133.651554:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.651715:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231721344 00000100:00100000:2.0:1789395133.651729:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231721344 00000100:00100000:2.0:1789395133.651812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23467 00000100:00100000:2.0:1789395133.651823:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:18247:x1876316231721344:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395133.651866:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.651896:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a93c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.652114:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a943 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.652132:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a943 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.652144:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a943 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.652156:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00010000:00010000:2.0:1789395133.652279:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316a93c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e60 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.652300:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a943 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e60 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.652311:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:2.0:1789395133.652315:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789395133.652320:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cda00, rc 0) 00000100:00100000:2.0:1789395133.652659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:18247:x1876316231721344:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 835us (1117us total) trans 4294983518 rc 0/0 00000100:00100000:2.0:1789395133.652667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23467 00000100:00100000:0.0:1789395133.662661:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395133.662996:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.664557:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231721472 00000100:00100000:3.0:1789395133.664575:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231721472 00000100:00100000:3.0:1789395133.664678:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1329 00000100:00100000:3.0:1789395133.664691:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:2396:x1876316231721472:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:3.0:1789395133.664714:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395133.664747:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316a801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105df0 expref: 41 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.664772:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395133.664779:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395133.664870:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:2396:x1876316231721472:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 180us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.664879:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1329 00000100:00100000:2.0:1789395133.668209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231721728 00000100:00100000:2.0:1789395133.668231:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231721728 00000100:00100000:2.0:1789395133.668346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5060 00000100:00100000:2.0:1789395133.668359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:18247:x1876316231721728:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:2.0:1789395133.669054:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:18247:x1876316231721728:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 693us (6404us total) trans 4294983519 rc 0/0 00000100:00100000:2.0:1789395133.669064:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5060 00000100:00100000:1.0:1789395133.675005:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.675118:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231721856 00000100:00100000:2.0:1789395133.675132:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231721856 00000100:00100000:2.0:1789395133.675216:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1330 00000100:00100000:2.0:1789395133.675228:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:2396:x1876316231721856:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:2.0:1789395133.675249:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789395133.675285:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e60 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.675312:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a81d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105df7 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.675338:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:2.0:1789395133.675344:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395133.675466:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:2396:x1876316231721856:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 239us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.675474:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1330 00000100:00100000:0.0:1789395133.682520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.682826:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231722112 00000100:00100000:2.0:1789395133.682841:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231722112 00000100:00100000:2.0:1789395133.682962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:2.0:1789395133.682974:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:18247:x1876316231722112:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:2.0:1789395133.683127:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.683139:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.683150:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.683180:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665408:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395133.683243:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.683312:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789395133.683424:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395133.683539:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665408 00000100:00100000:1.0:1789395133.683546:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665408 00000100:00100000:1.0:1789395133.683586:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247 00000100:00100000:1.0:1789395133.683593:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+26:6524:x1876316239665408:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395133.683605:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395133.683625:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316a958 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a951 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.683656:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316a958 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a951 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.683683:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316a958 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a951 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.683694:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395133.683697:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395133.683701:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0600, rc 0) 00000100:00100000:1.0:1789395133.683761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665408:12345-0@lo:101:mdt_io00_000.0 Request processed in 168us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.683768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247 00000100:00100000:2.0:1789395133.683807:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665408:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395133.683827:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.683840:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395133.683917:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:2.0:1789395133.683939:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1789395133.683993:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665536:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.684029:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.684064:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789395133.684233:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665536 00000100:00100000:1.0:1789395133.684239:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665536 00000100:00100000:1.0:1789395133.684277:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248 00000100:00100000:1.0:1789395133.684285:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665536:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.684661:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665536:12345-0@lo:1000:mdt_io00_000.0 Request processed in 375us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.684669:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248 00000100:00100000:2.0:1789395133.684761:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665536:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.684827:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665664:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.687101:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.687180:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.687435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665664 00000100:00100000:3.0:1789395133.687447:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665664 00000100:00100000:3.0:1789395133.687520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:3.0:1789395133.687530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665664:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.687645:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665664:12345-0@lo:1000:mdt_io00_000.0 Request processed in 116us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.687653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:2.0:1789395133.688231:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665664:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.688345:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665792:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.688422:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.688459:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.688658:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665792 00000100:00100000:3.0:1789395133.688665:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665792 00000100:00100000:3.0:1789395133.688709:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250 00000100:00100000:3.0:1789395133.688717:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665792:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.688842:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665792:12345-0@lo:1000:mdt_io00_000.0 Request processed in 125us (419us total) trans 0 rc 1/1 00000100:00100000:3.0:1789395133.688849:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250 00000100:00100000:2.0:1789395133.688965:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665792:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.689039:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665920:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.689065:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.689089:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.689132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239665920 00000100:00100000:3.0:1789395133.689137:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239665920 00000100:00100000:3.0:1789395133.689167:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1789395133.689173:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665920:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.689233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239665920:12345-0@lo:1000:mdt_io00_000.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.689240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000100:00100000:2.0:1789395133.689340:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239665920:0@lo:1000:mdt_io00_000.0 00010000:00010000:2.0:1789395133.689444:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.689457:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.689468:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.689482:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666048:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395133.689507:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.689534:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.689752:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666048 00000100:00100000:3.0:1789395133.689757:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666048 00000100:00100000:3.0:1789395133.689793:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252 00000100:00100000:3.0:1789395133.689800:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:6524:x1876316239666048:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395133.689810:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.689830:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316a966 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a95f expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.689859:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316a966 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a95f expref: 28 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.689875:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316a966 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a95f expref: 28 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.689884:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395133.689888:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.689892:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c200, rc 0) 00000100:00100000:3.0:1789395133.689931:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+28:6524:x1876316239666048:12345-0@lo:101:mdt_io00_000.0 Request processed in 131us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.689938:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252 00000100:00100000:2.0:1789395133.690049:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666048:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395133.690066:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.690078:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395133.690094:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789395133.690120:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.690128:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.690136:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.690149:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666176:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395133.690171:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.690193:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.691610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666176 00000100:00100000:3.0:1789395133.691626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666176 00000100:00100000:3.0:1789395133.691738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3253 00000100:00100000:3.0:1789395133.691749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+28:6524:x1876316239666176:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395133.691769:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.691797:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a96d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.691828:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.691844:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.691867:0:6516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1789395133.691906:0:6516:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1789395133.691992:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.692002:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4c7eb6e00) 00010000:00010000:3.0:1789395133.692005:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.692008:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.692016:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:3.0:1789395133.692088:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:6524:x1876316239666176:12345-0@lo:101:mdt_io00_000.0 Request processed in 341us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.692095:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3253 00000100:00100000:2.0:1789395133.692170:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666176:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395133.692189:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.692199:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.698244:0:6490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395133.698277:0:6490:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.698350:0:6490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.698358:0:6490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395133.698419:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0e00/0xff35729af316a7ec lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a7f3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395133.698443:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983519 is committed 00000001:00080000:0.0:1789395133.698494:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983502 is committed 00000100:00100000:0.0:1789395133.698540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239666304:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1789395133.698630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395133.698776:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698785:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698793:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698800:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.698805:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698813:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698830:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4c7eb6e00) 00010000:00010000:2.0:1789395133.698833:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.698838:0:3623:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698849:0:3623:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698858:0:3623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.698895:0:3623:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.698907:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3623:1876316239666432:0@lo:105: 00000100:00100000:2.0:1789395133.698943:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.698984:0:3623:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395133.699512:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666432 00000100:00100000:0.0:1789395133.699522:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666432 00000100:00100000:0.0:1789395133.699583:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1789395133.699593:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3623:x1876316239666432:12345-0@lo:105: 00010000:00010000:0.0:1789395133.699609:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.699620:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.699631:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.699645:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.699653:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.699662:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.699682:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3cd200) 00000100:00100000:0.0:1789395133.699731:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3623:x1876316239666432:12345-0@lo:105: Request processed in 138us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.699739:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1789395133.699841:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3623:1876316239666432:0@lo:105: 00010000:00010000:2.0:1789395133.699877:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699886:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316a7d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699901:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699908:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699915:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699921:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.699925:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699933:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699943:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a4c7eb6600) 00010000:00010000:2.0:1789395133.699954:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.699957:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699964:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316a7de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699980:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699988:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699994:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.699999:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700002:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700009:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700016:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:2.0:1789395133.700018:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700022:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700027:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316a7e5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700043:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700049:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700055:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700061:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700065:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700070:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700077:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a3ca366900) 00010000:00010000:2.0:1789395133.700080:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700083:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700090:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a840 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700105:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700111:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700117:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700122:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700125:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700131:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700144:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a3ca363b00) 00010000:00010000:2.0:1789395133.700147:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700150:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700156:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316a86a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700170:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700176:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700182:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700188:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700191:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700197:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700205:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca363a00) 00010000:00010000:2.0:1789395133.700208:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700211:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700216:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316a894 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700230:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700236:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700242:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700247:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700251:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700256:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700263:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3ca363400) 00010000:00010000:2.0:1789395133.700266:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700268:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700274:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a8be lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700287:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700294:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700301:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700307:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700310:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700317:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700323:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a3ca363100) 00010000:00010000:2.0:1789395133.700326:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700519:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700526:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a8e8 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700545:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700552:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700558:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700564:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.700567:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700574:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700588:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca366000) 00010000:00010000:2.0:1789395133.700591:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.700594:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700600:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a912 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700627:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700637:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395133.700664:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789395133.700723:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700732:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.700744:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.700764:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666560:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395133.700805:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.705726:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395133.708637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666560 00000100:00100000:1.0:1789395133.708665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666560 00000100:00100000:1.0:1789395133.708714:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666304 00000100:00100000:1.0:1789395133.708720:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666304 00000100:00100000:1.0:1789395133.708915:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1789395133.708929:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+22:3638:x1876316239666304:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1789395133.708958:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395133.708992:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cca00/0xff35729af316a7f3 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a7ec expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.709018:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcc:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395133.709031:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395133.709130:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+21:3638:x1876316239666304:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 204us (10499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.709138:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1789395133.712639:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254 00000100:00100000:0.0:1789395133.712656:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:6524:x1876316239666560:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1789395133.712687:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395133.712721:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316a982 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a97b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.712761:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316a982 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a97b expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.712779:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316a982 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a97b expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.712789:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395133.712793:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395133.712797:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aba00, rc 0) 00000100:00100000:0.0:1789395133.712894:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666560:12345-0@lo:101:mdt_io00_000.0 Request processed in 241us (12088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.712901:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254 00000100:00100000:3.0:1789395133.713029:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983502 gen 2 00000004:00080000:3.0:1789395133.713037:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983497 committed transno 4294983502 00000004:00080000:3.0:1789395133.713066:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983498 committed transno 4294983502 00000004:00080000:3.0:1789395133.713077:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983499 committed transno 4294983502 00000004:00080000:3.0:1789395133.713088:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983500 committed transno 4294983502 00000004:00080000:3.0:1789395133.713099:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983501 committed transno 4294983502 00000004:00080000:3.0:1789395133.713107:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983502 committed transno 4294983502 00000100:00100000:3.0:1789395133.713124:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666560:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395133.713149:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.713161:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395133.713183:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x151c:0x0] 00000100:00100000:3.0:1789395133.713245:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666688:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.713294:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395133.713345:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.713785:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666688 00000100:00100000:2.0:1789395133.713796:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666688 00000100:00100000:2.0:1789395133.713843:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:2.0:1789395133.713852:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666688:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.713938:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666688:12345-0@lo:1000:mdt_io00_000.0 Request processed in 87us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.713955:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00000100:00100000:3.0:1789395133.714042:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666688:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1789395133.714079:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x151c:0x0] 00000100:00100000:3.0:1789395133.714111:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666816:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.714141:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395133.714171:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395133.714240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666816 00000100:00100000:0.0:1789395133.714246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666816 00000100:00100000:0.0:1789395133.714283:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1789395133.714291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666816:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.714608:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666816:12345-0@lo:1000:mdt_io00_000.0 Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.714617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:3.0:1789395133.714701:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666816:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.715912:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239666304:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1789395133.717487:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666944:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1789395133.717589:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.717638:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.717780:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239666944 00000100:00100000:3.0:1789395133.717791:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239666944 00000100:00100000:3.0:1789395133.717853:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:3.0:1789395133.717864:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666944:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395133.723661:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239666944:12345-0@lo:403:mdt_io00_000.0 Request processed in 5784us (6057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.723679:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:1.0:1789395133.724021:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239666944:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1789395133.725249:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667072:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.725643:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.725682:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca4806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.727988:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667072 00000100:00100000:3.0:1789395133.728010:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667072 00000100:00100000:3.0:1789395133.728101:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:3.0:1789395133.728113:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667072:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.728280:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667072:12345-0@lo:1000:mdt_io00_000.0 Request processed in 169us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.728292:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00100000:1.0:1789395133.729955:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667072:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.730064:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667200:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.730132:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.730174:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca4806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.730584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667200 00000100:00100000:2.0:1789395133.730593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667200 00000100:00100000:2.0:1789395133.730663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259 00000100:00100000:2.0:1789395133.730674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667200:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.730784:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667200:12345-0@lo:1000:mdt_io00_000.0 Request processed in 111us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.730792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259 00000100:00100000:1.0:1789395133.731141:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667200:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.737050:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667328:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1789395133.737167:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.737220:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.738533:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667328 00000100:00100000:3.0:1789395133.738560:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667328 00000100:00100000:3.0:1789395133.738639:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260 00000100:00100000:3.0:1789395133.738650:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667328:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1789395133.762909:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667328:12345-0@lo:403:mdt_io00_000.0 Request processed in 24247us (25728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.762928:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260 00000100:00100000:1.0:1789395133.763066:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667328:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1789395133.764080:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667456:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.764141:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.764216:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca4806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.764720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667456 00000100:00100000:2.0:1789395133.764731:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667456 00000100:00100000:2.0:1789395133.764809:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:2.0:1789395133.764820:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667456:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.765060:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667456:12345-0@lo:1000:mdt_io00_000.0 Request processed in 241us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.765069:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00100000:3.0:1789395133.770293:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667456:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.770653:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667584:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.770744:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.770829:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.770978:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667584 00000100:00100000:2.0:1789395133.770986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667584 00000100:00100000:2.0:1789395133.771050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00100000:2.0:1789395133.771061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667584:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.771188:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667584:12345-0@lo:1000:mdt_io00_000.0 Request processed in 129us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.771198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00000100:00100000:0.0:1789395133.771550:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667584:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.771600:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667712:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.771631:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.771665:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395133.771777:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667712 00000100:00100000:1.0:1789395133.771783:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667712 00000100:00100000:1.0:1789395133.771825:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:1.0:1789395133.771834:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667712:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395133.771910:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667712:12345-0@lo:1000:mdt_io00_000.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.771918:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:0.0:1789395133.775971:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667712:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.776088:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667840:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.776170:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.776229:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.776330:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667840 00000100:00100000:2.0:1789395133.776339:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667840 00000100:00100000:2.0:1789395133.776450:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:2.0:1789395133.776462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667840:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.776595:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667840:12345-0@lo:1000:mdt_io00_000.0 Request processed in 134us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.776602:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00100000:0.0:1789395133.776789:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667840:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.776830:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667968:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.776857:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.776890:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.777303:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239667968 00000100:00100000:3.0:1789395133.777310:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239667968 00000100:00100000:3.0:1789395133.777365:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1789395133.777374:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667968:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.777486:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239667968:12345-0@lo:1000:mdt_io00_000.0 Request processed in 113us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.777493:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:0.0:1789395133.777833:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239667968:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.778866:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668096:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1789395133.778934:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.779051:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356540 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.782938:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668096 00000100:00100000:2.0:1789395133.783067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668096 00000100:00100000:3.0:1789395133.786214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:3.0:1789395133.786233:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668096:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1789395133.790352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668096:12345-0@lo:403:mdt_io00_000.0 Request processed in 4110us (11403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.790371:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:0.0:1789395133.790572:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668096:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1789395133.791362:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668224:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.791452:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.808523:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668224 00000100:00100000:2.0:1789395133.809443:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668224 00000100:00100000:0.0:1789395133.810776:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:0.0:1789395133.810791:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668224:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395133.810964:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668224:12345-0@lo:1000:mdt_io00_000.0 Request processed in 176us (19511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.810974:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00000100:00100000:2.0:1789395133.818931:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.819014:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668224:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.819178:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668352:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.819264:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.819304:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.819453:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668352 00000100:00100000:3.0:1789395133.819462:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668352 00000100:00100000:3.0:1789395133.819519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:3.0:1789395133.819532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668352:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.825171:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668352:12345-0@lo:1000:mdt_io00_000.0 Request processed in 5625us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.825191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00100000:2.0:1789395133.829680:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668352:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.829911:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668480:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395133.830017:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.830231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668480 00000100:00100000:2.0:1789395133.830240:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668480 00000100:00100000:2.0:1789395133.830297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:2.0:1789395133.830307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668480:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395133.830441:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6524:x1876316239668480:12345-0@lo:1000:mdt_io00_000.0 Request processed in 135us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.830449:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1789395133.830744:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.830770:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668480:0@lo:1000:mdt_io00_000.0 00000040:00080000:3.0:1789395133.833142:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].389, 2464 off582640 00000040:00080000:3.0:1789395133.833231:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].389, 2544 off636648 00000004:00080000:3.0:1789395133.833240:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca6cd900 with version 743 00000004:00080000:2.0:1789395133.833330:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 743 rpc_version 743 00000020:00100000:2.0:1789395133.833406:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395133.833618:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c988ed80 x1876316239668736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395133.833649:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239668736:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395133.833750:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.833859:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668736 00000100:00100000:0.0:1789395133.833869:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668736 00000100:00100000:0.0:1789395133.833933:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:0.0:1789395133.833956:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239668736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395133.835186:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239668736:12345-0@lo:1000:osp_up0-1.0 Request processed in 890us (1083us total) trans 4294983520 rc 0/0 00000100:00100000:0.0:1789395133.835200:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:2.0:1789395133.850134:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.850251:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239668736:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395133.850763:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850786:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850803:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850835:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850844:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850855:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850904:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850912:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.850925:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395133.850964:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668864:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1789395133.851045:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.851139:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789395133.861013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668864 00000100:00100000:2.0:1789395133.861035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668864 00000100:00100000:3.0:1789395133.864785:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:3.0:1789395133.864804:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6524:x1876316239668864:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395133.864840:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.864873:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316a997 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.864914:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316a997 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.864932:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a997 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.865660:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:3.0:1789395133.865665:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395133.865670:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:3.0:1789395133.867712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+26:6524:x1876316239668864:12345-0@lo:101:mdt_io00_000.0 Request processed in 2899us (16654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.867729:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00100000:1.0:1789395133.870905:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6524:1876316239668864:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395133.871000:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871018:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395133.871056:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a34f062a reply state 0000000039f1cb34 transno 4294968458 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871072:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871081:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395133.871086:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395133.871092:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395133.871100:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871108:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395133.871124:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000004:00010000:1.0:1789395133.871139:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a34f062a reply state 0000000039f1cb34 transno 4294968458 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871148:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871153:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:1.0:1789395133.871156:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395133.871157:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1789395133.871171:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x151c:0x0] 00010000:00010000:1.0:1789395133.871181:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871188:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395133.871197:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395133.871206:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871213:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871226:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871268:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395133.871273:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395133.871278:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871286:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395133.871300:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395133.871306:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871312:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.871319:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.871675:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395133.871685:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.871693:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cdc00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395133.871700:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395133.871709:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.871760:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.871769:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789395133.871848:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239668992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395133.871936:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789395133.872090:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789395133.872200:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18247:x1876316231722112:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 189224us (189692us total) trans 4294968458 rc 0/0 00000100:00100000:1.0:1789395133.872211:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 0 00010000:00010000:2.0:1789395133.874564:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874587:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cdc00/0xff35729af316a95f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a966 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874617:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395133.874623:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874631:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395133.874638:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395133.874647:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874703:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874710:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395133.874733:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874741:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cda00/0xff35729af316a951 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a958 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.874759:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395133.874761:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395133.874763:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395133.874996:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239668992 00000100:00100000:3.0:1789395133.875007:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239668992 00000100:00100000:3.0:1789395133.875081:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1789395133.875093:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+26:3639:x1876316239668992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395133.875110:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395133.875133:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316a966 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a95f expref: 26 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.875150:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395133.875157:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395133.875258:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239669120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395133.875304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.875364:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239669120 00000100:00100000:1.0:1789395133.875369:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239669120 00000100:00100000:1.0:1789395133.875429:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1789395133.875436:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+26:3636:x1876316239669120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395133.875445:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395133.875457:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316a958 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a951 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.875469:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395133.875477:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395133.875504:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+25:3636:x1876316239669120:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.875510:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1789395133.877791:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239669120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395133.879451:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395133.881985:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+24:3639:x1876316239668992:12345-0@lo:103:ldlm_bl.0 Request processed in 6879us (10034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.882004:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789395133.884185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.884853:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231722240 00000100:00100000:3.0:1789395133.884869:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231722240 00000100:00100000:3.0:1789395133.884963:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23468 00000100:00100000:3.0:1789395133.884976:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18247:x1876316231722240:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395133.885008:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.885038:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a9a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e67 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.885131:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.885150:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.885169:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395133.885232:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395133.885235:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395133.885260:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.885289:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316a9a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 17 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.885309:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 16 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.886953:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395133.886966:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395133.886975:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d000, rc 0) 00000100:00100000:3.0:1789395133.887131:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18247:x1876316231722240:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 2151us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.887140:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23468 00000100:00100000:0.0:1789395133.892130:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239668992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395133.909776:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.915662:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231722496 00000100:00100000:2.0:1789395133.915684:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231722496 00000100:00100000:3.0:1789395133.915882:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23469 00000100:00100000:3.0:1789395133.915896:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18247:x1876316231722496:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395133.915925:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.915964:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316a9b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916065:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916084:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916098:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916109:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916119:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a96d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916128:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.916170:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316a96d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395133.916187:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1876316239669248:0@lo:104: 00000100:00100000:3.0:1789395133.916270:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395133.916350:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395133.916691:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239669248 00000100:00100000:0.0:1789395133.916697:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239669248 00000100:00100000:0.0:1789395133.916743:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1789395133.916751:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6511:x1876316239669248:12345-0@lo:104: 00010000:00010000:0.0:1789395133.916767:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.916832:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395133.916839:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6511:x1876316239669248:12345-0@lo:104: Request processed in 89us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.916846:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00010000:00010000:0.0:1789395133.916869:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395133.916877:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.916885:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395133.916892:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395133.916902:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.916934:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.916941:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395133.916981:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.916994:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd200/0xff35729af316a96d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316a974 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.917018:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395133.917020:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395133.917022:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395133.917030:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395133.917042:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239669376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395133.917081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395133.917118:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239669376 00000100:00100000:0.0:1789395133.917122:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239669376 00010000:00010000:0.0:1789395133.917140:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316a96d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395133.917166:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1789395133.917172:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6280450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+24:3636:x1876316239669376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395133.917182:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789395133.918665:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1876316239669248:0@lo:104: 00010000:00010000:2.0:1789395133.918706:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395133.927792:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983520 is committed 00010000:00010000:0.0:1789395133.928128:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316a974 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316a96d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.928154:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4c7eb6e00) 00010000:00010000:0.0:1789395133.928160:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.928171:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.928184:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395133.928219:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395133.928674:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.928685:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.928871:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239669504:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395133.928926:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.928976:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.929046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239669504 00000100:00100000:3.0:1789395133.929056:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239669504 00000100:00100000:3.0:1789395133.929122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00100000:3.0:1789395133.929133:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6511:x1876316239669504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395133.929226:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6511:x1876316239669504:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.929234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00100000:2.0:1789395133.929329:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6511:1876316239669504:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789395133.929428:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a9c8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929444:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929455:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a9c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929471:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929479:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929486:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929499:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929506:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.929512:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929522:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929721:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395133.929726:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.929732:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929740:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316a9ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929756:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929763:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929769:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929774:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395133.929777:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929787:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929795:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4c7eb6e00) 00010000:00010000:2.0:1789395133.929797:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395133.929800:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929806:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316a9c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929854:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316a9b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e6e expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929870:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a9c8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e6e expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.929876:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca366f00) 00010000:00010000:2.0:1789395133.929878:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395133.929880:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cda00, rc 0) 00000100:00100000:2.0:1789395133.929980:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18247:x1876316231722496:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 14052us (20184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.929989:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23469 00000100:00100000:0.0:1789395133.930092:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6280450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3636:x1876316239669376:12345-0@lo:103:ldlm_bl.0 Request processed in 12918us (13009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395133.930102:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:3.0:1789395133.934164:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.934252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231722752 00000100:00100000:2.0:1789395133.934265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231722752 00000100:00100000:2.0:1789395133.934348:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23470 00000100:00100000:2.0:1789395133.934360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18247:x1876316231722752:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395133.934433:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.934463:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a9cf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.934913:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:2.0:1789395133.935049:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a9cf lrc: 1/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e75 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.935066:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:2.0:1789395133.935070:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395133.935077:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a9cf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e75 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.935093:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cdc00, rc 0) 00000100:00100000:2.0:1789395133.935267:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18247:x1876316231722752:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 909us (1116us total) trans 4294968459 rc 301/301 00000100:00100000:2.0:1789395133.935276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23470 00000100:00100000:1.0:1789395133.936042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239669376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395133.940935:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395133.941094:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231722880 00000100:00100000:3.0:1789395133.941107:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231722880 00000100:00100000:3.0:1789395133.941213:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23471 00000100:00100000:3.0:1789395133.941226:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18247:x1876316231722880:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395133.941264:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395133.941292:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316a9dd lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e7c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.941447:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316a9e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.941468:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316a9e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.941483:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316a9e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395133.941792:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xc9:0x0]: returning size 4096 00000004:00200000:3.0:1789395133.941799:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1789395133.941858:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316a9dd lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e7c expref: 11 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.941880:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316a9e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e7c expref: 10 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.941891:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:3.0:1789395133.941895:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395133.941900:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10da00, rc 0) 00000100:00100000:3.0:1789395133.942010:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18247:x1876316231722880:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 786us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.942019:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23471 00000100:00100000:0.0:1789395133.950179:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.950231:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723008 00000100:00100000:2.0:1789395133.950246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723008 00000100:00100000:2.0:1789395133.950317:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23472 00000100:00100000:2.0:1789395133.950336:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18247:x1876316231723008:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395133.950363:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.950409:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a9eb lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e83 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.950518:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.950540:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316a997 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.950551:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 4/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.950596:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316a997 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.950614:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1876316239669632:0@lo:104: 00000100:00100000:2.0:1789395133.950671:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395133.950731:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789395133.950961:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239669632 00000100:00100000:3.0:1789395133.950968:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239669632 00000100:00100000:3.0:1789395133.951007:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1789395133.951016:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6511:x1876316239669632:12345-0@lo:104: 00010000:00010000:3.0:1789395133.951032:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395133.951102:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395133.951109:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6511:x1876316239669632:12345-0@lo:104: Request processed in 95us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395133.951115:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1789395133.951137:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1876316239669632:0@lo:104: 00010000:00010000:2.0:1789395133.951160:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.951171:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395133.951180:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.951189:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395133.951196:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395133.951207:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.951238:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.951246:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395133.951278:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.951287:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316a997 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316a99e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395133.951294:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239669760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395133.951310:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395133.951312:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395133.951314:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395133.951332:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395133.951440:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239669760 00000100:00100000:1.0:1789395133.951445:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239669760 00010000:00010000:1.0:1789395133.951466:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316a997 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395133.951497:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1789395133.951504:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+22:3638:x1876316239669760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395133.951516:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395133.952157:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316a99e lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316a997 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.952174:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:1.0:1789395133.952180:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.952190:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.952198:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395133.952230:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395133.952276:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239669760:12345-0@lo:103:ldlm_bl.0 Request processed in 772us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395133.952284:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1789395133.952290:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239669760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395133.952311:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.952319:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.952381:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:2.0:1789395133.952405:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1789395133.952460:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316a9eb lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e83 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.952476:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e83 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.952484:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:2.0:1789395133.952487:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395133.952490:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cde00, rc 0) 00000100:00100000:2.0:1789395133.952546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18247:x1876316231723008:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 2219us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.952553:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23472 00000100:00100000:1.0:1789395133.969579:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.969659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723136 00000100:00100000:2.0:1789395133.969673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723136 00000100:00100000:2.0:1789395133.969747:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23473 00000100:00100000:2.0:1789395133.969760:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18247:x1876316231723136:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395133.969790:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395133.969823:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a9f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e8a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.969913:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316aa00 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.969932:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316aa00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.969961:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316aa00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395133.970088:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:2.0:1789395133.970094:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1789395133.970118:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316aa00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.970147:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cdc00/0xff35729af316a9f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e8a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.970176:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316aa00 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e8a expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395133.970185:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:2.0:1789395133.970189:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395133.970193:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd000, rc 0) 00000100:00100000:2.0:1789395133.970273:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18247:x1876316231723136:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 516us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395133.970281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23473 00000100:00100000:1.0:1789395133.986864:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395133.987429:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723264 00000100:00100000:2.0:1789395133.987443:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723264 00000100:00100000:2.0:1789395133.987510:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5061 00000100:00100000:2.0:1789395133.987524:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18247:x1876316231723264:12345-192.168.203.54@tcp:37:lfs.0 00000100:00100000:2.0:1789395134.004309:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18247:x1876316231723264:12345-192.168.203.54@tcp:37:lfs.0 Request processed in 16773us (17455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.004336:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5061 00000100:00100000:1.0:1789395134.010288:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.010500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723392 00000100:00100000:2.0:1789395134.010515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723392 00000100:00100000:2.0:1789395134.010589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5062 00000100:00100000:2.0:1789395134.010601:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18247:x1876316231723392:12345-192.168.203.54@tcp:37:lfs.0 00000100:00100000:2.0:1789395134.014612:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18247:x1876316231723392:12345-192.168.203.54@tcp:37:lfs.0 Request processed in 3997us (4324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.014629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5062 00000100:00100000:1.0:1789395134.033766:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.034104:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723520 00000100:00100000:3.0:1789395134.034118:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723520 00000100:00100000:3.0:1789395134.034201:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23474 00000100:00100000:3.0:1789395134.034215:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18247:x1876316231723520:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:3.0:1789395134.034336:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034358:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034373:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034440:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034449:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034456:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034533:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034673:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034682:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395134.034750:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034769:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034776:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034783:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034790:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034798:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.034803:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034813:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034828:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:3.0:1789395134.034831:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.034837:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034844:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316aa07 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034862:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034869:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034875:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034880:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.034882:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034888:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034896:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca363100) 00010000:00010000:3.0:1789395134.034898:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.034901:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034906:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316aa0e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034939:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034954:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034960:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034966:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.034968:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034974:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034982:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395134.034985:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.034988:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.034993:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316aa15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.035083:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18247:x1876316231723520:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 869us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.035094:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23474 00000100:00100000:1.0:1789395134.039062:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.039302:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723776 00000100:00100000:2.0:1789395134.039316:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723776 00000100:00100000:2.0:1789395134.039432:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23475 00000100:00100000:2.0:1789395134.039445:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18247:x1876316231723776:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395134.039474:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.039502:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e91 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.039711:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.039731:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.039745:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.039761:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151f:0x0]: returning size 2 00010000:00010000:0.0:1789395134.039951:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.039973:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.039984:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:0.0:1789395134.039987:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789395134.039991:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab200, rc 0) 00000100:00100000:0.0:1789395134.040066:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18247:x1876316231723776:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 623us (1018us total) trans 4294983521 rc 0/0 00000100:00100000:0.0:1789395134.040078:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23475 00000100:00100000:0.0:1789395134.050855:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.050956:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231723904 00000100:00100000:2.0:1789395134.050970:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231723904 00000100:00100000:2.0:1789395134.051099:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5197 00000100:00100000:2.0:1789395134.051113:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231723904:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:2.0:1789395134.051177:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.051205:0:14655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 9 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.051220:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789395134.051226:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395134.051231:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.051280:0:14655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 9 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.051297:0:14655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 9 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.051313:0:14655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14655:1876316239669888:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395134.051475:0:14655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.058236:0:14655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14655:1876316239669888:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395134.058281:0:14655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.072209:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.076375:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724032 00000100:00100000:1.0:1789395134.076438:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724032 00002000:00100000:1.0:1789395134.076510:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff89a4e7f60000 x1876316231724032/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/0 e 0 to 0 dl 1789395145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395134.076522:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f60000 with x1876316231724032 ext(0->1) 00010000:00010000:1.0:1789395134.076533:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 10 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.076552:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 10 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395134.076568:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a4e7f60000 00000100:00100000:1.0:1789395134.076608:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:1.0:1789395134.076619:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231724032:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:1.0:1789395134.077885:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231724032:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1252us (5669us total) trans 4294969881 rc 0/0 00000100:00100000:1.0:1789395134.077912:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 0 00002000:00100000:1.0:1789395134.077927:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff89a4e7f60000 x1876316231724032/t4294969881(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/448 e 0 to 0 dl 1789395145 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395134.077938:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f60000 with x1876316231724032 ext(0->1) 00010000:00010000:1.0:1789395134.077960:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 12 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.077983:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 12 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395134.077992:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a4e7f60000 00000100:00100000:1.0:1789395134.083009:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.090884:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724160 00000100:00100000:2.0:1789395134.091114:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724160 00010000:00010000:2.0:1789395134.091188:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 12 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.091319:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1558 00000100:00100000:2.0:1789395134.091332:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231724160:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395134.091354:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789395134.091378:0:16674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1789395134.091382:0:16674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1789395133 00002000:00010000:2.0:1789395134.091403:0:16674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1789395133 00002000:00010000:2.0:1789395134.091406:0:16674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789395134.091426:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 12 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.091444:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 12 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.091478:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316a8a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e28 expref: 12 pid: 14650 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.091501:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395134.091506:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395134.091514:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.091526:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.091582:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395134.091671:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231724160:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 341us (8678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.091680:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1558 00010000:00010000:0.0:1789395134.091765:0:14655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091776:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091801:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091811:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091820:0:14655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091828:0:14655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395134.091834:0:14655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091845:0:14655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091860:0:14655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.091869:0:14655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001edb4d0a/0xff35729af316aa31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.091971:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231723904:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 40861us (41130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.091982:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5197 00000100:00100000:1.0:1789395134.102714:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.102766:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.102791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.102817:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.102849:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724800 00000100:00100000:1.0:1789395134.102861:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724800 00000100:00100000:1.0:1789395134.102953:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1 00000100:00100000:1.0:1789395134.102967:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18247:x1876316231724800:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395134.103052:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.103090:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316a89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e21 expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.103114:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:1.0:1789395134.103119:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395134.103151:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.103167:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.103177:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395134.103202:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:1.0:1789395134.103266:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.103326:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.103366:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca4800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.103444:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724288 00000100:00100000:1.0:1789395134.103449:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724288 00000100:00100000:1.0:1789395134.103479:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724416 00000100:00100000:1.0:1789395134.103482:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724416 00000100:00100000:1.0:1789395134.103495:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724544 00000100:00100000:1.0:1789395134.103497:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724544 00000100:00100000:1.0:1789395134.103513:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1334 00000100:00100000:1.0:1789395134.103519:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231724288:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:1.0:1789395134.103530:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.103544:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd000/0xff35729af316aa00 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e8a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.103557:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:1.0:1789395134.103560:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395134.103606:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231724288:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 87us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.103614:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1334 00000100:00100000:1.0:1789395134.103632:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1335 00000100:00100000:1.0:1789395134.103638:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231724416:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:1.0:1789395134.103647:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.103657:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316a9f2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e83 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.103666:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:1.0:1789395134.103676:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395134.103691:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231724416:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 54us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.103697:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1335 00000100:00100000:1.0:1789395134.103709:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1336 00000100:00100000:1.0:1789395134.103715:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2397:x1876316231724544:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:1.0:1789395134.103721:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.103731:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316a9e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e7c expref: 10 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.103740:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395134.103743:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395134.103759:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231724544:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 45us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.103765:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1336 00000100:00100000:1.0:1789395134.103900:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670016 00000100:00100000:1.0:1789395134.103904:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670016 00000100:00100000:1.0:1789395134.103931:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00100000:1.0:1789395134.103938:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670016:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.104042:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670016:12345-0@lo:1000:mdt_io00_002.0 Request processed in 105us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.104049:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00100000:1.0:1789395134.104089:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.104745:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670144:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1789395134.104794:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.104819:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.104839:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670144 00000100:00100000:1.0:1789395134.104843:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670144 00000100:00100000:1.0:1789395134.104873:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:1.0:1789395134.104880:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670144:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1789395134.118580:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670144:12345-0@lo:403:mdt_io00_002.0 Request processed in 13684us (13769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.118600:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:3.0:1789395134.127417:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670144:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395134.128558:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670272:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.128638:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.128704:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.129208:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670272 00000100:00100000:3.0:1789395134.129217:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670272 00000100:00100000:3.0:1789395134.129281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:3.0:1789395134.129291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670272:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.129424:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670272:12345-0@lo:1000:mdt_io00_002.0 Request processed in 134us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.129433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:2.0:1789395134.132493:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670272:0@lo:1000:mdt_io00_002.0 00010000:00010000:2.0:1789395134.132640:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.132654:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.132666:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.132692:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670400:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395134.132786:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.132838:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.133212:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670400 00000100:00100000:0.0:1789395134.133222:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670400 00000100:00100000:0.0:1789395134.133297:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1789395134.133308:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239670400:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395134.133330:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.133351:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316aa3f expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.133419:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.133433:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 4/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.133589:0:11908:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1789395134.133633:0:11908:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1789395134.133689:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.133715:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:0.0:1789395134.133719:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.133912:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.133923:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aae00, rc 0) 00000100:00100000:0.0:1789395134.133999:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:6526:x1876316239670400:12345-0@lo:101:mdt_io00_002.0 Request processed in 692us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.134007:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1789395134.134410:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239670656:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134458:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.134497:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239671168:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134523:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.134538:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239671680:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134556:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.134578:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789395134.134584:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239670784:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.134623:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239671296:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134645:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.134666:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239671808:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.134719:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671168 00000100:00100000:3.0:1789395134.134726:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671168 00000100:00100000:3.0:1789395134.134771:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671680 00000100:00100000:3.0:1789395134.134774:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671680 00000100:00100000:3.0:1789395134.134795:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671296 00000100:00100000:3.0:1789395134.134798:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671296 00000100:00100000:3.0:1789395134.134817:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671808 00000100:00100000:3.0:1789395134.134820:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671808 00000100:00100000:3.0:1789395134.134840:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789395134.134848:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239671168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134896:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239671168:12345-0@lo:400:kworker.0 Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.134903:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789395134.134918:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789395134.134925:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239671680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.134964:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239671680:12345-0@lo:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.134970:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789395134.134982:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789395134.134988:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239671296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.135014:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239671296:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.135019:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789395134.135029:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789395134.135034:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239671808:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789395134.135208:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395134.135214:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395134.135229:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670656 00000100:00100000:0.0:1789395134.135234:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670656 00000100:00100000:0.0:1789395134.135275:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670784 00000100:00100000:0.0:1789395134.135278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670784 00000100:00100000:0.0:1789395134.135298:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1789395134.135305:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239670656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395134.135345:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239670656:12345-0@lo:400:kworker.0 Request processed in 40us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.135352:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1789395134.135365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1789395134.135371:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239670784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395134.135419:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239670784:12345-0@lo:400:kworker.0 Request processed in 48us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.135425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1789395134.135510:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239670528:0@lo:400:kworker.0 00000100:00100000:1.0:1789395134.135553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.135592:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239671040:0@lo:400:kworker.0 00000100:00100000:1.0:1789395134.135619:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.135637:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239671552:0@lo:400:kworker.0 00000100:00100000:1.0:1789395134.135659:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.135676:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789395134.135682:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239670912:0@lo:400:kworker.0 00000100:00100000:1.0:1789395134.135733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.135750:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239671424:0@lo:400:kworker.0 00000100:00100000:1.0:1789395134.135775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.136255:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239670400:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395134.136285:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 4/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.136300:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 4/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.136573:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670528 00000100:00100000:0.0:1789395134.136581:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670528 00000100:00100000:0.0:1789395134.136633:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1789395134.136641:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239670528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395134.136867:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239670528:0@lo:400:kworker.0 00000100:00100000:0.0:1789395134.136923:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239670528:12345-0@lo:400:kworker.0 Request processed in 281us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.136931:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1789395134.137009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671040 00000100:00100000:0.0:1789395134.137013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671040 00000100:00100000:0.0:1789395134.137057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671552 00000100:00100000:0.0:1789395134.137060:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671552 00000100:00100000:0.0:1789395134.137075:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239670912 00000100:00100000:0.0:1789395134.137078:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239670912 00000100:00100000:0.0:1789395134.137091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671424 00000100:00100000:0.0:1789395134.137093:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671424 00000100:00100000:0.0:1789395134.137107:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1789395134.137113:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239671040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789395134.137164:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395134.137168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395134.137463:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1789395134.137474:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239671552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395134.141553:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789395134.141581:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239670912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395134.141689:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239670912:12345-0@lo:400:kworker.0 Request processed in 120us (5954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.141698:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789395134.141746:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1789395134.141755:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239671424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395134.141790:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239671424:12345-0@lo:400:kworker.0 Request processed in 37us (6014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.141796:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1789395134.141862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239670912:0@lo:400:kworker.0 00000100:00100000:2.0:1789395134.141877:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239671424:0@lo:400:kworker.0 00000100:00100000:0.0:1789395134.142930:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239671040:12345-0@lo:400:kworker.0 Request processed in 5810us (7302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.142952:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1789395134.143011:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239671040:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.143441:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239671808:12345-0@lo:400:kworker.0 Request processed in 8402us (8750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.143453:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789395134.143513:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239670784:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.143527:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239671296:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.143539:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239671808:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.143554:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239670656:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.143566:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239671168:0@lo:400:kworker.0 00000100:00100000:3.0:1789395134.143577:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239671680:0@lo:400:kworker.0 00010000:00010000:0.0:1789395134.143910:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395134.143928:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.143988:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.144001:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395134.144033:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316a97b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316a982 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144130:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144141:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144148:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144156:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.144161:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144169:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144184:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:2.0:1789395134.144188:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.144193:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144200:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316a989 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144226:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144234:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144239:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144245:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.144248:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395134.144337:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968459 is committed 00000001:00080000:0.0:1789395134.144354:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968457 is committed 00010000:00010000:2.0:1789395134.144504:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144514:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:2.0:1789395134.144517:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.144523:0:3622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144538:0:3622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144549:0:3622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.144587:0:3622:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.144603:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3622:1876316239672064:0@lo:105: 00000100:00100000:2.0:1789395134.144669:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.145166:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672064 00000100:00100000:3.0:1789395134.145176:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672064 00000100:00100000:3.0:1789395134.145230:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1789395134.145239:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3622:x1876316239672064:12345-0@lo:105: 00000100:00100000:0.0:1789395134.145353:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395134.145368:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239671936:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1789395134.145674:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 5/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.145687:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 5/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.145697:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 5/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.145853:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239671552:12345-0@lo:400:kworker.0 Request processed in 8380us (10190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.145865:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1789395134.145999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.146154:0:3622:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.146227:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239671552:0@lo:400:kworker.0 00010000:00010000:3.0:1789395134.146321:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.146333:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.146344:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.146378:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3cde00) 00000100:00100000:1.0:1789395134.146512:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239671936 00000100:00100000:1.0:1789395134.146519:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239671936 00000100:00100000:1.0:1789395134.146571:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1789395134.146581:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239671936:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1789395134.146595:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.146622:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316a982 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316a97b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.146641:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395134.146652:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395134.146694:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239671936:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 115us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.146702:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1789395134.146818:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239671936:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1789395134.146901:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3622:x1876316239672064:12345-0@lo:105: Request processed in 1661us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.146910:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1789395134.147000:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3622:1876316239672064:0@lo:105: 00010000:00010000:0.0:1789395134.147022:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.147030:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316a990 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.147143:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.147154:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.147183:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.147241:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.147320:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.147334:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.147356:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672192:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395134.147673:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.147809:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672192 00000100:00100000:3.0:1789395134.147816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672192 00000100:00100000:3.0:1789395134.147864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:3.0:1789395134.147873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239672192:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395134.147894:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395134.147913:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316aa4d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.147951:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316aa4d expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.147970:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aa4d expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.147980:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x391d5834 (ffff89a3ca363100) 00010000:00010000:3.0:1789395134.147983:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.147986:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:3.0:1789395134.148021:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672192:12345-0@lo:101:mdt_io00_002.0 Request processed in 150us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.148028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:2.0:1789395134.148117:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.148137:0:6526:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968457 gen 2 00000004:00080000:2.0:1789395134.148144:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968446 committed transno 4294968457 00000004:00080000:2.0:1789395134.148169:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968447 committed transno 4294968457 00000004:00080000:2.0:1789395134.148180:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968448 committed transno 4294968457 00000004:00080000:2.0:1789395134.148191:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968449 committed transno 4294968457 00000004:00080000:2.0:1789395134.148202:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968450 committed transno 4294968457 00000004:00080000:2.0:1789395134.148218:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968451 committed transno 4294968457 00000004:00080000:2.0:1789395134.148228:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968452 committed transno 4294968457 00000004:00080000:2.0:1789395134.148243:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968453 committed transno 4294968457 00000004:00080000:2.0:1789395134.148371:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968454 committed transno 4294968457 00000004:00080000:2.0:1789395134.148520:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968455 committed transno 4294968457 00000004:00080000:2.0:1789395134.148536:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968456 committed transno 4294968457 00000004:00080000:2.0:1789395134.148545:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968457 committed transno 4294968457 00000020:00080000:2.0:1789395134.148553:0:6526:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4d92d3840 refcount 2 committed 0 result 0 batchid 401 00000020:00080000:2.0:1789395134.148557:0:6526:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4d92d3780 00000020:00080000:2.0:1789395134.148561:0:6526:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].395 00000020:00080000:2.0:1789395134.148563:0:6526:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca2bd000 00000020:00080000:2.0:1789395134.148567:0:6526:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].398 00000100:00100000:2.0:1789395134.148596:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672192:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395134.148617:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.148635:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.148656:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.148683:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.148693:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.148702:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789395134.150685:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 401 committed batchid 400 00000020:00080000:1.0:1789395134.150854:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 400 00010000:00010000:2.0:1789395134.151133:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151150:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151167:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151226:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151242:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151264:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151318:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.151337:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 18 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.151355:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239672320:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395134.151501:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1789395134.157341:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@000000000eab4948 x1876316239672320) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 18 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157373:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 18 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157457:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316aa23 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e91 expref: 18 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.157479:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239672320:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395134.157512:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:2.0:1789395134.157519:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157530:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157540:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157564:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157573:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.157580:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.157976:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672448:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.158046:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.158138:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.163667:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672448 00000100:00100000:0.0:1789395134.163692:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672448 00000100:00100000:0.0:1789395134.164261:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:0.0:1789395134.164278:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672448:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.164577:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672448:12345-0@lo:1000:mdt_io00_002.0 Request processed in 302us (6529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395134.164587:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:2.0:1789395134.164714:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672448:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.164823:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672576:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.164868:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.170757:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.185992:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672576 00000100:00100000:1.0:1789395134.186013:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672576 00000100:00100000:1.0:1789395134.186110:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:1.0:1789395134.186122:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672576:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.186304:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672576:12345-0@lo:1000:mdt_io00_002.0 Request processed in 184us (21435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.186312:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:0.0:1789395134.188445:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672576:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.188671:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672704:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.188759:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.188795:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.191983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672704 00000100:00100000:2.0:1789395134.192008:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672704 00000100:00100000:2.0:1789395134.192093:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:2.0:1789395134.192104:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672704:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.192786:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672704:12345-0@lo:1000:mdt_io00_002.0 Request processed in 540us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.192798:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:1.0:1789395134.192840:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672704:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.193005:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672832:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.193902:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.193958:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480780 going to sleep for 11 seconds 00010000:00010000:2.0:1789395134.194352:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395134.194440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672832 00000100:00100000:3.0:1789395134.194450:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672832 00000100:00100000:3.0:1789395134.194513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:3.0:1789395134.194524:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672832:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.194656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672832:12345-0@lo:1000:mdt_io00_002.0 Request processed in 133us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.194665:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00100000:0.0:1789395134.194897:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672832:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.194986:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672960:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.195029:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.195067:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.195191:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239672960 00000100:00100000:2.0:1789395134.195196:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239672960 00000100:00100000:2.0:1789395134.195237:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282 00000100:00100000:2.0:1789395134.195245:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672960:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.195329:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239672960:12345-0@lo:1000:mdt_io00_002.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.195337:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282 00000100:00100000:3.0:1789395134.196586:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239672960:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.196848:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239673088:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.196909:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.196971:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.197484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239673088 00000100:00100000:0.0:1789395134.197494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239673088 00000100:00100000:0.0:1789395134.197558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:0.0:1789395134.197569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1876316239673088:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.197683:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1876316239673088:12345-0@lo:1000:mdt_io00_002.0 Request processed in 115us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.197691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:3.0:1789395134.199908:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239673088:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1789395134.200599:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].399, 1264 off597328 00000040:00080000:3.0:1789395134.200665:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].396, 1344 off651064 00000100:00100000:3.0:1789395134.200716:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239673216:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.200793:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.200847:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.201053:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239673216 00000100:00100000:1.0:1789395134.201062:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239673216 00000100:00100000:1.0:1789395134.201124:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:1.0:1789395134.201136:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1876316239673216:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395134.201296:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239673216:12345-0@lo:1000:mdt_io00_002.0 Request processed in 161us (502us total) trans 4294969882 rc 0/0 00000100:00100000:1.0:1789395134.201304:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00100000:3.0:1789395134.203643:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239673216:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1789395134.203669:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca480a80 with version 755 00000004:00080000:1.0:1789395134.204139:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 755 rpc_version 755 00000020:00100000:1.0:1789395134.204191:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395134.204202:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca20c700 x1876316239673472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395134.204229:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239673472:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395134.204320:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.206449:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.209381:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239673472 00000100:00100000:2.0:1789395134.209419:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239673472 00000100:00100000:2.0:1789395134.209519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285 00000100:00100000:2.0:1789395134.209670:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239673472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395134.210724:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239673472:12345-0@lo:1000:osp_up1-0.0 Request processed in 1189us (6398us total) trans 4294968460 rc 0/0 00000100:00100000:2.0:1789395134.210735:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285 00000100:00100000:1.0:1789395134.210853:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239673472:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1789395134.210930:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0c50a52 reply state 00000000ccfae805 transno 4294983522 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.210966:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.210978:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395134.210982:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1789395134.210987:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395134.210996:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211004:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211018:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211025:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.211031:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211051:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211064:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:3.0:1789395134.211066:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.211071:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211078:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316aa5b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395134.211101:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0c50a52 reply state 00000000ccfae805 transno 4294983522 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211111:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211117:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395134.211120:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395134.211121:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1789395134.211128:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.211138:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211154:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211162:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211188:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395134.211192:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.211197:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211206:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211210:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1789395134.211222:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:2.0:1789395134.211228:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211232:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211246:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395134.211247:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211262:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211266:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211280:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc195d4f0) 00000004:00010000:2.0:1789395134.211281:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211284:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211301:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211312:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c3ab8800) 00010000:00010000:3.0:1789395134.211315:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.211318:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.211324:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316aa38 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211332:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211342:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395134.211409:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211418:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cde00/0xff35729af316aa3f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.211439:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395134.211441:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395134.211443:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395134.211518:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18247:x1876316231724800:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 108550us (108696us total) trans 4294983522 rc 0/0 00000100:00100000:0.0:1789395134.211525:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239673600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395134.211531:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1 00000100:00100000:0.0:1789395134.211597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.211824:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239673600 00000100:00100000:3.0:1789395134.211833:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239673600 00000100:00100000:3.0:1789395134.211889:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1789395134.211907:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6282850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+12:3639:x1876316239673600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395134.211923:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395134.211953:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316aa46 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316aa3f expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.212042:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:3.0:1789395134.212051:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395134.212090:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6282850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239673600:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.212097:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1789395134.212267:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239673600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395134.230285:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.230542:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231724928 00000100:00100000:2.0:1789395134.230558:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231724928 00000100:00100000:2.0:1789395134.230644:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23476 00000100:00100000:2.0:1789395134.230658:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18247:x1876316231724928:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:2.0:1789395134.230785:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230805:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230819:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230835:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230841:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230847:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230953:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230962:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.230969:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395134.231035:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231052:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231058:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231064:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231072:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231083:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.231088:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231096:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231111:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f700) 00010000:00010000:2.0:1789395134.231114:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.231120:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231128:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316aa70 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231153:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231159:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231164:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231169:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.231172:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231178:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231190:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca35fb00) 00010000:00010000:2.0:1789395134.231193:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.231196:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231201:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316aa77 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231213:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231219:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231225:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231230:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.231232:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231237:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231244:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:2.0:1789395134.231246:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.231248:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.231253:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316aa7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.231364:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18247:x1876316231724928:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 707us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.231374:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23476 00000100:00100000:2.0:1789395134.234994:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.235113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231725184 00000100:00100000:0.0:1789395134.235126:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231725184 00000100:00100000:0.0:1789395134.235205:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23477 00000100:00100000:0.0:1789395134.235218:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18247:x1876316231725184:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395134.235247:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.235278:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aa85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.235557:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.235577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.235591:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.235606:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1522:0x0]: returning size 3 00010000:00010000:0.0:1789395134.242450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aa85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1522:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.242491:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.242502:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:0.0:1789395134.242506:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789395134.242511:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2abe00, rc 0) 00000100:00100000:1.0:1789395134.243069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18247:x1876316231725184:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 7848us (8083us total) trans 4294983523 rc 0/0 00000100:00100000:1.0:1789395134.243081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23477 00000100:00100000:1.0:1789395134.249887:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.249999:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231725312 00000100:00100000:3.0:1789395134.250013:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231725312 00000100:00100000:3.0:1789395134.250088:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5198 00000100:00100000:3.0:1789395134.250100:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231725312:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:3.0:1789395134.250163:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.250191:0:14651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 10 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.250201:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9ca:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789395134.250207:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395134.250213:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.250256:0:14651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 10 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.250271:0:14651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 10 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.250287:0:14651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14651:1876316239673728:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395134.251298:0:14651:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.264697:0:14651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14651:1876316239673728:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395134.264759:0:14651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.266301:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.266379:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231725440 00000100:00100000:2.0:1789395134.266445:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231725440 00002000:00100000:2.0:1789395134.266517:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->2) req@ffff89a3ca20d880 x1876316231725440/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/0 e 0 to 0 dl 1789395145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395134.266530:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20d880 with x1876316231725440 ext(0->2) 00010000:00010000:2.0:1789395134.266541:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 11 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.266561:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 11 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395134.266572:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3ca20d880 00000100:00100000:2.0:1789395134.266604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1 00000100:00100000:2.0:1789395134.266616:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231725440:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395134.276925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231725440:12345-192.168.203.54@tcp:4:bash.0 Request processed in 10300us (10624us total) trans 4294969882 rc 0/0 00000100:00100000:2.0:1789395134.276953:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1 00002000:00100000:2.0:1789395134.276969:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->2) req@ffff89a3ca20d880 x1876316231725440/t4294969882(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/448 e 0 to 0 dl 1789395145 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395134.276980:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20d880 with x1876316231725440 ext(0->2) 00010000:00010000:2.0:1789395134.276992:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 13 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.277012:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 13 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395134.277021:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3ca20d880 00000100:00100000:3.0:1789395134.283707:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.283878:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231725568 00000100:00100000:0.0:1789395134.283896:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231725568 00010000:00010000:0.0:1789395134.283972:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 13 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.284039:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1559 00000100:00100000:0.0:1789395134.284052:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231725568:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395134.284072:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789395134.284097:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:0.0:1789395134.284101:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1789395133 00002000:00010000:0.0:1789395134.284104:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1789395133 00002000:00010000:0.0:1789395134.284107:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789395134.284114:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 13 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.284132:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 13 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.284159:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316a927 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e52 expref: 13 pid: 14651 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.284181:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.284186:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.284192:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.284203:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.284245:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395134.284316:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231725568:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 266us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.284324:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1559 00010000:00010000:3.0:1789395134.284365:0:14651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284426:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284464:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284474:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284483:0:14651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284491:0:14651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395134.284503:0:14651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284512:0:14651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284532:0:14651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.284540:0:14651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316aa9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.284656:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231725312:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 34555us (34781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.284671:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5198 00000100:00100000:3.0:1789395134.303816:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.306069:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231725824 00000100:00100000:1.0:1789395134.306090:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231725824 00000100:00100000:1.0:1789395134.306200:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 2 00000100:00100000:1.0:1789395134.306213:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18247:x1876316231725824:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395134.306288:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.306325:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316a919 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e4b expref: 21 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.306349:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:1.0:1789395134.306355:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395134.306423:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.306439:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.306454:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395134.306479:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:1.0:1789395134.306554:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239673856:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.306639:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.306706:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.306769:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239673856 00000100:00100000:2.0:1789395134.306784:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239673856 00000100:00100000:2.0:1789395134.306861:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:2.0:1789395134.306872:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239673856:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395134.307037:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239673856:12345-0@lo:1000:mdt_io00_000.0 Request processed in 167us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.307046:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00000100:00100000:3.0:1789395134.307328:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239673856:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.308165:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239673984:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1789395134.309110:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.309157:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.310088:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239673984 00000100:00100000:0.0:1789395134.310106:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239673984 00000100:00100000:0.0:1789395134.310189:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1789395134.310200:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239673984:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1789395134.312379:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239673984:12345-0@lo:403:mdt_io00_000.0 Request processed in 2166us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.312429:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:3.0:1789395134.313021:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239673984:0@lo:403:mdt_io00_000.0 00010000:00010000:3.0:1789395134.314234:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.314251:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.314263:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.314292:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674112:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1789395134.314365:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.314446:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.315642:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239674112 00000100:00100000:2.0:1789395134.315656:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239674112 00000100:00100000:2.0:1789395134.315902:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:2.0:1789395134.315913:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239674112:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395134.315935:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.315973:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316aaaf lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316aaa8 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.316007:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316aaaf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316aaa8 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.316023:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316aaaf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aaa8 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.316037:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35fb00) 00010000:00010000:2.0:1789395134.316041:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.316044:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd600, rc 0) 00000100:00100000:2.0:1789395134.316122:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6524:x1876316239674112:12345-0@lo:101:mdt_io00_000.0 Request processed in 210us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.316130:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:3.0:1789395134.316194:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674112:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395134.316236:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.316252:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395134.316283:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.316335:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.316343:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.316354:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.316377:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674240:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1789395134.316579:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.316626:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.317799:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239674240 00000100:00100000:2.0:1789395134.317809:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239674240 00000100:00100000:2.0:1789395134.318270:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:2.0:1789395134.318281:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6524:x1876316239674240:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395134.318297:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.318319:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316aab6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.318346:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316aab6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.318359:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aab6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.318366:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x84832a57 (ffff89a3ca35f700) 00010000:00010000:2.0:1789395134.318369:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.318372:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cde00, rc 0) 00000100:00100000:2.0:1789395134.318474:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674240:12345-0@lo:101:mdt_io00_000.0 Request processed in 194us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.318481:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:3.0:1789395134.321999:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674240:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395134.322033:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322050:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395134.322076:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.322108:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322118:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322128:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322141:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322153:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322158:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322205:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322217:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322225:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322258:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.322273:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 20 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.322286:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239674368:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395134.326670:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c600 going to sleep for 11 seconds 00010000:00010000:3.0:1789395134.333175:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@00000000d622714a x1876316239674368) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 20 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333210:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 20 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333238:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316aa8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e98 expref: 20 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.333254:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239674368:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395134.333282:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:3.0:1789395134.333288:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333297:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333304:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333335:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333344:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.333349:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.333565:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674496:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.333622:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.333658:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.334618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239674496 00000100:00100000:1.0:1789395134.334628:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239674496 00000100:00100000:1.0:1789395134.334689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1789395134.334700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674496:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.334845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674496:12345-0@lo:1000:mdt_io00_000.0 Request processed in 145us (1221us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395134.334852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:3.0:1789395134.335234:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674496:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.335299:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674624:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.335343:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.335376:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.335682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239674624 00000100:00100000:1.0:1789395134.335689:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239674624 00000100:00100000:1.0:1789395134.335727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1789395134.335735:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674624:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.335805:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674624:12345-0@lo:1000:mdt_io00_000.0 Request processed in 70us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.335813:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:3.0:1789395134.335954:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674624:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.336078:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674752:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.336104:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.336129:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.336615:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239674752 00000100:00100000:1.0:1789395134.336621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239674752 00000100:00100000:1.0:1789395134.336659:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292 00000100:00100000:1.0:1789395134.336665:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674752:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.336726:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239674752:12345-0@lo:1000:mdt_io00_000.0 Request processed in 60us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.336733:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292 00000100:00100000:3.0:1789395134.336905:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674752:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.337066:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674880:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.337098:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.337122:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d3dfb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.337504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239674880 00000100:00100000:1.0:1789395134.337509:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239674880 00000100:00100000:1.0:1789395134.337551:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293 00000100:00100000:1.0:1789395134.337558:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1876316239674880:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.337635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1876316239674880:12345-0@lo:1000:mdt_io00_000.0 Request processed in 76us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.337641:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293 00000100:00100000:3.0:1789395134.337724:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239674880:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1789395134.356246:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].400, 1264 off598592 00000040:00080000:2.0:1789395134.356324:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].397, 1344 off652408 00000100:00100000:2.0:1789395134.356377:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239675008:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395134.356460:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.356502:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.356531:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239675008 00000100:00100000:1.0:1789395134.356540:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239675008 00000100:00100000:1.0:1789395134.356595:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294 00000100:00100000:1.0:1789395134.356605:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876316239675008:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.356759:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1876316239675008:12345-0@lo:1000:mdt_io00_000.0 Request processed in 155us (298us total) trans 4294969883 rc 0/0 00000100:00100000:1.0:1789395134.356767:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00100000:2.0:1789395134.356854:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239675008:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1789395134.356865:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c9b9c540 with version 756 00000004:00080000:1.0:1789395134.363059:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 756 rpc_version 756 00000020:00100000:1.0:1789395134.363114:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395134.363135:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca20ca80 x1876316239675264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395134.363179:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239675264:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395134.363256:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.363300:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.363329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239675264 00000100:00100000:0.0:1789395134.363338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239675264 00000100:00100000:0.0:1789395134.363406:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:0.0:1789395134.363416:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239675264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395134.363892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239675264:12345-0@lo:1000:osp_up1-0.0 Request processed in 476us (635us total) trans 4294968461 rc 0/0 00000100:00100000:0.0:1789395134.363902:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:1.0:1789395134.364013:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239675264:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1789395134.364077:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1ae3f8c reply state 00000000d01e689b transno 4294983524 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364098:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364108:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:2.0:1789395134.364111:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1789395134.364115:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395134.364124:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364130:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364137:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364143:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364149:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.364154:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.364166:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365832:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363b00) 00010000:00010000:2.0:1789395134.365839:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.365846:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365854:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316aac4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395134.365874:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1ae3f8c reply state 00000000d01e689b transno 4294983524 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365889:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365896:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca363300) 00010000:00010000:2.0:1789395134.365899:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395134.365901:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1789395134.365908:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.365918:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365925:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365932:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365969:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395134.365973:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.365979:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.365988:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.366001:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1789395134.366003:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:0.0:1789395134.366012:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.366023:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395134.366028:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395134.366037:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.366072:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.366079:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395134.366100:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.366116:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.366122:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.366128:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.366131:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.366137:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239675392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395134.366139:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.366152:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395134.366154:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.366158:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.366164:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316aaa1 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.366194:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.366267:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239675392 00000100:00100000:3.0:1789395134.366275:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239675392 00000100:00100000:1.0:1789395134.366320:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18247:x1876316231725824:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 60107us (62510us total) trans 4294983524 rc 0/0 00000100:00100000:3.0:1789395134.366335:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1789395134.366344:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+14:3636:x1876316239675392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395134.366356:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395134.366371:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316aaaf lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316aaa8 expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.366406:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35fb00) 00010000:00010000:3.0:1789395134.366415:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395134.366448:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 2 00010000:00010000:0.0:1789395134.366487:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.366498:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10c400/0xff35729af316aaa8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316aaaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.366514:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395134.366517:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395134.366518:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395134.367072:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+13:3636:x1876316239675392:12345-0@lo:103:ldlm_bl.0 Request processed in 728us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.367080:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1789395134.369642:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239675392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395134.373487:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.373553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231725952 00000100:00100000:0.0:1789395134.373564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231725952 00000100:00100000:0.0:1789395134.373622:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23478 00000100:00100000:0.0:1789395134.373631:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18247:x1876316231725952:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:0.0:1789395134.373705:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373721:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373732:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373743:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373750:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373756:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373807:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373816:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373823:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395134.373871:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373885:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373892:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373899:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373905:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373911:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.373915:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373923:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373933:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395134.373937:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.373952:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373960:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316aad9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373977:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373983:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373989:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.373993:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.373995:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374001:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374009:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395134.374011:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.374013:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374019:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316aae0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374029:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374035:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374040:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374046:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.374048:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374054:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374059:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:0.0:1789395134.374061:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.374064:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.374070:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aae7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.374138:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18247:x1876316231725952:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 507us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.374145:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23478 00000100:00100000:3.0:1789395134.379137:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.379210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231726208 00000100:00100000:0.0:1789395134.379220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231726208 00000100:00100000:0.0:1789395134.379277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23479 00000100:00100000:0.0:1789395134.379288:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18247:x1876316231726208:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395134.379307:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.379339:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316aaee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105e9f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.379528:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.379543:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.379555:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.379567:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1520:0x0]: returning size 2 00010000:00010000:0.0:1789395134.379668:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316aaee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1520:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.379685:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.379694:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:0.0:1789395134.379697:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789395134.379700:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab600, rc 0) 00000100:00100000:0.0:1789395134.379763:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18247:x1876316231726208:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 476us (636us total) trans 4294983525 rc 0/0 00000100:00100000:0.0:1789395134.379770:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23479 00000100:00100000:1.0:1789395134.385800:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.385902:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231726336 00000100:00100000:0.0:1789395134.385912:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231726336 00000100:00100000:0.0:1789395134.385980:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5199 00000100:00100000:0.0:1789395134.385990:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231726336:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:0.0:1789395134.386035:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.386055:0:14655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.386064:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9c9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789395134.386068:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.386073:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.386105:0:14655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.386119:0:14655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 11 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.386133:0:14655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14655:1876316239675520:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395134.386291:0:14655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.392618:0:14655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14655:1876316239675520:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395134.392649:0:14655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.396381:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.396603:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231726464 00000100:00100000:3.0:1789395134.396614:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231726464 00002000:00100000:3.0:1789395134.396666:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff89a3ca20e680 x1876316231726464/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/0 e 0 to 0 dl 1789395145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395134.396677:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20e680 with x1876316231726464 ext(0->1) 00010000:00010000:3.0:1789395134.396686:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 12 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.396703:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 12 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395134.396711:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3ca20e680 00000100:00100000:3.0:1789395134.396743:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 2 00000100:00100000:3.0:1789395134.396753:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231726464:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395134.398477:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231726464:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1716us (2095us total) trans 4294969884 rc 0/0 00000100:00100000:3.0:1789395134.398488:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 2 00002000:00100000:3.0:1789395134.398499:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff89a3ca20e680 x1876316231726464/t4294969884(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/448 e 0 to 0 dl 1789395145 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395134.398509:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20e680 with x1876316231726464 ext(0->1) 00010000:00010000:3.0:1789395134.398518:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 14 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.398538:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 14 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395134.398551:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3ca20e680 00000100:00100000:1.0:1789395134.405478:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.405560:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231726592 00000100:00100000:2.0:1789395134.405570:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231726592 00010000:00010000:2.0:1789395134.405608:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 14 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.405648:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1560 00000100:00100000:2.0:1789395134.405657:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231726592:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395134.405672:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789395134.405688:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1789395134.405691:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1789395133 00002000:00010000:2.0:1789395134.405693:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1789395133 00002000:00010000:2.0:1789395134.405695:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789395134.405701:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 14 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.405716:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 14 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.405737:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316a8d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e36 expref: 14 pid: 14478 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.405754:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395134.405758:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395134.405764:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.405775:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.405803:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395134.405854:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231726592:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 198us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.405862:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1560 00010000:00010000:0.0:1789395134.405918:0:14655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.405928:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.405957:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.405966:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.405974:0:14655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.405980:0:14655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395134.405985:0:14655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.405994:0:14655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.406006:0:14655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.406014:0:14655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f0d3be/0xff35729af316ab03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.406059:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231726336:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 20071us (20268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.406070:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5199 00000100:00100000:0.0:1789395134.411114:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.411184:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231726848 00000100:00100000:3.0:1789395134.411194:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231726848 00000100:00100000:3.0:1789395134.411259:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:3.0:1789395134.411269:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18247:x1876316231726848:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:3.0:1789395134.411329:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395134.411356:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316a8c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e2f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.411378:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:3.0:1789395134.411431:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395134.411455:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.412005:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.412022:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395134.412042:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:3.0:1789395134.412098:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9126d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239675648:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.412154:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.412301:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.414218:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239675648 00000100:00100000:0.0:1789395134.414231:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239675648 00000100:00100000:0.0:1789395134.414424:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1789395134.414437:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239675648:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.414579:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239675648:12345-0@lo:1000:mdt_io00_002.0 Request processed in 144us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.414587:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:2.0:1789395134.414860:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9126d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239675648:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.415883:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239675776:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395134.415954:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.416073:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.416727:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239675776 00000100:00100000:1.0:1789395134.416737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239675776 00000100:00100000:1.0:1789395134.416827:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:1.0:1789395134.416837:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239675776:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1789395134.419254:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239675776:12345-0@lo:403:mdt_io00_002.0 Request processed in 2408us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.419269:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:2.0:1789395134.420892:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239675776:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1789395134.422440:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.422456:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.422467:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.422489:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239675904:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395134.422565:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.422685:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.424037:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239675904 00000100:00100000:1.0:1789395134.424048:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239675904 00000100:00100000:1.0:1789395134.424270:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:1.0:1789395134.424280:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239675904:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395134.424298:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.424320:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ab18 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316ab11 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.424349:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ab18 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316ab11 expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.424363:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ab18 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ab11 expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.424372:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395134.424376:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.424380:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1200, rc 0) 00000100:00100000:1.0:1789395134.424476:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:6526:x1876316239675904:12345-0@lo:101:mdt_io00_002.0 Request processed in 197us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.424483:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:2.0:1789395134.424572:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239675904:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395134.424591:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.424601:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.424621:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.424715:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.424723:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.424731:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.424747:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676032:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395134.424777:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.424803:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.424987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239676032 00000100:00100000:0.0:1789395134.424993:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239676032 00000100:00100000:0.0:1789395134.425032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:0.0:1789395134.425040:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6526:x1876316239676032:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395134.425049:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.425062:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316ab1f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.425083:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316ab1f expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.425095:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ab1f expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.425102:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x18618557 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395134.425105:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.425107:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab400, rc 0) 00000100:00100000:0.0:1789395134.425145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676032:12345-0@lo:101:mdt_io00_002.0 Request processed in 105us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.425151:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1789395134.425336:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676032:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395134.425348:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425356:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.425369:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.425408:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425417:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425425:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425437:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425443:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425450:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425499:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425510:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425521:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425545:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.425556:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 22 pid: 6513 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.425567:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239676160:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395134.425641:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1789395134.429730:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@00000000bdcec837 x1876316239676160) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 22 pid: 6513 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429754:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 22 pid: 6513 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429777:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316aaf5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e9f expref: 22 pid: 6513 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.429792:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239676160:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395134.429813:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:2.0:1789395134.429818:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429827:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429835:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429853:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429862:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.429867:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.430019:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676288:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.430075:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.430106:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.430277:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239676288 00000100:00100000:0.0:1789395134.430284:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239676288 00000100:00100000:0.0:1789395134.430330:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1789395134.430339:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676288:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.430503:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676288:12345-0@lo:1000:mdt_io00_002.0 Request processed in 164us (427us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395134.430512:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:2.0:1789395134.430847:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676288:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.430891:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676416:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.430916:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.430952:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.431565:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239676416 00000100:00100000:0.0:1789395134.431571:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239676416 00000100:00100000:0.0:1789395134.431609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:0.0:1789395134.431616:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676416:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.431683:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676416:12345-0@lo:1000:mdt_io00_002.0 Request processed in 67us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.431690:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:2.0:1789395134.431978:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676416:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.432070:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676544:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.432098:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.432122:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.432165:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239676544 00000100:00100000:0.0:1789395134.432170:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239676544 00000100:00100000:0.0:1789395134.432198:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302 00000100:00100000:0.0:1789395134.432204:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676544:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.432255:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239676544:12345-0@lo:1000:mdt_io00_002.0 Request processed in 51us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.432262:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302 00000100:00100000:2.0:1789395134.432343:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676544:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.432650:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676672:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.432681:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.432702:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.432740:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239676672 00000100:00100000:0.0:1789395134.432744:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239676672 00000100:00100000:0.0:1789395134.432774:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:0.0:1789395134.432781:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239676672:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.432848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239676672:12345-0@lo:1000:mdt_io00_002.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.432854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:2.0:1789395134.432947:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676672:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1789395134.433243:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].401, 1264 off599856 00000040:00080000:2.0:1789395134.433289:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].398, 1344 off653752 00000100:00100000:2.0:1789395134.433311:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676800:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.433336:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.433359:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c865a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.433415:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239676800 00000100:00100000:0.0:1789395134.433427:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239676800 00000100:00100000:0.0:1789395134.433456:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:0.0:1789395134.433686:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239676800:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.433795:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6526:x1876316239676800:12345-0@lo:1000:mdt_io00_002.0 Request processed in 332us (457us total) trans 4294969885 rc 0/0 00000100:00100000:0.0:1789395134.433801:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00000100:00100000:2.0:1789395134.433862:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239676800:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1789395134.433872:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34b840 with version 757 00000004:00080000:1.0:1789395134.433916:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 757 rpc_version 757 00000020:00100000:1.0:1789395134.433938:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395134.433955:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca20c000 x1876316239677056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395134.433970:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239677056:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395134.433998:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.434019:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.434061:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239677056 00000100:00100000:0.0:1789395134.434066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239677056 00000100:00100000:0.0:1789395134.434095:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305 00000100:00100000:0.0:1789395134.434100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239677056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395134.434833:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239677056:12345-0@lo:1000:osp_up1-0.0 Request processed in 730us (831us total) trans 4294968462 rc 0/0 00000100:00100000:0.0:1789395134.434841:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305 00000100:00100000:1.0:1789395134.434933:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239677056:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1789395134.435000:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0d306e8 reply state 00000000d0c8e5e6 transno 4294983526 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435020:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435030:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:2.0:1789395134.435033:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1789395134.435037:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395134.435043:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435051:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435059:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435065:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.435070:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435078:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435088:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395134.435090:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.435093:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435100:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab2d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395134.435117:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0d306e8 reply state 00000000d0c8e5e6 transno 4294983526 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435125:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435130:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3ca35f900) 00010000:00010000:2.0:1789395134.435133:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395134.435134:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1789395134.435139:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.435145:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435153:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435160:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435187:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395134.435191:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.435196:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435203:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.435215:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:2.0:1789395134.435221:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435228:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435233:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435238:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.435242:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435248:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435255:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca363700) 00010000:00010000:2.0:1789395134.435257:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.435260:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.435270:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316ab0a lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.435341:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18247:x1876316231726848:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 24072us (24234us total) trans 4294983526 rc 0/0 00000100:00100000:2.0:1789395134.435348:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3 00010000:00010000:1.0:1789395134.435408:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395134.435414:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.435430:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395134.435434:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395134.435442:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.435475:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.435482:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395134.435502:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.435509:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc600/0xff35729af316ab11 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ab18 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.435523:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395134.435525:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395134.435527:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395134.435691:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395134.435703:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239677184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395134.435739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.435919:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239677184 00000100:00100000:1.0:1789395134.435924:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239677184 00000100:00100000:1.0:1789395134.435975:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1789395134.435982:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+16:3636:x1876316239677184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395134.435992:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395134.436008:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ab18 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316ab11 expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.436019:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395134.436026:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395134.436060:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+15:3636:x1876316239677184:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.436066:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1789395134.436143:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239677184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395134.446770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.447140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231726976 00000100:00100000:0.0:1789395134.447151:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231726976 00000100:00100000:0.0:1789395134.447213:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23480 00000100:00100000:0.0:1789395134.447223:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18247:x1876316231726976:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:0.0:1789395134.447304:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.447324:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.447335:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.447350:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.447357:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.447364:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448676:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448694:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448703:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395134.448755:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448769:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448776:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448786:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448793:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448799:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.448804:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448812:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448823:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395134.448826:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.448830:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448837:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316ab42 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448859:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448865:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448871:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448875:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.448878:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448884:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448890:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395134.448893:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.448896:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448902:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ab49 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448914:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448920:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448926:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448930:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.448933:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448952:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448960:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:0.0:1789395134.448963:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.448966:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.448972:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316ab50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.449111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18247:x1876316231726976:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 1885us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.449121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23480 00000100:00100000:0.0:1789395134.456754:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.456829:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231727232 00000100:00100000:2.0:1789395134.456839:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231727232 00000100:00100000:2.0:1789395134.456897:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23481 00000100:00100000:2.0:1789395134.456907:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18247:x1876316231727232:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395134.456932:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.456962:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ea6 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.457073:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.457088:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.457099:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395134.457110:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151e:0x0]: returning size 2 00010000:00010000:2.0:1789395134.457217:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 26 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.457237:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 25 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.457247:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:2.0:1789395134.457249:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789395134.457253:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc800, rc 0) 00000100:00100000:2.0:1789395134.457301:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18247:x1876316231727232:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 396us (557us total) trans 4294983527 rc 0/0 00000100:00100000:2.0:1789395134.457308:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23481 00000100:00100000:1.0:1789395134.465848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.465978:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231727360 00000100:00100000:0.0:1789395134.465990:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231727360 00000100:00100000:0.0:1789395134.466049:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5200 00000100:00100000:0.0:1789395134.466059:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231727360:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:0.0:1789395134.466105:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.466125:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 12 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.466134:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789395134.466138:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.466143:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.466180:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 12 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.466523:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 12 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.466537:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1876316239677312:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395134.466655:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.475841:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1876316239677312:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395134.475872:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.480337:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.480622:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231727488 00000100:00100000:2.0:1789395134.480633:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231727488 00002000:00100000:2.0:1789395134.480688:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff89a3ca20ed80 x1876316231727488/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/0 e 0 to 0 dl 1789395145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395134.480700:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20ed80 with x1876316231727488 ext(0->1) 00010000:00010000:2.0:1789395134.480710:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 13 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.480728:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 13 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395134.480737:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3ca20ed80 00000100:00100000:2.0:1789395134.480773:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:2.0:1789395134.480782:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231727488:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395134.483656:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231727488:12345-192.168.203.54@tcp:4:bash.0 Request processed in 2863us (3316us total) trans 4294969886 rc 0/0 00000100:00100000:2.0:1789395134.483671:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3 00002000:00100000:2.0:1789395134.483683:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff89a3ca20ed80 x1876316231727488/t4294969886(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/448 e 0 to 0 dl 1789395145 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395134.483693:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20ed80 with x1876316231727488 ext(0->1) 00010000:00010000:2.0:1789395134.483704:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 15 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.483726:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 15 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395134.483735:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3ca20ed80 00000100:00100000:1.0:1789395134.493756:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.493833:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231727616 00000100:00100000:3.0:1789395134.493845:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231727616 00010000:00010000:3.0:1789395134.493884:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 15 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.493933:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1561 00000100:00100000:3.0:1789395134.493955:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2398:x1876316231727616:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395134.493973:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789395134.493991:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1789395134.493994:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1789395133 00002000:00010000:3.0:1789395134.493997:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1789395133 00002000:00010000:3.0:1789395134.493999:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789395134.494006:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 15 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.494021:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 15 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.494045:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316a87f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e1a expref: 15 pid: 14652 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.494062:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395134.494067:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395134.494074:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.494084:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.494126:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395134.494178:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2398:x1876316231727616:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 236us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.494185:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1561 00010000:00010000:0.0:1789395134.495021:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495034:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495058:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495067:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495075:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495088:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395134.495092:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495102:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495117:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.495125:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b835a2d0/0xff35729af316ab6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.495241:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231727360:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 29181us (29401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.495249:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5200 00000100:00100000:1.0:1789395134.513916:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.514201:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231727872 00000100:00100000:2.0:1789395134.514211:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231727872 00000100:00100000:2.0:1789395134.514351:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:2.0:1789395134.514362:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18247:x1876316231727872:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:2.0:1789395134.514446:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395134.514483:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316a871 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e13 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.514503:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:2.0:1789395134.514509:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395134.514535:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.514548:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.514563:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.514581:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:2.0:1789395134.514630:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677440:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395134.514680:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.514715:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c865a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.515661:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239677440 00000100:00100000:3.0:1789395134.515671:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239677440 00000100:00100000:3.0:1789395134.515780:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:3.0:1789395134.515791:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239677440:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.515913:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239677440:12345-0@lo:1000:mdt_io00_000.0 Request processed in 124us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.515920:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:2.0:1789395134.516034:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677440:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395134.516611:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677568:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395134.516653:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.520297:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.521288:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239677568 00000100:00100000:0.0:1789395134.521301:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239677568 00000100:00100000:0.0:1789395134.521454:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00100000:0.0:1789395134.521465:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239677568:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1789395134.527445:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239677568:12345-0@lo:403:mdt_io00_000.0 Request processed in 5972us (10781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.527459:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:2.0:1789395134.527662:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677568:0@lo:403:mdt_io00_000.0 00010000:00010000:2.0:1789395134.529111:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.529126:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.529138:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.529160:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677696:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395134.529212:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.530571:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239677696 00000100:00100000:0.0:1789395134.530583:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239677696 00000100:00100000:0.0:1789395134.530645:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1789395134.530655:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239677696:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1789395134.530672:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.530693:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316ab81 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316ab7a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.530719:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316ab81 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316ab7a expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.530731:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316ab81 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ab7a expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.530739:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395134.530741:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.530745:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa400, rc 0) 00000100:00100000:0.0:1789395134.530999:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239677696:12345-0@lo:101:mdt_io00_000.0 Request processed in 344us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.531008:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00100000:2.0:1789395134.531031:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.531060:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677696:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395134.531078:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.531091:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.531113:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.531142:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.531150:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.531157:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.531173:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677824:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395134.531203:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.531234:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.532037:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239677824 00000100:00100000:1.0:1789395134.532046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239677824 00000100:00100000:1.0:1789395134.532145:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:1.0:1789395134.532155:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239677824:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395134.532169:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.532187:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316ab88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.532215:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316ab88 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.532227:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ab88 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.532236:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xbc0ca3a9 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395134.532238:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.532241:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1c00, rc 0) 00000100:00100000:1.0:1789395134.532300:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239677824:12345-0@lo:101:mdt_io00_000.0 Request processed in 147us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.532306:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:2.0:1789395134.532426:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239677824:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395134.532442:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532453:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.532471:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.532491:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532499:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532507:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532519:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532527:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532533:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532574:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532586:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 24 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532595:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.532620:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 24 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.533517:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 24 pid: 10512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.533534:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239677952:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395134.533622:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789395134.542368:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@00000000a0d36fba x1876316239677952) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 24 pid: 10512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542434:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 24 pid: 10512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542458:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ab5e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ea6 expref: 24 pid: 10512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.542473:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239677952:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395134.542492:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:1.0:1789395134.542497:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542509:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542516:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542534:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542541:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.542546:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.542683:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678080:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.542729:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.543096:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.546659:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678080 00000100:00100000:3.0:1789395134.546675:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678080 00000100:00100000:3.0:1789395134.546790:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:3.0:1789395134.546801:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239678080:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.546989:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239678080:12345-0@lo:1000:mdt_io00_000.0 Request processed in 189us (4259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395134.546997:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1789395134.547073:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678080:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.547159:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678208:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.547197:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.549278:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.549538:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678208 00000100:00100000:0.0:1789395134.549548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678208 00000100:00100000:0.0:1789395134.549642:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:0.0:1789395134.549653:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239678208:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395134.549752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239678208:12345-0@lo:1000:mdt_io00_000.0 Request processed in 102us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.549760:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1789395134.549995:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678208:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.550129:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678336:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.550164:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.550181:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.550194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678336 00000100:00100000:1.0:1789395134.550198:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678336 00000100:00100000:1.0:1789395134.550221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:1.0:1789395134.550228:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239678336:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.550283:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239678336:12345-0@lo:1000:mdt_io00_000.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.550303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:1.0:1789395134.550333:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678336:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.550453:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678464:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.550479:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.550493:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.550502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678464 00000100:00100000:1.0:1789395134.550505:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678464 00000100:00100000:1.0:1789395134.550523:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313 00000100:00100000:1.0:1789395134.550528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1876316239678464:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.550589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1876316239678464:12345-0@lo:1000:mdt_io00_000.0 Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.550595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313 00000100:00100000:1.0:1789395134.550620:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678464:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1789395134.550968:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].402, 1264 off601120 00000040:00080000:1.0:1789395134.551021:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].399, 1344 off655096 00000100:00100000:1.0:1789395134.551045:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678592:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.551073:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.551089:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d92d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.551102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678592 00000100:00100000:1.0:1789395134.551105:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678592 00000100:00100000:1.0:1789395134.551124:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314 00000100:00100000:1.0:1789395134.551130:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1876316239678592:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.551221:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6524:x1876316239678592:12345-0@lo:1000:mdt_io00_000.0 Request processed in 89us (146us total) trans 4294969887 rc 0/0 00000100:00100000:1.0:1789395134.551228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314 00000100:00100000:1.0:1789395134.551258:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239678592:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1789395134.551266:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca480780 with version 758 00000004:00080000:1.0:1789395134.551278:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 758 rpc_version 758 00000020:00100000:1.0:1789395134.551296:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395134.551303:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c8ba9f80 x1876316239678848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395134.551315:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239678848:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395134.551340:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.551354:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395134.551365:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678848 00000100:00100000:1.0:1789395134.551368:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678848 00000100:00100000:1.0:1789395134.551415:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:1.0:1789395134.551422:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239678848:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395134.551706:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:7874:x1876316239678848:12345-0@lo:1000:osp_up1-0.0 Request processed in 284us (364us total) trans 4294968463 rc 0/0 00000100:00100000:1.0:1789395134.551713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00000100:00100000:1.0:1789395134.551748:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239678848:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1789395134.551778:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044b002bd reply state 00000000d7b1997c transno 4294983528 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551796:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551809:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:1.0:1789395134.551812:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1789395134.551816:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395134.551824:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551832:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551838:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551844:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551850:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.551854:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551863:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551873:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:1.0:1789395134.551875:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.551879:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551885:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316ab96 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395134.551903:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044b002bd reply state 00000000d7b1997c transno 4294983528 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551911:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551916:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a3ca35f300) 00010000:00010000:1.0:1789395134.551918:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395134.551920:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1789395134.551923:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:1.0:1789395134.551929:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551936:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551955:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551981:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395134.551986:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:1.0:1789395134.551991:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.551999:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395134.552011:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:1.0:1789395134.552017:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.552023:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.552029:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.552034:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.552037:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.552043:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.552052:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:1.0:1789395134.552054:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.552057:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.552063:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ab73 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.552126:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18247:x1876316231727872:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 37765us (38217us total) trans 4294983528 rc 0/0 00000100:00100000:1.0:1789395134.552134:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00010000:00010000:0.0:1789395134.552646:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395134.552654:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.552666:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395134.552671:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395134.552678:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.552706:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.552714:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395134.552732:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.552740:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cce00/0xff35729af316ab7a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ab81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.552756:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395134.552757:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395134.552759:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395134.552771:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239678976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395134.552808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.552858:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239678976 00000100:00100000:0.0:1789395134.552863:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239678976 00000100:00100000:0.0:1789395134.552901:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1789395134.552909:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+18:3638:x1876316239678976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395134.552919:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395134.552934:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316ab81 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316ab7a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.552956:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395134.552965:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395134.552993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+17:3638:x1876316239678976:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.553000:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1789395134.553030:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239678976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395134.563880:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.563980:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231728000 00000100:00100000:3.0:1789395134.563990:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231728000 00000100:00100000:3.0:1789395134.564051:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23482 00000100:00100000:3.0:1789395134.564060:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18247:x1876316231728000:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:3.0:1789395134.564142:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564162:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564173:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564187:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564195:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564202:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564255:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564264:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564272:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395134.564321:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564335:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564341:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564351:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564358:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564364:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.564368:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564376:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564553:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:3.0:1789395134.564557:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.564562:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564570:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316abab lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564587:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564593:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564599:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564604:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.564607:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564612:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564618:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a3ca363700) 00010000:00010000:3.0:1789395134.564621:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.564623:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564630:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316abb2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564640:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564645:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564650:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564654:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.564656:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564662:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564667:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:3.0:1789395134.564670:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.564673:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.564678:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316abb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.564747:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18247:x1876316231728000:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 686us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.564755:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23482 00000100:00100000:1.0:1789395134.574537:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.574662:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231728256 00000100:00100000:0.0:1789395134.574672:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231728256 00000100:00100000:0.0:1789395134.574730:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23483 00000100:00100000:0.0:1789395134.574741:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18247:x1876316231728256:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395134.574761:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.574782:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316abc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ead expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.574884:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.574899:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.574912:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.574924:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x151d:0x0]: returning size 2 00010000:00010000:0.0:1789395134.575038:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316abc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.575061:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.575070:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:0.0:1789395134.575074:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789395134.575078:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aac00, rc 0) 00000100:00100000:0.0:1789395134.575141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18247:x1876316231728256:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 402us (614us total) trans 4294983529 rc 0/0 00000100:00100000:0.0:1789395134.575148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23483 00000100:00100000:2.0:1789395134.580521:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.580610:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231728384 00000100:00100000:1.0:1789395134.580619:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231728384 00000100:00100000:1.0:1789395134.580673:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5201 00000100:00100000:1.0:1789395134.580682:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231728384:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:1.0:1789395134.580723:0:10007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.580742:0:10007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 10 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.580750:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789395134.580754:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789395134.580760:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.580799:0:10007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 10 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.580813:0:10007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 10 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.580827:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10007:1876316239679104:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395134.580907:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.583425:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10007:1876316239679104:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395134.583454:0:10007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.585427:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.585820:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231728512 00000100:00100000:3.0:1789395134.585830:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231728512 00002000:00100000:3.0:1789395134.585887:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff89a3c904c000 x1876316231728512/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/0 e 0 to 0 dl 1789395145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395134.585898:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c904c000 with x1876316231728512 ext(0->1) 00010000:00010000:3.0:1789395134.585908:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 11 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.585926:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 11 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395134.585935:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a3c904c000 00000100:00100000:3.0:1789395134.586021:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:3.0:1789395134.586032:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231728512:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395134.587262:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231728512:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1224us (1874us total) trans 4294969883 rc 0/0 00000100:00100000:3.0:1789395134.587273:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00002000:00100000:3.0:1789395134.587283:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff89a3c904c000 x1876316231728512/t4294969883(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/448 e 0 to 0 dl 1789395145 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395134.587295:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c904c000 with x1876316231728512 ext(0->1) 00010000:00010000:3.0:1789395134.587303:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 13 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.587416:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 13 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395134.587425:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a3c904c000 00000100:00100000:1.0:1789395134.590746:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.590847:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231728640 00000100:00100000:0.0:1789395134.590857:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231728640 00010000:00010000:0.0:1789395134.590900:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 13 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.590962:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1562 00000100:00100000:0.0:1789395134.590973:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c6280c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231728640:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395134.590989:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789395134.591006:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1789395134.591010:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1789395133 00002000:00010000:0.0:1789395134.591013:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1789395133 00002000:00010000:0.0:1789395134.591015:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789395134.591022:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 13 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.591036:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 13 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.591061:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc66c3a4/0xff35729af316a855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e0c expref: 13 pid: 14639 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.591078:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.591083:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.591090:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.591100:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.591564:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395134.591620:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c6280c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231728640:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 647us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.591630:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1562 00010000:00010000:1.0:1789395134.600284:0:10007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600304:0:10007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600527:0:10007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600543:0:10007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600552:0:10007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600560:0:10007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395134.600564:0:10007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600573:0:10007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600594:0:10007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.600602:0:10007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fac5ee4f/0xff35729af316abd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.600765:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231728384:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 20079us (20248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.600776:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5201 00000100:00100000:1.0:1789395134.639008:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.639141:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231728896 00000100:00100000:2.0:1789395134.639151:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231728896 00000100:00100000:2.0:1789395134.639215:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:2.0:1789395134.639224:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18247:x1876316231728896:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:2.0:1789395134.639280:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395134.639323:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316a847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e05 expref: 27 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.639341:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:2.0:1789395134.639346:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395134.639370:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.639414:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.639426:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.639445:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:2.0:1789395134.639500:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239679232:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.639557:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.639610:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c865af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.639790:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239679232 00000100:00100000:3.0:1789395134.639797:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239679232 00000100:00100000:3.0:1789395134.639838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:3.0:1789395134.639845:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239679232:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.639934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239679232:12345-0@lo:1000:mdt_io00_002.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.639954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00100000:1.0:1789395134.642594:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239679360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395134.642664:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.643074:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239679616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395134.643108:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.643148:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395134.643154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239679488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395134.643180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.643213:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239679616 00000100:00100000:3.0:1789395134.643220:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239679616 00000100:00100000:3.0:1789395134.643263:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239679488 00000100:00100000:3.0:1789395134.643266:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239679488 00000100:00100000:3.0:1789395134.643283:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789395134.643307:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239679616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789395134.643341:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25521600 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789395134.643634:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239679616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.643644:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789395134.643663:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789395134.643670:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239679488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789395134.643682:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 28672 granted 25521600 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789395134.643709:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239679488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.643715:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789395134.643761:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239679488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395134.643775:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239679616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395134.643797:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239679360 00000100:00100000:3.0:1789395134.643801:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239679360 00000100:00100000:3.0:1789395134.643826:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:3.0:1789395134.643832:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:3639:x1876316239679360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789395134.643856:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1789395134.643891:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:3639:x1876316239679360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.643896:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000100:00100000:2.0:1789395134.644131:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239679232:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395134.644761:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239679744:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395134.644808:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.644839:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c865af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.644860:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239679744 00000100:00100000:2.0:1789395134.644864:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239679744 00000100:00100000:2.0:1789395134.644891:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00000100:00100000:2.0:1789395134.644897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239679744:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395134.646580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239679744:12345-0@lo:403:mdt_io00_002.0 Request processed in 1675us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.646592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00000100:00100000:2.0:1789395134.646642:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239679744:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1789395134.648707:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239679360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395134.648734:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395134.648743:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239679872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395134.648793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.648853:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239679872 00000100:00100000:1.0:1789395134.648860:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239679872 00000100:00100000:1.0:1789395134.648905:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789395134.648914:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3639:x1876316239679872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789395134.648935:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67571136 pending 86016 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395134.649079:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3639:x1876316239679872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.649086:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789395134.649136:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239679872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395134.651592:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789395134.653631:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.653648:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.653660:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.653682:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680128:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395134.653746:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.653841:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c865af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.653865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680128 00000100:00100000:2.0:1789395134.653872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680128 00000100:00100000:0.0:1789395134.655281:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239680000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395134.655352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.657180:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680000 00000100:00100000:3.0:1789395134.657192:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680000 00000100:00100000:3.0:1789395134.657258:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789395134.657268:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239680000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789395134.657298:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67571136 pending 86016 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395134.657377:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239680000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.657580:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789395134.657637:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239680000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395134.659622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:0.0:1789395134.659799:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239680128:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395134.659822:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.659848:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316abea lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316abe3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.659878:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316abea lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316abe3 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.659897:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316abea lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316abe3 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.659904:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395134.659907:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.659910:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab800, rc 0) 00000100:00100000:0.0:1789395134.660001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:6526:x1876316239680128:12345-0@lo:101:mdt_io00_002.0 Request processed in 367us (6255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.660008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00000100:00100000:3.0:1789395134.660162:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680128:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395134.660181:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.660192:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395134.660214:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.660247:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.660254:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.660261:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.660279:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680256:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1789395134.660326:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.660360:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.660586:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680256 00000100:00100000:0.0:1789395134.660593:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680256 00000100:00100000:0.0:1789395134.660638:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:0.0:1789395134.660645:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:6526:x1876316239680256:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395134.660654:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.660666:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316abf1 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.660684:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316abf1 expref: 19 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.660695:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316abf1 expref: 19 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.660703:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xdcc87686 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395134.660706:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.660709:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab000, rc 0) 00000100:00100000:0.0:1789395134.660750:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680256:12345-0@lo:101:mdt_io00_002.0 Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.660757:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1789395134.660832:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680256:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395134.660847:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.660856:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395134.660871:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:1.0:1789395134.660889:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.660897:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.660905:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.660917:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.660923:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.660930:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.661004:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.661017:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.661025:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.661051:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.661066:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 26 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.661078:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8baa680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239680384:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395134.661155:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b30c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789395134.666108:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@000000006977a020 x1876316239680384) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 26 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666153:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 26 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666180:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316abc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ead expref: 26 pid: 6512 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.666198:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8baa680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239680384:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395134.666219:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:3.0:1789395134.666225:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666233:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666241:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666263:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666272:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.666279:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.666599:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680512:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.666652:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.666738:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.666966:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680512 00000100:00100000:0.0:1789395134.666974:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680512 00000100:00100000:0.0:1789395134.667020:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:0.0:1789395134.667029:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680512:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667157:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680512:12345-0@lo:1000:mdt_io00_002.0 Request processed in 128us (504us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395134.667165:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00000100:00100000:3.0:1789395134.667292:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680512:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.667351:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680640:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395134.667380:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.667426:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.667527:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680640 00000100:00100000:0.0:1789395134.667531:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680640 00000100:00100000:0.0:1789395134.667559:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322 00000100:00100000:0.0:1789395134.667565:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680640:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667614:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680640:12345-0@lo:1000:mdt_io00_002.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.667621:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322 00000100:00100000:0.0:1789395134.667642:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680640:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667724:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680768:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667750:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.667760:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c4f4d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.667771:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680768 00000100:00100000:0.0:1789395134.667774:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680768 00000100:00100000:0.0:1789395134.667791:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:0.0:1789395134.667797:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680768:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667842:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239680768:12345-0@lo:1000:mdt_io00_002.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.667848:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00000100:00100000:0.0:1789395134.667870:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680768:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667960:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680896:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.667983:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.667992:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.668001:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239680896 00000100:00100000:0.0:1789395134.668004:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239680896 00000100:00100000:0.0:1789395134.668020:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:0.0:1789395134.668025:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239680896:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.668074:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239680896:12345-0@lo:1000:mdt_io00_002.0 Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.668079:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00000100:00100000:0.0:1789395134.668101:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239680896:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1789395134.668614:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].403, 1264 off602384 00000040:00080000:0.0:1789395134.668668:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].401, 1344 off656704 00000100:00100000:0.0:1789395134.668690:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239681024:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.668716:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.668727:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.668741:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239681024 00000100:00100000:0.0:1789395134.668745:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239681024 00000100:00100000:0.0:1789395134.668764:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:0.0:1789395134.668770:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1876316239681024:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395134.668866:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1876316239681024:12345-0@lo:1000:mdt_io00_002.0 Request processed in 95us (148us total) trans 4294969884 rc 0/0 00000100:00100000:0.0:1789395134.668872:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:0.0:1789395134.668900:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239681024:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1789395134.668908:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4c4f4d0c0 with version 759 00000004:00080000:1.0:1789395134.669301:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 759 rpc_version 759 00000020:00100000:1.0:1789395134.669566:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395134.669575:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c8bab800 x1876316239681280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395134.669591:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8bab800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239681280:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395134.669629:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.669679:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.669718:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239681280 00000100:00100000:0.0:1789395134.669723:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239681280 00000100:00100000:0.0:1789395134.669787:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:0.0:1789395134.669795:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:7874:x1876316239681280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395134.670313:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:7874:x1876316239681280:12345-0@lo:1000:osp_up1-0.0 Request processed in 517us (681us total) trans 4294968464 rc 0/0 00000100:00100000:0.0:1789395134.670328:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:1.0:1789395134.671615:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8bab800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239681280:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1789395134.671823:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008113ea15 reply state 00000000cb021a88 transno 4294983530 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671845:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671855:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:2.0:1789395134.671858:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1789395134.671862:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395134.671868:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671875:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671882:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671888:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.671892:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671900:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671909:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c3ab8a00) 00010000:00010000:2.0:1789395134.671911:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.671914:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.671920:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316abff lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395134.672014:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008113ea15 reply state 00000000cb021a88 transno 4294983530 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672024:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672030:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a4c3ab8400) 00010000:00010000:2.0:1789395134.672032:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395134.672034:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1789395134.672041:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.672047:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672054:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672060:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672113:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395134.672118:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.672129:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672137:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.672151:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:2.0:1789395134.672158:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672163:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672169:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672173:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.672176:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672181:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672189:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:2.0:1789395134.672191:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.672193:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.672199:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316abdc lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.672287:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18247:x1876316231728896:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 33062us (33286us total) trans 4294983530 rc 0/0 00000100:00100000:2.0:1789395134.672295:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00010000:00010000:3.0:1789395134.679582:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395134.679595:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.679607:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395134.679614:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395134.679624:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.680072:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.680142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231729024 00000100:00100000:1.0:1789395134.680151:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231729024 00000100:00100000:1.0:1789395134.680203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23484 00000100:00100000:1.0:1789395134.680212:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18247:x1876316231729024:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:1.0:1789395134.680284:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680299:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680309:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680328:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680336:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680342:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680607:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680618:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680625:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395134.680671:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680683:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680690:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680696:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680703:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680707:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.680712:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680718:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680727:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4c3ab8300) 00010000:00010000:1.0:1789395134.680730:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.680735:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680741:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ac14 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680758:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680774:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680780:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680785:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.680787:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680793:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680800:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a4c3ab8c00) 00010000:00010000:1.0:1789395134.680803:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.680805:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680810:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ac1b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680820:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680825:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680830:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680834:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.680836:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680842:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:1.0:1789395134.680860:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.680862:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.680868:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ac22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.680950:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18247:x1876316231729024:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 724us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.680958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23484 00010000:00010000:2.0:1789395134.681675:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.682024:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789395134.682071:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789395134.682112:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.682126:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc800/0xff35729af316abe3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316abea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.682152:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395134.682154:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395134.682156:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395134.686789:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239681408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395134.686869:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.688004:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239681408 00000100:00100000:3.0:1789395134.688015:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239681408 00000100:00100000:3.0:1789395134.688083:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1789395134.688093:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+20:3637:x1876316239681408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395134.688107:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789395134.688310:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.688380:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231729280 00000100:00100000:0.0:1789395134.688419:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231729280 00000100:00100000:0.0:1789395134.688457:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23485 00000100:00100000:0.0:1789395134.688465:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18247:x1876316231729280:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395134.688482:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.688500:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316ac29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105eb4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.688608:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.688622:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.688633:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.688643:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1521:0x0]: returning size 2 00010000:00010000:0.0:1789395134.688742:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316ac29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1521:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.688759:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.688768:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:0.0:1789395134.688771:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789395134.688775:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab600, rc 0) 00000100:00100000:0.0:1789395134.688827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18247:x1876316231729280:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 362us (519us total) trans 4294983531 rc 0/0 00000100:00100000:0.0:1789395134.688834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23485 00010000:00010000:3.0:1789395134.689972:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316abea lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316abe3 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.689992:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3c8b1d300) 00010000:00010000:3.0:1789395134.690004:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395134.690075:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+19:3637:x1876316239681408:12345-0@lo:103:ldlm_bl.0 Request processed in 1983us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.690083:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1789395134.690275:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239681408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395134.693791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.693913:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231729408 00000100:00100000:3.0:1789395134.693924:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231729408 00000100:00100000:3.0:1789395134.693995:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5202 00000100:00100000:3.0:1789395134.694006:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231729408:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:3.0:1789395134.694052:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.694072:0:14638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.694080:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9ca:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789395134.694084:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395134.694088:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.694131:0:14638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.694147:0:14638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 11 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.694161:0:14638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6405180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14638:1876316239681536:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395134.694238:0:14638:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.697167:0:14638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6405180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14638:1876316239681536:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395134.697199:0:14638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.700643:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.701052:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231729536 00000100:00100000:1.0:1789395134.701061:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231729536 00002000:00100000:1.0:1789395134.701109:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->1) req@ffff89a3c79bed80 x1876316231729536/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/0 e 0 to 0 dl 1789395145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395134.701129:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79bed80 with x1876316231729536 ext(0->1) 00010000:00010000:1.0:1789395134.701139:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 12 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.701155:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 12 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395134.701164:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a3c79bed80 00000100:00100000:1.0:1789395134.701189:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:1.0:1789395134.701199:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231729536:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:1.0:1789395134.702504:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231729536:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1299us (1872us total) trans 4294969885 rc 0/0 00000100:00100000:1.0:1789395134.702515:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00002000:00100000:1.0:1789395134.702526:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->1) req@ffff89a3c79bed80 x1876316231729536/t4294969885(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:600/0 lens 496/448 e 0 to 0 dl 1789395145 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395134.702535:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79bed80 with x1876316231729536 ext(0->1) 00010000:00010000:1.0:1789395134.702544:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 14 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.702558:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 14 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395134.702565:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a3c79bed80 00000100:00100000:1.0:1789395134.712371:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.712538:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231729664 00000100:00100000:0.0:1789395134.712549:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231729664 00010000:00010000:0.0:1789395134.712590:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 14 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.712675:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1563 00000100:00100000:0.0:1789395134.712686:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231729664:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395134.712702:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789395134.712731:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1789395134.712734:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1789395133 00002000:00010000:0.0:1789395134.712737:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1789395133 00002000:00010000:0.0:1789395134.712739:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789395134.712747:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 14 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.712768:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 14 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.712791:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316a8fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e44 expref: 14 pid: 8426 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.712809:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.712814:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395134.712820:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.712830:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.712866:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395134.712921:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231729664:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 236us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.712928:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1563 00010000:00010000:1.0:1789395134.713208:0:14638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713224:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713245:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713254:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713262:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713269:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395134.713273:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713282:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713295:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.713303:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff062f0c/0xff35729af316ac3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.713368:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231729408:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 19364us (19585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.713378:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5202 00000100:00100000:1.0:1789395134.726006:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.726158:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231729920 00000100:00100000:2.0:1789395134.726168:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231729920 00000100:00100000:2.0:1789395134.726232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:2.0:1789395134.726242:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18247:x1876316231729920:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:2.0:1789395134.726293:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395134.726318:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316a8ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e3d expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.726337:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:2.0:1789395134.726342:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395134.726364:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.726376:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.726448:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.726466:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:2.0:1789395134.726511:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239681664:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395134.726560:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.726582:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4c865af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.726891:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239681664 00000100:00100000:0.0:1789395134.726905:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239681664 00000100:00100000:0.0:1789395134.726951:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:0.0:1789395134.726959:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239681664:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395134.727058:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239681664:12345-0@lo:1000:mdt_io00_000.0 Request processed in 98us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.727066:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000100:00100000:2.0:1789395134.727572:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239681664:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395134.728358:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239681792:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395134.729022:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.729059:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.729214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239681792 00000100:00100000:3.0:1789395134.729222:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239681792 00000100:00100000:3.0:1789395134.729273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:3.0:1789395134.729282:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239681792:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395134.735037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239681792:12345-0@lo:403:mdt_io00_000.0 Request processed in 5746us (6006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.735052:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:1.0:1789395134.735211:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239681792:0@lo:403:mdt_io00_000.0 00010000:00010000:1.0:1789395134.737182:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.737199:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.737211:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.737233:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239681920:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1789395134.737375:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.737567:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.737608:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239681920 00000100:00100000:0.0:1789395134.737616:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239681920 00000100:00100000:0.0:1789395134.737705:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:0.0:1789395134.737715:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239681920:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1789395134.737731:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.737750:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316ac53 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316ac4c expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.738022:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316ac53 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316ac4c expref: 20 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.738037:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316ac53 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ac4c expref: 20 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.738045:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395134.738048:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.738051:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa200, rc 0) 00000100:00100000:0.0:1789395134.738103:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:6524:x1876316239681920:12345-0@lo:101:mdt_io00_000.0 Request processed in 390us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.738109:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1789395134.738235:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239681920:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395134.738251:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.738261:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.738294:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.738319:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.738326:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.738334:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.738347:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682048:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395134.738373:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395134.738796:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.738863:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239682048 00000100:00100000:0.0:1789395134.738868:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239682048 00000100:00100000:0.0:1789395134.738898:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:0.0:1789395134.738906:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:6524:x1876316239682048:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1789395134.738916:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.738930:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316ac5a expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.738989:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316ac5a expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.739000:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ac5a expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.739008:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xb62e0cbf (ffff89a3c8b1dc00) 00010000:00010000:0.0:1789395134.739010:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.739013:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2abe00, rc 0) 00000100:00100000:0.0:1789395134.739043:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682048:12345-0@lo:101:mdt_io00_000.0 Request processed in 138us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.739048:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00100000:2.0:1789395134.739622:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682048:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395134.739647:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739659:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395134.739675:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1789395134.739693:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739711:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739720:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739732:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739739:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739745:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739794:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739805:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739813:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739838:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.739852:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 28 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395134.739864:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239682176:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395134.739955:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d8966b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789395134.745130:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@000000001023cc87 x1876316239682176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 28 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745157:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 28 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745181:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ac30 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eb4 expref: 28 pid: 6511 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395134.745197:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239682176:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395134.745220:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:0.0:1789395134.745226:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745238:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745246:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745268:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745276:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.745282:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.745837:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682304:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.745904:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.745976:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395134.746024:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239682304 00000100:00100000:0.0:1789395134.746031:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239682304 00000100:00100000:0.0:1789395134.746139:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:0.0:1789395134.746150:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682304:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395134.746281:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682304:12345-0@lo:1000:mdt_io00_000.0 Request processed in 133us (377us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395134.746292:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00000100:00100000:1.0:1789395134.746365:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682304:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.746436:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682432:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.746472:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.747282:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395134.747568:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239682432 00000100:00100000:2.0:1789395134.747575:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239682432 00000100:00100000:3.0:1789395134.747632:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3332 00000100:00100000:3.0:1789395134.747642:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682432:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.747717:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682432:12345-0@lo:1000:mdt_io00_000.0 Request processed in 77us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.747725:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3332 00000100:00100000:1.0:1789395134.747804:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682432:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.747921:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682560:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395134.747958:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.747982:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.748085:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239682560 00000100:00100000:3.0:1789395134.748089:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239682560 00000100:00100000:3.0:1789395134.748119:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333 00000100:00100000:3.0:1789395134.748125:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682560:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.748168:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6524:x1876316239682560:12345-0@lo:1000:mdt_io00_000.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.748174:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333 00000100:00100000:3.0:1789395134.748197:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682560:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.748274:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6405180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682688:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.748310:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.748331:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.748342:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239682688 00000100:00100000:3.0:1789395134.748346:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239682688 00000100:00100000:3.0:1789395134.748363:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334 00000100:00100000:3.0:1789395134.748368:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1876316239682688:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.748454:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1876316239682688:12345-0@lo:1000:mdt_io00_000.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.748461:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334 00000100:00100000:3.0:1789395134.748485:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6405180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682688:0@lo:1000:mdt_io00_000.0 00000040:00080000:3.0:1789395134.748792:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].404, 1264 off603648 00000040:00080000:3.0:1789395134.748840:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].402, 1344 off658048 00000100:00100000:3.0:1789395134.748860:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6405180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682816:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.748882:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.748896:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.748909:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239682816 00000100:00100000:3.0:1789395134.748913:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239682816 00000100:00100000:3.0:1789395134.748932:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335 00000100:00100000:3.0:1789395134.748948:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1876316239682816:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395134.749048:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1876316239682816:12345-0@lo:1000:mdt_io00_000.0 Request processed in 110us (164us total) trans 4294969886 rc 0/0 00000100:00100000:3.0:1789395134.749055:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335 00000100:00100000:3.0:1789395134.749082:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6405180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239682816:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1789395134.749090:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c9b9ccc0 with version 760 00000004:00080000:3.0:1789395134.749103:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 760 rpc_version 760 00000020:00100000:3.0:1789395134.749120:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395134.749128:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4f6406a00 x1876316239683072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395134.749141:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6406a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239683072:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395134.749167:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.749181:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.749192:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683072 00000100:00100000:3.0:1789395134.749195:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683072 00000100:00100000:3.0:1789395134.749211:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:3.0:1789395134.749217:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:7874:x1876316239683072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395134.749510:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:7874:x1876316239683072:12345-0@lo:1000:osp_up1-0.0 Request processed in 292us (341us total) trans 4294968465 rc 0/0 00000100:00100000:3.0:1789395134.749516:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:3.0:1789395134.749549:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6406a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239683072:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1789395134.749585:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001edc47bf reply state 00000000f816560d transno 4294983532 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749604:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749613:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:3.0:1789395134.749616:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1789395134.749621:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395134.749628:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749635:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749641:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749649:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749659:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.749664:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749672:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749681:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:3.0:1789395134.749684:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.749688:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749695:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac68 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395134.749715:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001edc47bf reply state 00000000f816560d transno 4294983532 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749724:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749730:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a3ca35fe00) 00010000:00010000:3.0:1789395134.749732:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395134.749734:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1789395134.749738:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.749745:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749752:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749763:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749786:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395134.749790:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1789395134.749795:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749802:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395134.749812:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:3.0:1789395134.749819:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749824:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749830:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749834:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.749837:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749843:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749850:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:3.0:1789395134.749853:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.749856:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.749862:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac45 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.749929:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18247:x1876316231729920:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 23687us (23931us total) trans 4294983532 rc 0/0 00000100:00100000:3.0:1789395134.749947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00010000:00010000:0.0:1789395134.755124:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395134.755138:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.755151:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395134.755159:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395134.755175:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.755225:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.755232:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395134.755262:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.755270:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1e00/0xff35729af316ac4c lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316ac53 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.755297:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395134.755299:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395134.755301:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395134.756107:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395134.756129:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239683200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395134.756204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395134.756752:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683200 00000100:00100000:0.0:1789395134.756760:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683200 00000100:00100000:0.0:1789395134.756814:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1789395134.756824:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+22:3636:x1876316239683200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395134.756838:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395134.756860:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316ac53 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316ac4c expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.756877:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395134.756890:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395134.756933:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+21:3636:x1876316239683200:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.756950:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1789395134.757950:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.758601:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239683200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395134.758744:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231730176 00000100:00100000:3.0:1789395134.758751:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231730176 00000100:00100000:3.0:1789395134.758841:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5063 00000100:00100000:3.0:1789395134.758850:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:18247:x1876316231730176:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:3.0:1789395134.759090:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18247:x1876316231730176:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 240us (1151us total) trans 4294968466 rc 0/0 00000100:00100000:3.0:1789395134.759098:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5063 00000100:00100000:3.0:1789395134.796371:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.796554:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231730432 00000100:00100000:2.0:1789395134.796565:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231730432 00000100:00100000:2.0:1789395134.796628:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23486 00000100:00100000:2.0:1789395134.796648:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18249:x1876316231730432:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395134.796673:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.796696:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ebb expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796783:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796797:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796807:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796821:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796827:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796833:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796900:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ac92 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796908:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ac92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796914:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ac92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796927:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796934:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796951:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796958:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796963:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.796968:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796975:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.796987:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395134.796990:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.796995:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797001:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316ac84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797014:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797020:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797026:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797031:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.797034:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797039:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797046:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a3ca35f400) 00010000:00010000:2.0:1789395134.797049:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.797052:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797057:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ac8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797090:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ac7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ebb expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797102:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ac92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ebb expref: 30 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.797110:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca366f00) 00010000:00010000:2.0:1789395134.797113:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395134.797115:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395134.797181:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18249:x1876316231730432:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 544us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.797188:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23486 00000100:00100000:1.0:1789395134.802747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.802794:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.802986:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231730688 00000100:00100000:0.0:1789395134.802996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231730688 00000100:00100000:0.0:1789395134.803059:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23487 00000100:00100000:0.0:1789395134.803069:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18249:x1876316231730688:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395134.803092:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.803115:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316ac99 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ec2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.803270:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:0.0:1789395134.803367:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316ac99 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ec2 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.803381:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395134.803424:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395134.803430:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316ac99 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ec2 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.803458:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab600, rc 0) 00000100:00100000:0.0:1789395134.803506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18249:x1876316231730688:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 438us (768us total) trans 4294968467 rc 301/301 00000100:00100000:0.0:1789395134.803513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23487 00000100:00100000:2.0:1789395134.803902:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231730816 00000100:00100000:2.0:1789395134.803908:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231730816 00000100:00100000:2.0:1789395134.803956:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1344 00000100:00100000:2.0:1789395134.803964:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231730816:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395134.803976:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395134.803992:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ac92 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ebb expref: 30 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.804004:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca366f00) 00010000:00010000:2.0:1789395134.804007:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395134.804029:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:2395:x1876316231730816:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 67us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.804035:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1344 00000100:00100000:0.0:1789395134.814096:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.814231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231730944 00000100:00100000:1.0:1789395134.814241:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231730944 00000100:00100000:1.0:1789395134.814299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5064 00000100:00100000:1.0:1789395134.814309:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18249:x1876316231730944:12345-192.168.203.54@tcp:33:lfs.0 00000004:00200000:1.0:1789395134.815592:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:1.0:1789395134.815598:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:1.0:1789395134.815701:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18249:x1876316231730944:12345-192.168.203.54@tcp:33:lfs.0 Request processed in 1390us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.817654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5064 00000100:00100000:3.0:1789395134.822543:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.822755:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231731200 00000100:00100000:2.0:1789395134.822774:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231731200 00000100:00100000:2.0:1789395134.822828:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5065 00000100:00100000:2.0:1789395134.822837:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18249:x1876316231731200:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:2.0:1789395134.823070:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18249:x1876316231731200:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 234us (536us total) trans 4294968468 rc 0/0 00000100:00100000:2.0:1789395134.823077:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5065 00000100:00100000:2.0:1789395134.831958:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.837223:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231731328 00000100:00100000:0.0:1789395134.837238:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231731328 00000100:00100000:2.0:1789395134.842682:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23488 00000100:00100000:2.0:1789395134.842698:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18090:x1876316231731328:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395134.842735:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.842760:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316aca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ec9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.843834:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316acae lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.843854:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316acae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.843866:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316acae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395134.843965:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:2.0:1789395134.843970:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1789395134.843990:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316acae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.844020:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316aca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ec9 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.844042:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316acae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ec9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.844051:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:2.0:1789395134.844054:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395134.844057:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395134.844130:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18090:x1876316231731328:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1435us (12193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.844138:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23488 00000100:00100000:3.0:1789395134.849019:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.854011:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231731456 00000100:00100000:0.0:1789395134.854025:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231731456 00000100:00100000:2.0:1789395134.854201:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23489 00000100:00100000:2.0:1789395134.854214:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18090:x1876316231731456:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395134.854237:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.854260:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316acb5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ed0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.854318:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316acbc lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.854332:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316acbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.854344:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316acbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395134.854416:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xc9:0x0]: returning size 4096 00000004:00200000:2.0:1789395134.854422:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1789395134.854468:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316acb5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed0 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.854487:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316acbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed0 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.854497:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395134.854500:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395134.854504:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395134.854564:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18090:x1876316231731456:12345-192.168.203.54@tcp:101:bash.0 Request processed in 352us (5553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395134.854571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23489 00000100:00100000:1.0:1789395134.860220:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395134.860294:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231731584 00000100:00100000:0.0:1789395134.860303:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231731584 00000100:00100000:0.0:1789395134.860366:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23490 00000100:00100000:0.0:1789395134.860376:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18090:x1876316231731584:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395134.860411:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395134.860445:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316acc3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ed7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.860525:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.860541:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.860551:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.860599:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:0.0:1789395134.860604:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1789395134.860640:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316acc3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.860657:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.860664:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395134.860667:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395134.860671:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aba00, rc 0) 00000100:00100000:0.0:1789395134.861003:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231731584:12345-192.168.203.54@tcp:101:bash.0 Request processed in 626us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395134.861014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23490 00000100:00100000:0.0:1789395134.870061:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.870132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231731840 00000100:00100000:1.0:1789395134.870142:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231731840 00000100:00100000:1.0:1789395134.870198:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23491 00000100:00100000:1.0:1789395134.870207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18090:x1876316231731840:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395134.870229:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.870251:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316acd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ede expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.870517:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0c00/0xff35729af316acd8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.870531:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0c00/0xff35729af316acd8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.870542:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0c00/0xff35729af316acd8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395134.870553:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:1.0:1789395134.870656:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316acd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ede expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.870677:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0c00/0xff35729af316acd8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ede expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.870685:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:1.0:1789395134.870688:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789395134.870691:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0c00, rc 0) 00000100:00100000:1.0:1789395134.872077:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231731840:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1865us (2018us total) trans 4294968469 rc 0/0 00000100:00100000:1.0:1789395134.872088:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23491 00000100:00100000:3.0:1789395134.883237:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.883338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231731968 00000100:00100000:1.0:1789395134.883347:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231731968 00000100:00100000:2.0:1789395134.883427:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5066 00000100:00100000:2.0:1789395134.883440:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231731968:12345-192.168.203.54@tcp:37:bash.0 00000100:00100000:3.0:1789395134.899136:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231731968:12345-192.168.203.54@tcp:37:bash.0 Request processed in 15689us (15897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.899151:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5066 00000100:00100000:0.0:1789395134.906233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.906333:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732096 00000100:00100000:1.0:1789395134.906343:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732096 00000100:00100000:1.0:1789395134.906433:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5067 00000100:00100000:1.0:1789395134.906444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231732096:12345-192.168.203.54@tcp:37:bash.0 00000100:00100000:1.0:1789395134.913453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231732096:12345-192.168.203.54@tcp:37:bash.0 Request processed in 7001us (7223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395134.913467:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5067 00000100:00100000:3.0:1789395134.946298:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.948051:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732224 00000100:00100000:2.0:1789395134.948067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732224 00000100:00100000:2.0:1789395134.948147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23492 00000100:00100000:2.0:1789395134.948159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231732224:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395134.948181:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.948205:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ace6 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ee5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948271:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948286:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948299:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948313:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948319:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948325:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948364:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948370:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948376:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948437:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948443:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.948448:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948456:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948472:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395134.948476:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.948480:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948486:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316aced lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948499:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948505:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948510:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948514:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.948516:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948525:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948531:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xeddcfc6c (ffff89a3ca35f400) 00010000:00010000:2.0:1789395134.948533:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.948535:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948540:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316acf4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948572:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ace6 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ee5 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948581:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395134.948584:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395134.948587:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ace6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ee5 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.948596:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395134.948651:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231732224:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 494us (2362us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395134.948659:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23492 00000100:00100000:0.0:1789395134.953680:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.953777:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732352 00000100:00100000:1.0:1789395134.953788:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732352 00000100:00100000:1.0:1789395134.953859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23493 00000100:00100000:1.0:1789395134.953870:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231732352:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395134.953890:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.953911:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316acfb lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105eec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.953983:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.953997:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954010:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954023:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954030:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954036:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954077:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954084:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954090:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954097:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954102:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.954106:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954114:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954124:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:1.0:1789395134.954127:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.954132:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954139:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316ad02 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954151:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954157:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954163:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954168:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.954171:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954177:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954185:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xeddcfc6c (ffff89a4c3ab8300) 00010000:00010000:1.0:1789395134.954188:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.954190:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954196:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316ad09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954225:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316acfb lrc: 1/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eec expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954235:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:1.0:1789395134.954237:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395134.954241:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316acfb lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105eec expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.954250:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0200, rc 0) 00000100:00100000:1.0:1789395134.954313:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231732352:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 445us (643us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395134.954321:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23493 00000100:00100000:0.0:1789395134.959789:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.960083:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732480 00000100:00100000:3.0:1789395134.960093:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732480 00000100:00100000:3.0:1789395134.960195:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23494 00000100:00100000:3.0:1789395134.960206:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231732480:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395134.960225:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395134.960246:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316ad10 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105ef3 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960308:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960334:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960346:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960361:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960368:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960374:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960451:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960459:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960464:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960474:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960479:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.960483:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960490:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960501:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395134.960504:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.960508:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960514:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ad17 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960527:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960532:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960537:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960542:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.960544:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960553:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960559:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3491cd4c (ffff89a3ca363000) 00010000:00010000:3.0:1789395134.960561:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.960564:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960569:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316ad1e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960598:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316ad10 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ef3 expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960608:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395134.960610:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395134.960614:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316ad10 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ef3 expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.960622:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:3.0:1789395134.960684:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231732480:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 480us (906us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395134.960691:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23494 00000100:00100000:2.0:1789395134.966787:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395134.966958:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732608 00000100:00100000:3.0:1789395134.966969:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732608 00000100:00100000:3.0:1789395134.967119:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23495 00000100:00100000:3.0:1789395134.967131:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231732608:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395134.967154:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395134.967172:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316ad25 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105efa expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967231:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967244:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967255:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967267:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967274:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967281:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967327:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967334:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967340:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967347:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967353:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.967356:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967364:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967374:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395134.967377:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.967382:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967419:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ad2c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967431:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967437:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967442:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967447:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395134.967450:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967455:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967466:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3491cd4c (ffff89a3ca363c00) 00010000:00010000:3.0:1789395134.967469:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395134.967471:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967478:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ad33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967504:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316ad25 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105efa expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967513:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395134.967515:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395134.967518:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316ad25 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105efa expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.967527:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c400, rc 0) 00000100:00100000:3.0:1789395134.967578:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231732608:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 450us (801us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395134.967585:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23495 00000100:00100000:0.0:1789395134.971953:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.972045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732736 00000100:00100000:1.0:1789395134.972055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732736 00000100:00100000:1.0:1789395134.972153:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23496 00000100:00100000:1.0:1789395134.972163:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231732736:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395134.972185:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.972207:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ad3a lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f01 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972297:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972323:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972335:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972350:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972358:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972364:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972637:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972646:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972653:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972660:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972666:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.972670:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972678:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972689:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395134.972693:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.972697:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972705:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad41 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972718:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972724:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972729:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972734:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.972737:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972747:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972754:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3735a305 (ffff89a4c3ab8300) 00010000:00010000:1.0:1789395134.972757:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.972759:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972765:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad48 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972797:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ad3a lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f01 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972807:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395134.972809:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395134.972813:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ad3a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f01 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.972822:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0400, rc 0) 00000100:00100000:1.0:1789395134.972931:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231732736:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 768us (996us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395134.973056:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23496 00000100:00100000:3.0:1789395134.976274:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395134.976355:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231732864 00000100:00100000:2.0:1789395134.976365:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231732864 00000100:00100000:2.0:1789395134.976450:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23497 00000100:00100000:2.0:1789395134.976461:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231732864:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395134.976482:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395134.976502:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316ad4f lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f08 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976562:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976576:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976587:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976601:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976608:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976613:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976655:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976661:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976667:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976673:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976679:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.976684:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976691:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976703:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395134.976706:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.976711:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976718:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfc00/0xff35729af316ad56 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976730:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976735:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976741:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976746:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395134.976749:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976755:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976766:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3735a305 (ffff89a3ca35f400) 00010000:00010000:2.0:1789395134.976768:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395134.976771:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976776:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ad5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976806:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316ad4f lrc: 1/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f08 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976817:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395134.976819:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395134.976822:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316ad4f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f08 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395134.976831:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395134.977738:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231732864:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 1274us (1469us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395134.977749:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23497 00000100:00100000:3.0:1789395134.984519:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.984657:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231733120 00000100:00100000:1.0:1789395134.984668:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231733120 00000100:00100000:1.0:1789395134.984723:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23498 00000100:00100000:1.0:1789395134.984734:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231733120:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395134.984758:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.984778:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ad64 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f0f expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984859:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984873:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984883:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984894:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984901:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984907:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984951:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984959:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984965:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984971:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984977:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.984981:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984988:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.984998:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395134.985001:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.985006:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985013:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316ad6b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985026:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985032:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985037:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985042:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395134.985044:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985049:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985059:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a4c3ab8400) 00010000:00010000:1.0:1789395134.985061:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395134.985063:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985069:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ad72 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985097:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ad64 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f0f expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985108:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395134.985110:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395134.985114:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ad64 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f0f expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.985123:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0400, rc 0) 00000100:00100000:1.0:1789395134.985189:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18251:x1876316231733120:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 457us (680us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395134.985197:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23498 00000100:00100000:0.0:1789395134.989356:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395134.989544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231733376 00000100:00100000:1.0:1789395134.989555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231733376 00000100:00100000:1.0:1789395134.989622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23499 00000100:00100000:1.0:1789395134.989634:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18251:x1876316231733376:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395134.989656:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395134.989677:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316ad79 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989757:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989770:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989780:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989790:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989799:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316abf1 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989807:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.989844:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316abf1 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395134.989859:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6406680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239683328:0@lo:104: 00000100:00100000:1.0:1789395134.989904:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395134.989967:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395134.990026:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683328 00000100:00100000:3.0:1789395134.990030:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683328 00000100:00100000:3.0:1789395134.990070:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1789395134.990077:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1876316239683328:12345-0@lo:104: 00010000:00010000:3.0:1789395134.990089:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.990141:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395134.990147:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1876316239683328:12345-0@lo:104: Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.990153:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00010000:00010000:3.0:1789395134.990172:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395134.990178:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.990185:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395134.990190:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395134.990199:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.990223:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.990229:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395134.990249:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.990257:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10cc00/0xff35729af316abf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316abf8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.990274:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395134.990276:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395134.990278:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395134.990289:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239683456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395134.990317:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395134.990350:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683456 00000100:00100000:3.0:1789395134.990354:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683456 00010000:00010000:3.0:1789395134.990372:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316abf1 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395134.990431:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1789395134.990438:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+21:3638:x1876316239683456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395134.990448:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395134.991263:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6406680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239683328:0@lo:104: 00010000:00010000:1.0:1789395134.991287:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395134.993841:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968469 is committed 00000001:00080000:2.0:1789395134.994082:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968465 is committed 00010000:00010000:3.0:1789395134.994246:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316abf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316abf1 expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.994267:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xdcc87686 (ffff89a3c8b1d800) 00010000:00010000:3.0:1789395134.994272:0:20671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.994282:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.994290:0:20671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395134.994361:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395134.994473:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+14:3638:x1876316239683456:12345-0@lo:103:ldlm_bl.0 Request processed in 4034us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395134.994483:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1789395134.994731:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239683456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395134.994981:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395134.994992:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995195:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316ad8e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995207:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316ad8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995215:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316ad8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395134.995226:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x190:0x0]: returning size 2 00010000:00010000:0.0:1789395134.995307:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995380:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995494:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995501:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995512:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.995516:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995525:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995536:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395134.995539:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.995543:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995549:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316ad80 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995561:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995567:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995574:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995579:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395134.995582:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995588:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995599:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xdcc87686 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395134.995602:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395134.995605:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995611:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316ad87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995677:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316ad79 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f16 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995692:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316ad8e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f16 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395134.995700:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:0.0:1789395134.995702:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395134.995705:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa000, rc 0) 00000100:00100000:0.0:1789395134.995793:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18251:x1876316231733376:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 6162us (6446us total) trans 4294968470 rc 0/0 00000100:00100000:0.0:1789395134.995802:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23499 00000100:00100000:3.0:1789395135.005432:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.005503:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231733504 00000100:00100000:1.0:1789395135.005513:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231733504 00000100:00100000:1.0:1789395135.005588:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5203 00000100:00100000:1.0:1789395135.005598:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231733504:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.005618:0:14639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.005639:0:14639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f1d expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395135.005666:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x6aa800bd, atime: 0x0, ctime: 0x6aa800bd, blocks: 0x8 00010000:00010000:1.0:1789395135.005685:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789395135.005690:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395135.005700:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 13 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.005719:0:14639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 13 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.005733:0:14639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0400, rc 0) 00000100:00080000:2.0:1789395135.005813:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395135.006062:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231733504:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 464us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.006071:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5203 00000100:00100000:3.0:1789395135.012183:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.012289:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231733632 00000100:00100000:1.0:1789395135.012301:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231733632 00002000:00100000:1.0:1789395135.012363:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff89a3c9127800 x1876316231733632/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/0 e 0 to 0 dl 1789395146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395135.012375:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9127800 with x1876316231733632 ext(0->4095) 00002000:00010000:1.0:1789395135.012381:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9127800 00000100:00100000:1.0:1789395135.012457:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:1.0:1789395135.012469:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231733632:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:1.0:1789395135.012641:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231733632:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 174us (467us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789395135.012649:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00002000:00100000:1.0:1789395135.012655:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff89a3c9127800 x1876316231733632/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/4536 e 0 to 0 dl 1789395146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395135.012663:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9127800 with x1876316231733632 ext(0->4095) 00002000:00010000:1.0:1789395135.012667:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9127800 00000100:00100000:0.0:1789395135.020670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.020892:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231733888 00000100:00100000:3.0:1789395135.020903:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231733888 00000100:00100000:3.0:1789395135.020993:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5068 00000100:00100000:3.0:1789395135.021003:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18251:x1876316231733888:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:3.0:1789395135.021293:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18251:x1876316231733888:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 291us (630us total) trans 4294968471 rc 0/0 00000100:00100000:3.0:1789395135.021301:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5068 00000100:00080000:2.0:1789395135.021609:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395135.037629:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.037722:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231734016 00000100:00100000:1.0:1789395135.037732:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231734016 00000100:00100000:1.0:1789395135.037806:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3337 00000100:00100000:1.0:1789395135.037817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2396:x1876316231734016:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:1.0:1789395135.037873:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.037893:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ada3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.037962:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.037977:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.037989:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038004:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038010:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038015:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038070:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038077:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038084:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038089:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.038093:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038100:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038112:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395135.038114:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.038119:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038127:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038139:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038145:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038151:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038156:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.038158:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038164:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038172:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4c3ab8700) 00010000:00010000:1.0:1789395135.038174:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.038177:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038183:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038213:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ada3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f24 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038227:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395135.038229:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395135.038234:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316ada3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f24 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.038242:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1800, rc -2) 00000100:00080000:2.0:1789395135.038430:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395135.038621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2396:x1876316231734016:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 805us (1001us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395135.038629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3337 00000100:00100000:0.0:1789395135.048857:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.049128:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231734272 00000100:00100000:3.0:1789395135.049139:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231734272 00000100:00100000:3.0:1789395135.049200:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23500 00000100:00100000:3.0:1789395135.049211:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18253:x1876316231734272:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395135.049232:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.049254:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316adb8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049337:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049351:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049362:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049373:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049380:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049449:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049487:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049493:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049499:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049506:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049512:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.049517:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049526:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049538:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395135.049541:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.049546:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049553:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316adbf lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049567:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049573:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049579:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049583:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.049586:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049592:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049600:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a3ca35f300) 00010000:00010000:3.0:1789395135.049602:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.049605:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049611:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316adc6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049640:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316adb8 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f5c expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049650:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395135.049653:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395135.049657:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316adb8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f5c expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.049672:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c400, rc 0) 00000100:00100000:3.0:1789395135.049734:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18253:x1876316231734272:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 525us (900us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395135.049741:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23500 00000100:00100000:2.0:1789395135.055226:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395135.055560:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231734528 00000100:00100000:0.0:1789395135.055570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231734528 00000100:00100000:0.0:1789395135.055631:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23501 00000100:00100000:0.0:1789395135.055642:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18253:x1876316231734528:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395135.055667:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395135.055688:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316adcd lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f63 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.055762:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.055777:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.055788:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.055800:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.055810:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ab88 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.055818:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.056248:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316ab88 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395135.056265:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239683584:0@lo:104: 00000100:00100000:0.0:1789395135.056316:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.056446:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.057663:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683584 00000100:00100000:3.0:1789395135.057673:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683584 00000100:00100000:0.0:1789395135.058098:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1789395135.058108:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239683584:12345-0@lo:104: 00010000:00010000:0.0:1789395135.058134:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.058221:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395135.058227:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239683584:12345-0@lo:104: Request processed in 121us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.058234:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00010000:00010000:1.0:1789395135.058284:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.058292:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.058300:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.058306:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.058325:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.058361:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.058367:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.058423:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.058437:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd800/0xff35729af316ab88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ab8f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.058459:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.058461:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.058462:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.058475:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239683712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.058535:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.058578:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683712 00000100:00100000:1.0:1789395135.058583:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683712 00010000:00010000:1.0:1789395135.058989:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316ab88 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.059018:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1789395135.059026:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+14:3639:x1876316239683712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.059037:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1789395135.060511:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968471 is committed 00010000:00010000:1.0:1789395135.060573:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xbc0ca3a9 (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395135.060580:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.060592:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.060750:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316ab8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316ab88 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.060766:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239683584:0@lo:104: 00010000:00010000:1.0:1789395135.060805:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.061020:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.061198:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.061271:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+13:3639:x1876316239683712:12345-0@lo:103:ldlm_bl.0 Request processed in 2245us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.061280:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:0.0:1789395135.061426:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239683712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395135.061817:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.061825:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.061954:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ade2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.061964:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ade2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.061973:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ade2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395135.061984:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18f:0x0]: returning size 2 00010000:00010000:2.0:1789395135.062070:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062078:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062084:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062091:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062098:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.062103:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062110:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062188:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395135.062192:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.062196:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062203:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316add4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062216:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062222:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062228:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062233:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.062236:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062242:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062253:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xbc0ca3a9 (ffff89a4c3ab8200) 00010000:00010000:2.0:1789395135.062256:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.062258:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062264:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316addb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316adcd lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f63 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062509:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ade2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f63 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.062517:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:2.0:1789395135.062520:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395135.062522:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395135.062679:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18253:x1876316231734528:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 7038us (7461us total) trans 4294968472 rc 0/0 00000100:00100000:2.0:1789395135.062688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23501 00000100:00100000:0.0:1789395135.071159:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.071238:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231734656 00000100:00100000:3.0:1789395135.071248:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231734656 00000100:00100000:3.0:1789395135.071324:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5204 00000100:00100000:3.0:1789395135.071335:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2398:x1876316231734656:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395135.071353:0:14651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.071371:0:14651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f6a expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395135.071432:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x6aa800bd, atime: 0x0, ctime: 0x6aa800bd, blocks: 0x8 00010000:00010000:3.0:1789395135.071452:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=586s v=(0 0) 00010000:00010000:3.0:1789395135.071456:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395135.071465:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 14 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.071484:0:14651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 14 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.071497:0:14651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c400, rc 0) 00000100:00100000:3.0:1789395135.071552:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2398:x1876316231734656:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 218us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.071559:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5204 00000100:00080000:2.0:1789395135.071873:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395135.080671:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.080824:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231734784 00000100:00100000:1.0:1789395135.080834:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231734784 00002000:00100000:1.0:1789395135.080882:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff89a3c988d880 x1876316231734784/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/0 e 0 to 0 dl 1789395146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395135.080893:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988d880 with x1876316231734784 ext(0->4095) 00002000:00010000:1.0:1789395135.080899:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988d880 00000100:00100000:1.0:1789395135.080978:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:1.0:1789395135.080989:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2397:x1876316231734784:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:1.0:1789395135.081176:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2397:x1876316231734784:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 188us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789395135.081184:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00002000:00100000:1.0:1789395135.081190:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff89a3c988d880 x1876316231734784/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/4536 e 0 to 0 dl 1789395146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395135.081198:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988d880 with x1876316231734784 ext(0->4095) 00002000:00010000:1.0:1789395135.081202:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988d880 00000100:00100000:1.0:1789395135.093987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395135.094211:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231735040 00000100:00100000:0.0:1789395135.094220:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231735040 00000100:00100000:0.0:1789395135.094275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5069 00000100:00100000:0.0:1789395135.094285:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18253:x1876316231735040:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:0.0:1789395135.095237:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18253:x1876316231735040:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 946us (1254us total) trans 4294968473 rc 0/0 00000100:00100000:0.0:1789395135.095246:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5069 00000100:00100000:0.0:1789395135.113897:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.113994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231735296 00000100:00100000:1.0:1789395135.114005:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231735296 00000100:00100000:1.0:1789395135.114065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23502 00000100:00100000:1.0:1789395135.114075:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18257:x1876316231735296:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.114099:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.114121:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adf7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f71 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114189:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114203:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114214:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114224:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114231:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114237:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114272:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114280:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114286:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114293:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114300:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.114304:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114326:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114337:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395135.114340:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.114345:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114351:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316adfe lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114364:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114370:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114377:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114382:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.114437:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114443:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114455:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca363300) 00010000:00010000:1.0:1789395135.114458:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.114461:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114467:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae05 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114495:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adf7 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f71 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114505:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395135.114508:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395135.114511:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316adf7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f71 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.114520:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395135.114569:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18257:x1876316231735296:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 496us (681us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395135.114576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23502 00000100:00100000:0.0:1789395135.118906:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.118983:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231735552 00000100:00100000:1.0:1789395135.118993:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231735552 00000100:00100000:1.0:1789395135.119055:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23503 00000100:00100000:1.0:1789395135.119065:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18257:x1876316231735552:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.119090:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.119110:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316ae0c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f78 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119188:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119203:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119214:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119224:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119234:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aab6 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119242:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.119274:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316aab6 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.119302:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239683840:0@lo:104: 00000100:00100000:1.0:1789395135.119356:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.119560:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789395135.119572:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683840 00000100:00100000:3.0:1789395135.119577:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683840 00000100:00100000:3.0:1789395135.119612:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1789395135.119619:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239683840:12345-0@lo:104: 00010000:00010000:3.0:1789395135.119633:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.119676:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395135.119682:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239683840:12345-0@lo:104: Request processed in 64us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.119688:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1789395135.119872:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.119895:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239683840:0@lo:104: 00010000:00010000:1.0:1789395135.119912:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.119996:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395135.120004:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.120012:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395135.120017:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395135.120026:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.120055:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.120061:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395135.120091:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.120099:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca10d800/0xff35729af316aab6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316aabd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.120115:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395135.120117:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395135.120118:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.120228:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395135.120241:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239683968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.120273:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.120542:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239683968 00000100:00100000:2.0:1789395135.120547:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239683968 00010000:00010000:2.0:1789395135.120567:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316aab6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.120597:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1789395135.120604:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cb3ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3637:x1876316239683968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395135.120614:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789395135.123298:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968473 is committed 00010000:00010000:2.0:1789395135.123461:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316aabd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316aab6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.123486:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x84832a57 (ffff89a3ca35f700) 00010000:00010000:2.0:1789395135.123491:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.123501:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.123509:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.123537:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395135.123616:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cb3ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3637:x1876316239683968:12345-0@lo:103:ldlm_bl.0 Request processed in 3011us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.123626:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1789395135.123757:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239683968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.123845:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.123854:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.123975:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316ae21 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.123986:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316ae21 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.123995:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316ae21 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395135.124006:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18d:0x0]: returning size 3 00010000:00010000:1.0:1789395135.124094:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124112:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124119:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124126:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124132:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.124136:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124144:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124158:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:1.0:1789395135.124162:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.124166:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124172:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0600/0xff35729af316ae13 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124182:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124189:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124194:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124199:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.124201:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124207:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124215:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x84832a57 (ffff89a3ca35f700) 00010000:00010000:1.0:1789395135.124217:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.124220:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124225:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316ae1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124275:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316ae0c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f78 expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124287:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316ae21 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f78 expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.124293:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff89a4c3ab8b00) 00010000:00010000:1.0:1789395135.124296:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395135.124298:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395135.124341:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18257:x1876316231735552:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 5279us (5444us total) trans 4294968474 rc 0/0 00000100:00100000:1.0:1789395135.124348:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23503 00000100:00100000:0.0:1789395135.134365:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.135668:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231735680 00000100:00100000:2.0:1789395135.135681:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231735680 00000100:00100000:2.0:1789395135.135879:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5205 00000100:00100000:2.0:1789395135.135891:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231735680:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395135.135910:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.135931:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f7f expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395135.135965:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 3, mtime: 0x6aa800bd, atime: 0x0, ctime: 0x6aa800bd, blocks: 0x8 00010000:00010000:2.0:1789395135.135984:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789395135.135989:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395135.135998:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 15 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.136023:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 15 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.136036:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfc00, rc 0) 00000100:00100000:2.0:1789395135.136102:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231735680:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 212us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.136109:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5205 00000100:00100000:0.0:1789395135.142798:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.143154:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231735808 00000100:00100000:2.0:1789395135.143164:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231735808 00002000:00100000:2.0:1789395135.143215:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff89a3c988fb80 x1876316231735808/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/0 e 0 to 0 dl 1789395146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395135.143225:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988fb80 with x1876316231735808 ext(0->4095) 00002000:00010000:2.0:1789395135.143232:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988fb80 00000100:00100000:2.0:1789395135.143266:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:2.0:1789395135.143276:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231735808:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:2.0:1789395135.144210:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231735808:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 931us (1416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789395135.144219:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00002000:00100000:2.0:1789395135.144228:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff89a3c988fb80 x1876316231735808/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/4536 e 0 to 0 dl 1789395146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395135.144237:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988fb80 with x1876316231735808 ext(0->4095) 00002000:00010000:2.0:1789395135.144240:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988fb80 00000100:00100000:0.0:1789395135.154047:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.154143:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231736064 00000100:00100000:1.0:1789395135.154154:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231736064 00000100:00100000:1.0:1789395135.154211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5070 00000100:00100000:1.0:1789395135.154222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18257:x1876316231736064:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:1.0:1789395135.154545:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18257:x1876316231736064:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 324us (507us total) trans 4294968475 rc 0/0 00000100:00100000:1.0:1789395135.154553:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5070 00000100:00100000:0.0:1789395135.179255:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.179345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231736320 00000100:00100000:2.0:1789395135.179355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231736320 00000100:00100000:2.0:1789395135.179439:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23504 00000100:00100000:2.0:1789395135.179448:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18259:x1876316231736320:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395135.179468:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.179488:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316ae36 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f86 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179554:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179567:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179577:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179587:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179594:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179600:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179636:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179642:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179648:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179654:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179660:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.179664:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179671:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179683:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.179686:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.179691:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179698:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae3d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179720:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179726:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179733:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179738:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.179740:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179751:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179758:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395135.179760:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.179763:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179769:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316ae44 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179794:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316ae36 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f86 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179804:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.179806:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395135.179810:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316ae36 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f86 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.179817:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dee00, rc 0) 00000100:00100000:2.0:1789395135.179862:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18259:x1876316231736320:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 415us (616us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395135.179869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23504 00000100:00100000:0.0:1789395135.186638:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.186790:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231736576 00000100:00100000:3.0:1789395135.186801:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231736576 00000100:00100000:3.0:1789395135.186862:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23505 00000100:00100000:3.0:1789395135.186873:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18259:x1876316231736576:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395135.186898:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.186920:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ae4b lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f8d expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187007:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187023:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187034:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187046:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187056:0:10512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316aa4d expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187065:0:10512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.187099:0:10512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316aa4d expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.187113:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239684096:0@lo:104: 00000100:00100000:3.0:1789395135.187162:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.187542:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.190264:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684096 00000100:00100000:0.0:1789395135.190279:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684096 00000100:00100000:0.0:1789395135.190363:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1789395135.190374:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239684096:12345-0@lo:104: 00010000:00010000:0.0:1789395135.190416:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.190511:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395135.190516:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:10512:x1876316239684096:12345-0@lo:104: Request processed in 146us (3354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.190524:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1789395135.190688:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10512:1876316239684096:0@lo:104: 00010000:00010000:2.0:1789395135.190721:0:10512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.190834:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.190842:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.190865:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.190871:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.190881:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.190915:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.190922:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.190962:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.190970:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd000/0xff35729af316aa4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316aa54 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.190988:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.190990:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.190992:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395135.191036:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239684224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395135.191078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.191285:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684224 00000100:00100000:1.0:1789395135.191289:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684224 00010000:00010000:1.0:1789395135.191311:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316aa4d expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.191340:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1789395135.191347:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+12:3637:x1876316239684224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.191358:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789395135.193506:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968475 is committed 00010000:00010000:1.0:1789395135.193606:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316aa54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316aa4d expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.193632:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x391d5834 (ffff89a3ca363100) 00010000:00010000:1.0:1789395135.193637:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.193648:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.193656:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.193685:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.193752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3637:x1876316239684224:12345-0@lo:103:ldlm_bl.0 Request processed in 2405us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.193761:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00010000:00010000:2.0:1789395135.194038:0:10512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194047:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194151:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316ae60 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194160:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316ae60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194169:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316ae60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395135.194179:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 2 00010000:00010000:2.0:1789395135.194254:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194261:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194268:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194274:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194280:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.194284:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194307:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194322:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395135.194324:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.194328:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194335:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316ae52 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194344:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194350:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194356:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194361:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.194364:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194369:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194375:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x391d5834 (ffff89a3ca363100) 00010000:00010000:2.0:1789395135.194377:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.194380:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194420:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316ae59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194461:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316ae4b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f8d expref: 15 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194474:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316ae60 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f8d expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.194481:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff89a3ca35f700) 00010000:00010000:2.0:1789395135.194484:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395135.194486:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dee00, rc 0) 00000100:00100000:2.0:1789395135.194527:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18259:x1876316231736576:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 7657us (7898us total) trans 4294968476 rc 0/0 00000100:00100000:2.0:1789395135.194534:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23505 00000100:00100000:3.0:1789395135.194683:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239684224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395135.202194:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.202259:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231736704 00000100:00100000:2.0:1789395135.202268:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231736704 00000100:00100000:2.0:1789395135.202327:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5206 00000100:00100000:2.0:1789395135.202336:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231736704:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395135.202354:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.202374:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f94 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395135.202430:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x6aa800bd, atime: 0x0, ctime: 0x6aa800bd, blocks: 0x8 00010000:00010000:2.0:1789395135.202446:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789395135.202451:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395135.202460:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 14 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.202476:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 14 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.202489:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395135.202531:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231736704:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 196us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.202538:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5206 00000100:00100000:0.0:1789395135.208729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.208809:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231736832 00000100:00100000:1.0:1789395135.208819:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231736832 00002000:00100000:1.0:1789395135.208871:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff89a3c79f6300 x1876316231736832/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/0 e 0 to 0 dl 1789395146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395135.208882:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79f6300 with x1876316231736832 ext(0->4095) 00002000:00010000:1.0:1789395135.208887:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c79f6300 00000100:00100000:1.0:1789395135.208922:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:1.0:1789395135.208931:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2398:x1876316231736832:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:1.0:1789395135.209103:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2398:x1876316231736832:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 172us (381us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789395135.209112:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00002000:00100000:1.0:1789395135.209119:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff89a3c79f6300 x1876316231736832/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/4536 e 0 to 0 dl 1789395146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395135.209127:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79f6300 with x1876316231736832 ext(0->4095) 00002000:00010000:1.0:1789395135.209130:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c79f6300 00010000:00010000:3.0:1789395135.217604:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.222899:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.222951:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.222990:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231736960 00000100:00100000:2.0:1789395135.223000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231736960 00000100:00100000:2.0:1789395135.223059:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3338 00000100:00100000:2.0:1789395135.223070:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231736960:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:2.0:1789395135.223106:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.223128:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae75 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105f9b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223191:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223205:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223216:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223225:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223233:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223239:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223277:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223284:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223363:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223369:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.223374:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223382:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223421:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.223424:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.223429:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223436:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316ae7c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223449:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223456:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223461:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223465:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.223468:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223473:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223480:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3ca35f900) 00010000:00010000:2.0:1789395135.223482:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.223486:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223491:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316ae83 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223514:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae75 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f9b expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223523:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.223525:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395135.223529:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316ae75 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f9b expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.223542:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfe00, rc -2) 00000100:00100000:2.0:1789395135.223600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231736960:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 532us (709us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395135.223608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3338 00000100:00100000:1.0:1789395135.223684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231737216 00000100:00100000:1.0:1789395135.223689:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231737216 00000100:00100000:1.0:1789395135.223739:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5071 00000100:00100000:1.0:1789395135.223747:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18259:x1876316231737216:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:1.0:1789395135.224004:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18259:x1876316231737216:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 257us (1052us total) trans 4294968477 rc 0/0 00000100:00100000:1.0:1789395135.224011:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5071 00000100:00100000:0.0:1789395135.248047:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.248434:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231737472 00000100:00100000:1.0:1789395135.248446:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231737472 00000100:00100000:1.0:1789395135.248541:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23506 00000100:00100000:1.0:1789395135.248552:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18263:x1876316231737472:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.248573:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.248593:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ae8a lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fb7 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248678:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248693:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248705:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248716:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248723:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248729:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248768:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248775:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248782:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248788:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248794:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.248798:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248806:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248818:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395135.248821:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.248826:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248833:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ae91 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248853:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248860:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248866:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248870:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.248873:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248878:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248886:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3ca35f900) 00010000:00010000:1.0:1789395135.248888:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.248892:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248897:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316ae98 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248924:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ae8a lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fb7 expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248943:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395135.248946:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395135.248950:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ae8a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fb7 expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.248959:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1000, rc 0) 00000100:00100000:1.0:1789395135.249020:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18263:x1876316231737472:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 469us (981us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395135.249027:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23506 00000100:00100000:3.0:1789395135.253585:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.253826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231737728 00000100:00100000:1.0:1789395135.253836:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231737728 00000100:00100000:1.0:1789395135.253909:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23507 00000100:00100000:1.0:1789395135.253920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18263:x1876316231737728:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.253950:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.253974:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae9f lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fbe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254048:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254063:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254074:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254084:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254094:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ab1f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254107:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.254139:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316ab1f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.254153:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239684352:0@lo:104: 00000100:00100000:1.0:1789395135.254200:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.254250:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.254365:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684352 00000100:00100000:0.0:1789395135.254370:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684352 00000100:00100000:0.0:1789395135.254435:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1789395135.254443:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1876316239684352:12345-0@lo:104: 00010000:00010000:0.0:1789395135.254456:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.254509:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395135.254515:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1876316239684352:12345-0@lo:104: Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.254521:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00010000:00010000:2.0:1789395135.254527:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395135.254534:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.254542:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395135.254547:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395135.254556:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.254583:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.254589:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395135.254628:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.254636:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cd400/0xff35729af316ab1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ab26 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.254655:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395135.254657:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395135.254660:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395135.254667:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395135.254677:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239684480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395135.254826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.255029:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684480 00000100:00100000:0.0:1789395135.255034:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684480 00010000:00010000:0.0:1789395135.255053:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316ab1f expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395135.255083:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:0.0:1789395135.255090:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239684480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395135.255100:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395135.256615:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239684352:0@lo:104: 00010000:00010000:1.0:1789395135.256640:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395135.257244:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968477 is committed 00010000:00010000:1.0:1789395135.257342:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316ab26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316ab1f expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.257359:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x18618557 (ffff89a3c8b1d500) 00010000:00010000:1.0:1789395135.257364:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.257374:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.257382:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.257434:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.257486:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3639:x1876316239684480:12345-0@lo:103:ldlm_bl.0 Request processed in 2396us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.257495:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00010000:00010000:0.0:1789395135.257556:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257564:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257666:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316aeb4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257676:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316aeb4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257684:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316aeb4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395135.257694:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18e:0x0]: returning size 2 00010000:00010000:0.0:1789395135.257778:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257786:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257792:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257799:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257805:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.257810:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257818:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257829:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395135.257832:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.257835:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257841:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316aea6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257866:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257872:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257878:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257882:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.257885:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257891:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257898:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x18618557 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395135.257900:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.257904:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257909:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316aead lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257962:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0e00/0xff35729af316ae9f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fbe expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257976:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316aeb4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fbe expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.257984:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:0.0:1789395135.257987:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395135.257989:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab800, rc 0) 00000100:00100000:0.0:1789395135.258038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18263:x1876316231737728:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 4120us (4462us total) trans 4294968478 rc 0/0 00000100:00100000:0.0:1789395135.258045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23507 00000100:00100000:2.0:1789395135.258521:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239684480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.264065:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.264199:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231737856 00000100:00100000:1.0:1789395135.264208:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231737856 00000100:00100000:1.0:1789395135.264261:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5207 00000100:00100000:1.0:1789395135.264271:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231737856:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.264290:0:10007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.264319:0:10007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fc5 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395135.264346:0:10007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x6aa800bd, atime: 0x0, ctime: 0x6aa800bd, blocks: 0x8 00010000:00010000:1.0:1789395135.264365:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789395135.264369:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395135.264378:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 16 pid: 10007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.264422:0:10007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 16 pid: 10007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.264436:0:10007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1000, rc 0) 00000100:00100000:1.0:1789395135.264483:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231737856:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 214us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.264490:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5207 00000100:00100000:1.0:1789395135.270929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.271026:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231737984 00000100:00100000:2.0:1789395135.271037:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231737984 00002000:00100000:2.0:1789395135.271088:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff89a3c9a6c000 x1876316231737984/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/0 e 0 to 0 dl 1789395146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395135.271098:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6c000 with x1876316231737984 ext(0->4095) 00002000:00010000:2.0:1789395135.271104:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9a6c000 00000100:00100000:2.0:1789395135.271136:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:2.0:1789395135.271146:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231737984:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:2.0:1789395135.271303:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231737984:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 158us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789395135.271311:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00002000:00100000:2.0:1789395135.271318:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff89a3c9a6c000 x1876316231737984/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/4536 e 0 to 0 dl 1789395146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395135.271326:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6c000 with x1876316231737984 ext(0->4095) 00002000:00010000:2.0:1789395135.271329:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9a6c000 00000100:00100000:2.0:1789395135.278950:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.279042:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231738240 00000100:00100000:3.0:1789395135.279053:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231738240 00000100:00100000:3.0:1789395135.279110:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5072 00000100:00100000:3.0:1789395135.279121:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18263:x1876316231738240:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:3.0:1789395135.279462:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18263:x1876316231738240:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 341us (527us total) trans 4294968479 rc 0/0 00000100:00100000:3.0:1789395135.279470:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5072 00000100:00100000:3.0:1789395135.295488:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.295636:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231738496 00000100:00100000:2.0:1789395135.295646:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231738496 00000100:00100000:2.0:1789395135.295699:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23508 00000100:00100000:2.0:1789395135.295709:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18265:x1876316231738496:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395135.295733:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.295754:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316aec9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fcc expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.295825:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.295839:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296062:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296077:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296085:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296092:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296128:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296135:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296142:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296150:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296157:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.296162:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296170:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296180:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.296183:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.296188:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296194:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316aed0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296207:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296213:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296219:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296224:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.296227:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296233:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296515:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395135.296518:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.296522:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296528:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316aed7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296557:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316aec9 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fcc expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296567:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.296569:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395135.296572:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316aec9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fcc expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.296581:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395135.296632:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18265:x1876316231738496:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 925us (1154us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395135.296640:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23508 00000100:00100000:0.0:1789395135.302625:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.302834:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231738752 00000100:00100000:1.0:1789395135.302843:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231738752 00000100:00100000:1.0:1789395135.303029:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23509 00000100:00100000:1.0:1789395135.303039:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18265:x1876316231738752:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395135.303063:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.303084:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316aede lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fd3 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303149:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303163:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303174:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303185:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303195:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316ac5a expref: 9 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303204:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.303235:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316ac5a expref: 9 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.303250:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239684608:0@lo:104: 00000100:00100000:1.0:1789395135.303291:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.303334:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.303569:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684608 00000100:00100000:3.0:1789395135.303574:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684608 00000100:00100000:3.0:1789395135.303644:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1789395135.303651:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239684608:12345-0@lo:104: 00010000:00010000:3.0:1789395135.303663:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.303725:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395135.303731:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239684608:12345-0@lo:104: Request processed in 81us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.303737:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1789395135.303804:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239684608:0@lo:104: 00010000:00010000:1.0:1789395135.303824:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.304291:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395135.304299:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.304318:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395135.304324:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395135.304339:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.304368:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.304376:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395135.304435:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.304443:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3cc200/0xff35729af316ac5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316ac61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.304463:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395135.304465:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395135.304467:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395135.304475:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395135.304485:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239684736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395135.304521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.304836:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684736 00000100:00100000:3.0:1789395135.304842:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684736 00010000:00010000:3.0:1789395135.305175:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316ac5a expref: 10 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.305235:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:3.0:1789395135.305243:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239684736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.305254:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789395135.306727:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968479 is committed 00010000:00010000:3.0:1789395135.306826:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abe00/0xff35729af316ac61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316ac5a expref: 10 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.306856:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xb62e0cbf (ffff89a3c8b1dc00) 00010000:00010000:3.0:1789395135.306863:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.306873:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.306882:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.306913:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.306998:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239684736:12345-0@lo:103:ldlm_bl.0 Request processed in 1754us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.307006:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:0.0:1789395135.307086:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239684736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.307218:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307226:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307350:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316aef3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307361:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316aef3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307370:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316aef3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395135.307380:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x191:0x0]: returning size 2 00010000:00010000:1.0:1789395135.307494:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307502:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307509:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307515:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307521:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.307526:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307534:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307544:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:1.0:1789395135.307547:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.307550:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307557:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316aee5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307566:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307573:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307580:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307585:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395135.307587:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307593:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307599:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xb62e0cbf (ffff89a3c8b1dc00) 00010000:00010000:1.0:1789395135.307601:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.307603:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307613:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316aeec lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307672:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316aede lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fd3 expref: 17 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307685:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316aef3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fd3 expref: 16 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.307692:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff89a4c3ab8000) 00010000:00010000:1.0:1789395135.307695:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395135.307697:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1600, rc 0) 00000100:00100000:1.0:1789395135.307752:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18265:x1876316231738752:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 4713us (5137us total) trans 4294968480 rc 0/0 00000100:00100000:1.0:1789395135.307760:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23509 00000100:00100000:1.0:1789395135.314005:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.314095:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231738880 00000100:00100000:3.0:1789395135.314106:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231738880 00000100:00100000:3.0:1789395135.314182:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5208 00000100:00100000:3.0:1789395135.314192:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231738880:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395135.314211:0:14638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.314231:0:14638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fda expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395135.314258:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 2, mtime: 0x6aa800bd, atime: 0x0, ctime: 0x6aa800bd, blocks: 0x8 00010000:00010000:3.0:1789395135.314278:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=586s v=(0 0) 00010000:00010000:3.0:1789395135.314282:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395135.314293:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 15 pid: 14638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.314333:0:14638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 15 pid: 14638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.314347:0:14638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:3.0:1789395135.314610:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231738880:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 418us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.314618:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5208 00000100:00100000:0.0:1789395135.326606:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.326696:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231739008 00000100:00100000:3.0:1789395135.326787:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231739008 00002000:00100000:3.0:1789395135.326843:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff89a3c79f5880 x1876316231739008/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/0 e 0 to 0 dl 1789395146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395135.326854:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79f5880 with x1876316231739008 ext(0->4095) 00002000:00010000:3.0:1789395135.326860:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c79f5880 00000100:00100000:3.0:1789395135.326896:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:3.0:1789395135.326906:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231739008:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:3.0:1789395135.327086:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231739008:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 180us (488us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789395135.327095:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00002000:00100000:3.0:1789395135.327102:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff89a3c79f5880 x1876316231739008/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:601/0 lens 488/4536 e 0 to 0 dl 1789395146 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395135.327110:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79f5880 with x1876316231739008 ext(0->4095) 00002000:00010000:3.0:1789395135.327114:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c79f5880 00000100:00100000:0.0:1789395135.335254:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.335986:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231739264 00000100:00100000:2.0:1789395135.335997:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231739264 00000100:00100000:2.0:1789395135.336106:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5073 00000100:00100000:2.0:1789395135.336118:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18265:x1876316231739264:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:2.0:1789395135.336428:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18265:x1876316231739264:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 311us (1183us total) trans 4294968481 rc 0/0 00000100:00100000:2.0:1789395135.336437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5073 00000100:00100000:1.0:1789395135.369324:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395135.370755:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231739392 00000100:00100000:0.0:1789395135.370768:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231739392 00000100:00100000:0.0:1789395135.370831:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3339 00000100:00100000:0.0:1789395135.370842:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2396:x1876316231739392:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:0.0:1789395135.370898:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395135.370920:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316af08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402105fe1 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.370987:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371003:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371015:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371030:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371036:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371042:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371095:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371104:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371111:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371117:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.371121:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371134:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371146:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395135.371149:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.371153:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371160:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316af0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371174:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371180:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371186:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371191:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.371194:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371200:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371207:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4cbc0ed00) 00010000:00010000:0.0:1789395135.371209:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.371212:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371222:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316af16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371252:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316af08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fe1 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371262:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395135.371265:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395135.371269:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316af08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fe1 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.371277:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aac00, rc -2) 00000100:00100000:0.0:1789395135.371343:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2396:x1876316231739392:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 503us (2035us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395135.371351:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3339 00000100:00100000:0.0:1789395135.384632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.384697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231739520 00000100:00100000:1.0:1789395135.384708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231739520 00000100:00100000:1.0:1789395135.384771:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23510 00000100:00100000:1.0:1789395135.384781:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18266:x1876316231739520:12345-192.168.203.54@tcp:41:rm.0 00000004:00000024:1.0:1789395135.384843:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847018496 avail 7383801856 00000100:00100000:1.0:1789395135.384931:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18266:x1876316231739520:12345-192.168.203.54@tcp:41:rm.0 Request processed in 150us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.384946:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23510 00000100:00100000:1.0:1789395135.397341:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395135.397461:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231739776 00000100:00100000:0.0:1789395135.397471:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231739776 00000100:00100000:0.0:1789395135.397533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23511 00000100:00100000:0.0:1789395135.397551:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18266:x1876316231739776:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395135.397607:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395135.397632:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dee00/0xff35729af316ae60 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f8d expref: 17 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.397652:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff89a3ca35f700) 00010000:00010000:0.0:1789395135.397663:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395135.397712:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.397722:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.397732:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395135.397753:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239684864:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395135.397799:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.397876:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.398131:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239684864 00000100:00100000:3.0:1789395135.398137:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239684864 00000100:00100000:3.0:1789395135.398178:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00000100:00100000:3.0:1789395135.398186:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6512:x1876316239684864:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.398197:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.398213:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316af1d expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.398237:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.398248:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.398271:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.398285:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 29 pid: 6511 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.398296:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239684992:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395135.398359:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.406824:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239684992:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395135.406880:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.406893:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395135.406896:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.406899:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.406908:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:0.0:1789395135.406975:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6512:x1876316239684864:12345-0@lo:101:mdt00_001.0 Request processed in 8789us (9175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.406984:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00000100:00100000:1.0:1789395135.407137:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983520 gen 2 00000004:00080000:1.0:1789395135.407143:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983520 committed transno 4294983520 00000020:00080000:1.0:1789395135.407149:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca6cd780 refcount 2 committed 0 result 0 batchid 395 00000020:00080000:1.0:1789395135.407153:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c8861100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca6cd900 00000020:00080000:1.0:1789395135.407156:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].389 00000020:00080000:1.0:1789395135.407159:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c8861f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c1400 00000020:00080000:1.0:1789395135.407161:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].389 00000100:00100000:1.0:1789395135.407200:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8bab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239684864:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395135.407218:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.407229:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789395135.407287:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 395 committed batchid 394 00000020:00080000:0.0:1789395135.407353:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 394 00000100:00100000:1.0:1789395135.409808:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.410120:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231739904 00000100:00100000:2.0:1789395135.410130:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231739904 00010000:00010000:2.0:1789395135.410167:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 30 pid: 6511 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.410206:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1570 00000100:00100000:2.0:1789395135.410216:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231739904:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395135.410231:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395135.410237:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 30 pid: 6511 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.410248:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 30 pid: 6511 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.410271:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316acca lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed7 expref: 30 pid: 6511 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.410287:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395135.410294:0:20671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.410304:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.410313:0:20671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.410345:0:20671:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.410359:0:20671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:20671:1876316239685120:0@lo:105: 00000100:00100000:2.0:1789395135.410448:0:20671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.410480:0:20671:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.410775:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239685120 00000100:00100000:3.0:1789395135.410781:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239685120 00000100:00100000:3.0:1789395135.410819:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1789395135.410826:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20671:x1876316239685120:12345-0@lo:105: 00010000:00010000:3.0:1789395135.410853:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.410868:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.410877:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.410884:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.410891:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.410899:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.410923:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2aac00) 00000100:00100000:3.0:1789395135.410975:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20671:x1876316239685120:12345-0@lo:105: Request processed in 149us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.410983:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00010000:00010000:1.0:1789395135.411151:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.411161:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395135.411188:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1789395135.411224:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.411232:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.411246:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.411263:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239685248:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395135.411292:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.411317:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.411380:0:20671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:20671:1876316239685120:0@lo:105: 00010000:00010000:2.0:1789395135.411429:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395135.411469:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:2395:x1876316231739904:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1253us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.411476:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1570 00000100:00100000:3.0:1789395135.411983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239685248 00000100:00100000:3.0:1789395135.411989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239685248 00000100:00100000:3.0:1789395135.412032:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:3.0:1789395135.412040:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:6512:x1876316239685248:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.412055:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.412072:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316af2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.412096:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.412105:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.412120:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1789395135.412151:0:6517:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1789395135.412193:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.412202:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395135.412205:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.412208:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.412215:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c600, rc 0) 00000100:00100000:3.0:1789395135.412257:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239685248:12345-0@lo:101:mdt00_001.0 Request processed in 217us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.412263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:3.0:1789395135.412295:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239685248:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.412310:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.412319:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395135.416243:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983532 is committed 00000020:00080000:0.0:1789395135.416285:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 401 batchid updated 00010000:00010000:2.0:1789395135.416352:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416364:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416371:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416377:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cdc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.416422:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416432:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416448:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395135.416451:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.416458:0:3623:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416473:0:3623:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416482:0:3623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.416527:0:3623:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.416613:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3623:1876316239685376:0@lo:105: 00000100:00100000:2.0:1789395135.416684:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.416722:0:3623:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.417041:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239685376 00000100:00100000:3.0:1789395135.417050:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239685376 00000100:00100000:3.0:1789395135.417109:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1789395135.417119:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3623:x1876316239685376:12345-0@lo:105: 00010000:00010000:3.0:1789395135.417131:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.417141:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.417150:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.417158:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.417166:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.417174:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.417204:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca0e0200) 00000100:00100000:3.0:1789395135.417247:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3623:x1876316239685376:12345-0@lo:105: Request processed in 130us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.417253:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000020:00080000:1.0:1789395135.417340:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 401 00000004:00080000:1.0:1789395135.417442:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c80b3900 with version 761 00000020:00080000:1.0:1789395135.417450:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 401 cancel update log [0x240000401:0x3:0x0].395: rc = 0 00000020:00080000:1.0:1789395135.417526:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 401 cancel update log [0x200000400:0x3:0x0].398: rc = 0 00000020:00080000:1.0:1789395135.417535:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 401 00000100:00100000:2.0:1789395135.417817:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3623:1876316239685376:0@lo:105: 00010000:00010000:2.0:1789395135.418143:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418154:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316aa62 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418170:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418177:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418183:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418194:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.418198:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418206:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418220:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff89a3ca363f00) 00010000:00010000:2.0:1789395135.418222:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1789395135.418226:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418231:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316aa69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418251:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418256:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418261:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418265:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.418268:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418274:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418284:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca363300) 00010000:00010000:2.0:1789395135.418286:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.418289:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418295:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316aacb lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418314:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418321:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418327:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418331:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.418334:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418340:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418348:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff89a3ca366200) 00010000:00010000:2.0:1789395135.418350:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1789395135.418353:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418358:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316aad2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418372:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418377:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418413:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418418:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.418421:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418426:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418432:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a3ca35f900) 00010000:00010000:2.0:1789395135.418434:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.418437:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418441:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ab34 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418451:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418456:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418460:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418465:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.418468:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418473:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418479:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:2.0:1789395135.418481:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1789395135.418484:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418489:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ab3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418500:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418506:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418512:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418517:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.418520:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418526:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.418537:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a3ca35f300) 00010000:00010000:2.0:1789395135.418539:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:3.0:1789395135.418644:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 761 rpc_version 761 00000020:00100000:3.0:1789395135.418674:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395135.418683:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c89cca80 x1876316239685632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395135.418702:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239685632:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395135.418753:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.418780:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.419413:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239685632 00000100:00100000:0.0:1789395135.419421:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239685632 00000100:00100000:0.0:1789395135.419468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3342 00000100:00100000:0.0:1789395135.419477:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239685632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395135.419778:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239685632:12345-0@lo:1000:osp_up1-0.0 Request processed in 301us (1023us total) trans 4294968482 rc 0/0 00000100:00100000:0.0:1789395135.419786:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3342 00000100:00100000:1.0:1789395135.419909:0:7874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968465 gen 2 00000004:00080000:1.0:1789395135.419916:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968460 committed transno 4294968465 00000020:00080000:1.0:1789395135.419921:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca480240 refcount 2 committed 0 result 0 batchid 402 00000020:00080000:1.0:1789395135.419925:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9c0c0 00000020:00080000:1.0:1789395135.419928:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca480a80 00000020:00080000:1.0:1789395135.419939:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].396 00000020:00080000:1.0:1789395135.419942:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c91c0000 00000020:00080000:1.0:1789395135.419945:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].399 00000004:00080000:1.0:1789395135.419988:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968461 committed transno 4294968465 00000020:00080000:1.0:1789395135.419992:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c9b9c300 refcount 2 committed 0 result 0 batchid 403 00000020:00080000:1.0:1789395135.419995:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c8861a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca34b9c0 00000020:00080000:1.0:1789395135.419998:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9c540 00000020:00080000:1.0:1789395135.420001:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].397 00000020:00080000:1.0:1789395135.420003:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9274c00 00000020:00080000:1.0:1789395135.420006:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].400 00000004:00080000:1.0:1789395135.420017:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968462 committed transno 4294968465 00000020:00080000:1.0:1789395135.420020:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca34b3c0 refcount 2 committed 0 result 0 batchid 404 00000020:00080000:1.0:1789395135.420023:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c8861d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4c865a9c0 00000020:00080000:1.0:1789395135.420025:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c8861400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca34b840 00000020:00080000:1.0:1789395135.420027:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].398 00000020:00080000:1.0:1789395135.420029:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c8861e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c82eaa00 00000020:00080000:1.0:1789395135.420031:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].401 00000004:00080000:1.0:1789395135.420039:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968463 committed transno 4294968465 00000020:00080000:1.0:1789395135.420042:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca480180 refcount 2 committed 0 result 0 batchid 405 00000020:00080000:1.0:1789395135.420044:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4d92d3780 00000020:00080000:1.0:1789395135.420047:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca480780 00000020:00080000:1.0:1789395135.420049:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].399 00000020:00080000:1.0:1789395135.420051:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c921dc00 00000020:00080000:1.0:1789395135.420053:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].402 00000004:00080000:1.0:1789395135.420062:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968464 committed transno 4294968465 00000020:00080000:1.0:1789395135.420065:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4c4f4d240 refcount 2 committed 0 result 0 batchid 406 00000020:00080000:1.0:1789395135.420067:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40d200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca33ac00 00000020:00080000:1.0:1789395135.420070:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40dd00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4c4f4d0c0 00000020:00080000:1.0:1789395135.420072:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].401 00000020:00080000:1.0:1789395135.420074:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca288c00 00000020:00080000:1.0:1789395135.420076:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].403 00000004:00080000:1.0:1789395135.420086:0:7874:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968465 committed transno 4294968465 00000020:00080000:1.0:1789395135.420089:0:7874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c9b9c480 refcount 2 committed 0 result 0 batchid 407 00000020:00080000:1.0:1789395135.420091:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca1cc300 00000020:00080000:1.0:1789395135.420094:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919cd00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9ccc0 00000020:00080000:1.0:1789395135.420096:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].402 00000020:00080000:1.0:1789395135.420098:0:7874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c919c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c77d8600 00000020:00080000:1.0:1789395135.420100:0:7874:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].404 00000100:00100000:1.0:1789395135.420111:0:7874:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a3c89cca80 x1876316239685632/t4294968482(4294968482) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395151 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789395135.420127:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239685632:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1789395135.420144:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 407 committed batchid 401 00000020:00080000:1.0:1789395135.420178:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 401 00010000:00010000:2.0:1789395135.420777:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.420790:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ab9d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.420814:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.420821:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.421106:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.421117:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395135.421140:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:3.0:1789395135.421185:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239685760:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.421233:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.421265:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789395135.421305:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421321:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.421325:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421334:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421348:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:2.0:1789395135.421351:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1789395135.421356:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421362:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316aba4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421410:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421418:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421423:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421428:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.421431:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421437:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421445:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a4c3ab8400) 00010000:00010000:2.0:1789395135.421447:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.421449:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421455:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316ac06 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421467:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421473:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421478:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421483:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.421485:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421490:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421497:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff89a3ca366600) 00010000:00010000:2.0:1789395135.421499:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1789395135.421501:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421506:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ac0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421519:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421525:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421530:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.421535:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.421537:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.421746:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239685760 00000100:00100000:1.0:1789395135.421754:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239685760 00000100:00100000:1.0:1789395135.421799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343 00000100:00100000:1.0:1789395135.421809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239685760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395135.422132:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239685760:12345-0@lo:1000:mdt00_001.0 Request processed in 323us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.422140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343 00010000:00010000:2.0:1789395135.422188:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422205:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395135.422208:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.422211:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422217:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316ac6f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422233:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422239:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422245:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422250:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395135.422253:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422258:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422264:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:2.0:1789395135.422267:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1789395135.422270:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.422275:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316ac76 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.422442:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239685760:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.422503:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239685888:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.422533:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.422718:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.422802:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239685888 00000100:00100000:0.0:1789395135.422808:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239685888 00000100:00100000:0.0:1789395135.423089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344 00000100:00100000:0.0:1789395135.423099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239685888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395135.423190:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239685888:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.423196:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344 00000100:00100000:1.0:1789395135.423253:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239685888:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395135.423296:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239686016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789395135.423332:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.423751:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.423813:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686016 00000100:00100000:3.0:1789395135.423818:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686016 00000100:00100000:3.0:1789395135.423878:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00000100:00100000:3.0:1789395135.423886:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239686016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.423966:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239686016:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (632us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395135.423976:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00000100:00100000:1.0:1789395135.424100:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239686016:0@lo:1000:mdt00_001.0 00000004:00080000:1.0:1789395135.424122:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1789395135.424130:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.424142:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.424149:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.424173:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395135.424179:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1789395135.424183:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.424189:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.424196:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.424207:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789395135.424266:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18266:x1876316231739776:12345-192.168.203.54@tcp:36:rm.0 Request processed in 26723us (26932us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395135.424274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23511 00010000:00010000:3.0:1789395135.424760:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789395135.424767:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.424775:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395135.424781:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.424790:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.424819:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.424826:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395135.425057:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425066:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aac00/0xff35729af316af1d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425085:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395135.425089:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425095:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395135.425099:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.425107:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425126:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425132:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395135.425138:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425146:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0200/0xff35729af316af2b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425157:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.425159:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.425160:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.425167:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.425179:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239686272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.425217:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.425246:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395135.425253:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239686144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.425273:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.425299:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686272 00000100:00100000:3.0:1789395135.425303:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686272 00000100:00100000:3.0:1789395135.425496:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686144 00000100:00100000:3.0:1789395135.425500:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686144 00000100:00100000:3.0:1789395135.425522:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1789395135.425529:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+23:3637:x1876316239686272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.425663:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.425681:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316af32 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316af2b expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425696:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x391d5834 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395135.425705:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.425784:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239686272:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.425791:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1789395135.425807:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:3.0:1789395135.425814:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239686144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.425825:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.425846:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af24 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316af1d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.425856:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395135.425863:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.425885:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239686144:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.425891:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1789395135.429930:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239686272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.429975:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239686144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.431223:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.431305:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231740160 00000100:00100000:3.0:1789395135.431323:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231740160 00000100:00100000:3.0:1789395135.431380:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23512 00000100:00100000:3.0:1789395135.431432:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18266:x1876316231740160:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.431489:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.431518:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316acbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ed0 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431538:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395135.431560:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395135.431584:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431597:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431607:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431621:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431628:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431634:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431696:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431705:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.431712:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395135.432010:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789395135.432023:0:7813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 586485637222ns, next at 587485633751ns, rc = 0 00010000:00010000:3.0:1789395135.432069:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432079:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432086:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432093:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432100:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432106:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432127:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395135.432147:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432153:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432159:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432165:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.432169:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432176:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432186:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:3.0:1789395135.432189:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395135.432193:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432198:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af47 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432214:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432221:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432226:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432232:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432236:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.432239:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432245:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432253:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca363b00) 00010000:00010000:3.0:1789395135.432255:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.432258:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432268:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af39 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.432283:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffe697a1 reply state 00000000a3cdbf89 transno 4294968483 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432294:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.432300:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x391d5834 (ffff89a3ca363400) 00010000:00010000:3.0:1789395135.432302:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395135.432304:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395135.432373:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18266:x1876316231740160:12345-192.168.203.54@tcp:36:rm.0 Request processed in 942us (1154us total) trans 4294968483 rc 0/0 00000100:00100000:3.0:1789395135.432381:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23512 00010000:00010000:3.0:1789395135.433510:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395135.433521:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.433531:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395135.433536:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.433769:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.433783:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:3.0:1789395135.433786:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395135.433791:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.433802:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316af4e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.433826:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.434030:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.434034:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.440306:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.440562:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231740416 00000100:00100000:2.0:1789395135.440572:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231740416 00000100:00100000:2.0:1789395135.440631:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23513 00000100:00100000:2.0:1789395135.440642:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18266:x1876316231740416:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395135.440699:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395135.440725:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316ae21 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f78 expref: 17 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.440743:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff89a4c3ab8b00) 00010000:00010000:2.0:1789395135.440753:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395135.440799:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.440807:0:10512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.440817:0:10512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.441036:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686400:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1789395135.441081:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.441111:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.441150:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686400 00000100:00100000:3.0:1789395135.441154:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686400 00000100:00100000:3.0:1789395135.441184:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:3.0:1789395135.441191:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:10512:x1876316239686400:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1789395135.441200:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.441215:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af5c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316af55 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.441236:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af5c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316af55 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.441247:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af5c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af55 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.441254:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363a00) 00010000:00010000:3.0:1789395135.441257:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.441259:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:3.0:1789395135.441299:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:10512:x1876316239686400:12345-0@lo:101:mdt00_004.0 Request processed in 109us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.441305:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1789395135.441548:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686400:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1789395135.441564:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.441575:0:10512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395135.441595:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.441616:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.441622:0:10512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.441629:0:10512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.441640:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686528:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1789395135.441665:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.441685:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.442001:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686528 00000100:00100000:3.0:1789395135.442006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686528 00000100:00100000:3.0:1789395135.442041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:3.0:1789395135.442048:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:10512:x1876316239686528:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1789395135.442056:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.442069:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316af6a lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316af63 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.442084:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316af6a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316af63 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.442095:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316af6a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af63 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.442101:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca363100) 00010000:00010000:3.0:1789395135.442104:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.442106:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:3.0:1789395135.442145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239686528:12345-0@lo:101:mdt00_004.0 Request processed in 97us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.442150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1789395135.442246:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686528:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1789395135.442257:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.442266:0:10512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395135.442277:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:2.0:1789395135.442320:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686656:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789395135.442349:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.442370:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.442616:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686656 00000100:00100000:3.0:1789395135.442620:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686656 00000100:00100000:3.0:1789395135.442693:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1789395135.442701:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239686656:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789395135.442770:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239686656:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.442777:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00100000:2.0:1789395135.442826:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686656:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789395135.442881:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686784:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789395135.442908:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.444289:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.444537:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686784 00000100:00100000:1.0:1789395135.444553:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686784 00000100:00100000:1.0:1789395135.444608:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:1.0:1789395135.444617:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239686784:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789395135.444721:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239686784:12345-0@lo:1000:mdt00_004.0 Request processed in 104us (1810us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395135.444728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:2.0:1789395135.445018:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239686784:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1789395135.445047:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.445056:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.445066:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.445073:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.445099:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395135.445104:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.445108:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.445114:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.445120:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.445138:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395135.445198:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18266:x1876316231740416:12345-192.168.203.54@tcp:36:rm.0 Request processed in 4557us (4899us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395135.445205:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23513 00010000:00010000:3.0:1789395135.445278:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789395135.445286:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.445293:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395135.445299:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.445307:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445499:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.445505:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445512:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.445516:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.445522:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445624:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445631:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789395135.445676:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239686912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395135.445718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789395135.445792:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.445797:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.445826:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445843:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316af63 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af6a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445872:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.445874:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.445876:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.445889:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239686912 00000100:00100000:1.0:1789395135.445894:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239686912 00000100:00100000:1.0:1789395135.445944:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1789395135.445952:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2f07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3638:x1876316239686912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.445963:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395135.445979:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316af6a lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316af63 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.445994:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x84832a57 (ffff89a3ca363100) 00010000:00010000:1.0:1789395135.446001:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395135.446291:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.446300:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df600/0xff35729af316af55 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af5c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.446327:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.446329:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.446331:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.446507:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2f07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239686912:12345-0@lo:103:ldlm_bl.0 Request processed in 554us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.446514:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1789395135.446578:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239687040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.446604:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.446638:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687040 00000100:00100000:1.0:1789395135.446643:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687040 00000100:00100000:1.0:1789395135.446674:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1789395135.446681:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239687040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.446688:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395135.446700:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316af5c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316af55 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.446711:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363a00) 00010000:00010000:1.0:1789395135.446717:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.446746:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239687040:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.446755:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1789395135.446790:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239687040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.450298:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.450442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231740672 00000100:00100000:3.0:1789395135.450453:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231740672 00000100:00100000:3.0:1789395135.450507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23514 00000100:00100000:3.0:1789395135.450518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18266:x1876316231740672:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.451214:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451238:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451249:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451263:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451270:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451275:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451345:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451353:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451361:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395135.451744:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789395135.451753:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 586505368027ns, next at 587505365927ns, rc = 0 00010000:00010000:3.0:1789395135.451796:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451806:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451816:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451824:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.451840:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452103:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452250:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395135.452270:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452277:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452283:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452289:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.452293:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452300:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452321:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff89a3ca363600) 00010000:00010000:3.0:1789395135.452324:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395135.452330:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452336:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316af7f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452356:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452363:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452368:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452374:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452380:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.452411:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452418:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452426:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca363b00) 00010000:00010000:3.0:1789395135.452429:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.452431:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452437:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316af71 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.452452:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd5a35bc reply state 00000000a3d2d1ed transno 4294968484 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452462:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.452467:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x84832a57 (ffff89a3ca363900) 00010000:00010000:3.0:1789395135.452469:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395135.452471:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395135.452558:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18266:x1876316231740672:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2040us (2265us total) trans 4294968484 rc 0/0 00000100:00100000:3.0:1789395135.452566:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23514 00000100:00100000:1.0:1789395135.457229:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.457308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231740928 00000100:00100000:3.0:1789395135.457328:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231740928 00000100:00100000:3.0:1789395135.457415:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23515 00000100:00100000:3.0:1789395135.457426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18266:x1876316231740928:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.457487:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.457511:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316ade2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f63 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.457529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:3.0:1789395135.457687:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395135.457735:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.457744:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.457753:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.457778:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687168:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1789395135.457825:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.457958:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.458223:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239686912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395135.462455:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395135.462470:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.462482:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395135.462487:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.462498:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.462514:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff89a3ca363600) 00010000:00010000:0.0:1789395135.462518:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395135.462522:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.462534:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316af86 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.462574:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.462576:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.462578:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.463665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687168 00000100:00100000:1.0:1789395135.463679:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687168 00000100:00100000:1.0:1789395135.464239:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:1.0:1789395135.464252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:6513:x1876316239687168:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395135.464273:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.464295:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316af94 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316af8d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.464337:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316af94 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316af8d expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.464351:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316af94 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af8d expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.464359:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4df47a300) 00010000:00010000:1.0:1789395135.464362:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.464365:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0e00, rc 0) 00000100:00100000:1.0:1789395135.464485:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239687168:12345-0@lo:101:mdt00_002.0 Request processed in 236us (6658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.464492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00000100:00100000:3.0:1789395135.464831:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687168:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395135.464852:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.464862:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395135.464883:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1789395135.464916:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.464924:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.464940:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.464969:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687296:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1789395135.465003:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.468859:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.468939:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687296 00000100:00100000:0.0:1789395135.468949:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687296 00000100:00100000:0.0:1789395135.469056:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:0.0:1789395135.469067:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239687296:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395135.469088:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395135.469114:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316afa2 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316af9b expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.469146:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316afa2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316af9b expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.469173:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316afa2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316af9b expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.469183:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a4cbc0e800) 00010000:00010000:0.0:1789395135.469186:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.469190:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aaa00, rc 0) 00000100:00100000:0.0:1789395135.469253:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239687296:12345-0@lo:101:mdt00_002.0 Request processed in 188us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.469261:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00100000:3.0:1789395135.469697:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687296:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395135.469717:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.469733:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395135.469754:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:3.0:1789395135.469836:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687424:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395135.469872:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.469890:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.469905:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687424 00000100:00100000:3.0:1789395135.469909:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687424 00000100:00100000:3.0:1789395135.469946:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352 00000100:00100000:3.0:1789395135.469953:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239687424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395135.470423:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239687424:12345-0@lo:1000:mdt00_002.0 Request processed in 470us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.470430:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352 00000100:00100000:1.0:1789395135.470773:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687424:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395135.470884:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687552:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395135.470916:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.470990:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.471072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687552 00000100:00100000:3.0:1789395135.471077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687552 00000100:00100000:3.0:1789395135.471156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:3.0:1789395135.471164:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239687552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395135.471240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239687552:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395135.471247:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:1.0:1789395135.471297:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239687552:0@lo:1000:mdt00_002.0 00000004:00080000:1.0:1789395135.471325:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1789395135.471332:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471350:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471376:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395135.471381:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1789395135.471412:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471419:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471426:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471440:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789395135.471469:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789395135.471475:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471486:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.471492:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.471500:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471522:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471528:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.471556:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471564:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d800/0xff35729af316af8d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316af94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471582:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.471586:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471592:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.471595:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.471603:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471624:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471630:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.471636:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471643:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d600/0xff35729af316af9b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471656:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.471658:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.471660:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.471670:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239687680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.471699:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.471724:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395135.471729:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239687808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.471750:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.471780:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687680 00000100:00100000:1.0:1789395135.471785:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687680 00000100:00100000:1.0:1789395135.471813:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687808 00000100:00100000:1.0:1789395135.471816:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687808 00000100:00100000:1.0:1789395135.471850:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1789395135.471857:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+23:3636:x1876316239687680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.471868:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395135.471885:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316af94 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316af8d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.471902:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a4df47a300) 00010000:00010000:1.0:1789395135.471911:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.471949:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:3636:x1876316239687680:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.471956:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1789395135.472706:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1789395135.472716:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239687808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.472727:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395135.472741:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316afa2 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316af9b expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.472753:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xbc0ca3a9 (ffff89a4cbc0e800) 00010000:00010000:1.0:1789395135.472761:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.472789:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239687808:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.472796:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1789395135.472854:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239687808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.472864:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239687680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.472921:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18266:x1876316231740928:12345-192.168.203.54@tcp:36:rm.0 Request processed in 15496us (15699us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395135.472928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23515 00010000:00010000:0.0:1789395135.476035:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.476996:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.477065:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231741184 00000100:00100000:2.0:1789395135.477074:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231741184 00000100:00100000:2.0:1789395135.477143:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23516 00000100:00100000:2.0:1789395135.477153:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18266:x1876316231741184:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395135.477226:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477242:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477252:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477264:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477270:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477276:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477341:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477347:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.477358:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395135.477905:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00010000:00010000:3.0:1789395135.477964:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.477975:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.477983:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.477990:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.477996:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478002:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478021:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395135.478040:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478046:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478051:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478056:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.478059:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478066:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478076:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:3.0:1789395135.478078:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395135.478084:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478090:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316afb7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478109:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478115:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478121:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478126:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478131:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.478134:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478139:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478147:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca35f900) 00010000:00010000:3.0:1789395135.478149:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.478153:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478158:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316afa9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.478172:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ae97ab2 reply state 000000007e275ff4 transno 4294968485 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478182:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.478187:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xbc0ca3a9 (ffff89a3ca35f200) 00010000:00010000:3.0:1789395135.478189:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395135.478192:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395135.478269:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18266:x1876316231741184:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1115us (1276us total) trans 4294968485 rc 0/0 00000100:00100000:3.0:1789395135.478276:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23516 00010000:00010000:0.0:1789395135.478925:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395135.478941:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.478948:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395135.478952:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.478960:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.478969:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:0.0:1789395135.478972:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395135.478975:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.478981:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afbe lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.479001:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.479003:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.479005:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.486355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.486554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231741440 00000100:00100000:3.0:1789395135.486563:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231741440 00000100:00100000:3.0:1789395135.486612:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23517 00000100:00100000:3.0:1789395135.486622:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18266:x1876316231741440:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.486683:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.486707:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1600/0xff35729af316aef3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fd3 expref: 19 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.486725:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff89a4c3ab8000) 00010000:00010000:3.0:1789395135.486735:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395135.486782:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.486790:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.486799:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.486824:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239687936:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395135.486891:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.487298:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d3dfb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.490175:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239687936 00000100:00100000:2.0:1789395135.490189:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239687936 00000100:00100000:2.0:1789395135.490297:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:2.0:1789395135.490314:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6512:x1876316239687936:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395135.490333:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.490357:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316afcc lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316afc5 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.490415:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316afcc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316afc5 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.490430:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316afcc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316afc5 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.490439:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:2.0:1789395135.490442:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.490445:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dee00, rc 0) 00000100:00100000:2.0:1789395135.490512:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6512:x1876316239687936:12345-0@lo:101:mdt00_001.0 Request processed in 207us (3621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.490519:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:3.0:1789395135.490604:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239687936:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.490628:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.490640:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395135.490662:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1789395135.490694:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.490702:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.490711:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.490728:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239688064:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395135.490763:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.491343:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4d3dfb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.491619:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688064 00000100:00100000:0.0:1789395135.491627:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688064 00000100:00100000:0.0:1789395135.491676:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:0.0:1789395135.491684:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:6512:x1876316239688064:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395135.491695:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395135.491711:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316afda lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316afd3 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.491731:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316afda lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316afd3 expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.491744:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316afda lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316afd3 expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.491751:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a4cbc0e600) 00010000:00010000:0.0:1789395135.491754:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.491757:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2abe00, rc 0) 00000100:00100000:0.0:1789395135.491794:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239688064:12345-0@lo:101:mdt00_001.0 Request processed in 111us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.491800:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000100:00100000:3.0:1789395135.491993:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239688064:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.492010:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492026:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395135.492044:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:3.0:1789395135.492084:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239688192:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.492117:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.492137:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.492152:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688192 00000100:00100000:3.0:1789395135.492155:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688192 00000100:00100000:3.0:1789395135.492182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:3.0:1789395135.492188:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239688192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.492249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239688192:12345-0@lo:1000:mdt00_001.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.492255:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:3.0:1789395135.492280:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239688192:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.492328:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239688320:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.492350:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.492364:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.492375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688320 00000100:00100000:3.0:1789395135.492377:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688320 00000100:00100000:3.0:1789395135.492427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:3.0:1789395135.492433:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239688320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395135.492495:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239688320:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (144us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395135.492501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357 00000100:00100000:3.0:1789395135.492524:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239688320:0@lo:1000:mdt00_001.0 00000004:00080000:3.0:1789395135.492539:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1789395135.492556:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492563:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492570:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492587:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395135.492591:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1789395135.492598:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395135.492604:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492610:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395135.492616:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.492623:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492646:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492653:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395135.492677:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492685:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10dc00/0xff35729af316afc5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afcc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.492703:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.492705:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.492706:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.492714:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395135.492723:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239688448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.492751:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.492785:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688448 00000100:00100000:3.0:1789395135.492789:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688448 00000100:00100000:3.0:1789395135.492818:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1789395135.492825:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239688448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.493096:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.493114:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316afcc lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316afc5 expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493128:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:3.0:1789395135.493138:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.493167:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239688448:12345-0@lo:103:ldlm_bl.0 Request processed in 343us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.493173:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1789395135.493200:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239688448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.493213:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493224:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493231:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493245:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395135.493272:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395135.493276:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493283:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395135.493287:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.493295:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493311:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493317:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395135.493327:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493334:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c600/0xff35729af316afd3 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316afda expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493350:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.493352:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.493353:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.493362:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239688576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.493466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.493501:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688576 00000100:00100000:3.0:1789395135.493506:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688576 00000100:00100000:3.0:1789395135.493534:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1789395135.493607:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239688576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.493618:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.493629:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316afda lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316afd3 expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.493639:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xb62e0cbf (ffff89a4cbc0e600) 00010000:00010000:3.0:1789395135.493646:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.493676:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239688576:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.493683:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1789395135.493711:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239688576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395135.493761:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18266:x1876316231741440:12345-192.168.203.54@tcp:36:rm.0 Request processed in 7139us (7414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395135.493769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23517 00000100:00100000:2.0:1789395135.498765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.499099:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231741696 00000100:00100000:3.0:1789395135.499109:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231741696 00000100:00100000:3.0:1789395135.499170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23518 00000100:00100000:3.0:1789395135.499181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18266:x1876316231741696:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.499261:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499277:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499289:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499300:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499306:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499311:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499380:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 3/0,1 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499872:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.499881:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395135.500173:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00010000:00010000:3.0:1789395135.500219:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500228:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500237:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500244:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500250:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500257:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500495:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395135.500515:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500522:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500529:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500535:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.500539:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500709:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500720:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff89a3ca363a00) 00010000:00010000:3.0:1789395135.500723:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395135.500728:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 2/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500735:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316afef lrc: 0/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500753:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500759:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500764:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500770:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500775:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.500777:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500782:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500790:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca363d00) 00010000:00010000:3.0:1789395135.500792:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.500794:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500799:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316afe1 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.500813:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049fce920 reply state 000000007b5e8f84 transno 4294968486 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500822:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.500839:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xb62e0cbf (ffff89a3ca363600) 00010000:00010000:3.0:1789395135.500842:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395135.500845:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395135.501187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18266:x1876316231741696:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2004us (2427us total) trans 4294968486 rc 0/0 00000100:00100000:3.0:1789395135.501195:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23518 00010000:00010000:0.0:1789395135.502089:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395135.502098:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.502105:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395135.502109:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.502117:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.502129:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff89a3ca363a00) 00010000:00010000:0.0:1789395135.502131:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395135.502135:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.502140:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d800/0xff35729af316aff6 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.502156:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.502159:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.502160:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.510675:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395135.510822:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231741952 00000100:00100000:2.0:1789395135.510841:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231741952 00000100:00100000:2.0:1789395135.510900:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23519 00000100:00100000:2.0:1789395135.510910:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18266:x1876316231741952:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395135.510977:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395135.511004:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316ad8e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f16 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.511023:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:2.0:1789395135.511035:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395135.511082:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.511091:0:10512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.511101:0:10512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.511121:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239688704:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1789395135.511167:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.511214:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.511259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688704 00000100:00100000:3.0:1789395135.511264:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688704 00000100:00100000:3.0:1789395135.511689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:3.0:1789395135.511699:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:10512:x1876316239688704:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1789395135.511710:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395135.511726:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316b004 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316affd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.511748:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316b004 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316affd expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.511760:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316b004 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316affd expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.511767:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:3.0:1789395135.511770:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.511772:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:3.0:1789395135.511809:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:10512:x1876316239688704:12345-0@lo:101:mdt00_004.0 Request processed in 113us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.511815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:2.0:1789395135.511942:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239688704:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1789395135.511960:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.511969:0:10512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395135.511987:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.512007:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.512018:0:10512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.512025:0:10512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.512038:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239688832:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1789395135.512060:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.512127:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.512191:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688832 00000100:00100000:0.0:1789395135.512197:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688832 00000100:00100000:0.0:1789395135.512232:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:0.0:1789395135.512239:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:10512:x1876316239688832:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1789395135.512248:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395135.512262:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b012 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b00b expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.512277:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b012 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b00b expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.512298:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b012 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b00b expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.512305:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a4cbc0ea00) 00010000:00010000:0.0:1789395135.512307:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.512310:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa400, rc 0) 00000100:00100000:0.0:1789395135.515589:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239688832:12345-0@lo:101:mdt00_004.0 Request processed in 3340us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.515602:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000100:00100000:3.0:1789395135.515749:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239688832:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1789395135.515775:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.515848:0:10512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395135.515870:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:3.0:1789395135.515921:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239688960:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789395135.516076:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.516118:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.516185:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239688960 00000100:00100000:1.0:1789395135.516192:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239688960 00000100:00100000:1.0:1789395135.516238:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:1.0:1789395135.516247:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239688960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789395135.516467:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239688960:12345-0@lo:1000:mdt00_004.0 Request processed in 221us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.516474:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:1.0:1789395135.516505:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239688960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789395135.516756:0:10512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239689088:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789395135.516787:0:10512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.516843:0:10512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.516856:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689088 00000100:00100000:1.0:1789395135.516861:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689088 00000100:00100000:0.0:1789395135.516930:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:0.0:1789395135.516946:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239689088:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789395135.517035:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:10512:x1876316239689088:12345-0@lo:1000:mdt00_004.0 Request processed in 89us (247us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395135.517042:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:3.0:1789395135.517100:0:10512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10512:1876316239689088:0@lo:1000:mdt00_004.0 00000004:00080000:3.0:1789395135.517122:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1789395135.517129:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.517138:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.517146:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.517201:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395135.517206:0:10512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1789395135.517211:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.517219:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.517224:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517255:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395135.517261:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517269:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395135.517275:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395135.517512:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517657:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517665:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395135.517691:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517699:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316affd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b004 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517722:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395135.517725:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517731:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395135.517735:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 5/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395135.517742:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 5/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517760:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 4/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517766:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395135.517771:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.517778:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.517781:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.517782:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395135.517795:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239689344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395135.517827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.517857:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395135.517863:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239689216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395135.517886:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.517914:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689344 00000100:00100000:0.0:1789395135.517919:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689344 00000100:00100000:0.0:1789395135.517961:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689216 00000100:00100000:0.0:1789395135.517964:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689216 00000100:00100000:0.0:1789395135.517986:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1789395135.517992:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3637:x1876316239689344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395135.518003:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395135.518020:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b012 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b00b expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.518033:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0xdcc87686 (ffff89a4cbc0ea00) 00010000:00010000:0.0:1789395135.518044:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395135.518072:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239689344:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.518077:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1789395135.518090:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1789395135.518096:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2f07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239689216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395135.518102:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395135.518111:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316b004 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316affd expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.518121:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:0.0:1789395135.518127:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395135.518147:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2f07050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239689216:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.518153:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1789395135.518209:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239689216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395135.518216:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239689344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.518720:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789395135.518728:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3df400/0xff35729af316b00b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b012 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.518815:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18266:x1876316231741952:12345-192.168.203.54@tcp:36:rm.0 Request processed in 7904us (8147us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395135.518822:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23519 00010000:00010000:0.0:1789395135.519179:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395135.523102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.523182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231742208 00000100:00100000:3.0:1789395135.523191:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231742208 00000100:00100000:3.0:1789395135.523244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23520 00000100:00100000:3.0:1789395135.523254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18266:x1876316231742208:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395135.523909:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.523929:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.523952:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.523966:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.523977:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.523984:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524044:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524052:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524059:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395135.524376:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00010000:00010000:0.0:1789395135.524780:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524792:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524800:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524807:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524814:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524819:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524836:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395135.524854:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524860:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524865:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524871:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.524875:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524882:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524892:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff89a4cbc0e100) 00010000:00010000:0.0:1789395135.524895:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395135.524900:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524906:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b027 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524922:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524928:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524952:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524958:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524963:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.524966:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524971:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524978:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a4cbc0e700) 00010000:00010000:0.0:1789395135.524980:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.524982:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.524988:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b019 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395135.525003:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fe56c1f reply state 00000000a1fcf28a transno 4294968487 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.525013:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.525018:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xdcc87686 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395135.525020:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395135.525023:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395135.525145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18266:x1876316231742208:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1888us (2047us total) trans 4294968487 rc 0/0 00000100:00100000:0.0:1789395135.525153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23520 00010000:00010000:3.0:1789395135.525228:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395135.525234:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.525240:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395135.525244:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.525250:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.525260:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff89a4cbc0e100) 00010000:00010000:3.0:1789395135.525262:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395135.525265:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 1/0,0 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.525271:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b02e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.525295:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.525297:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395135.525299:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395135.532157:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.532235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231742464 00000100:00100000:3.0:1789395135.532244:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231742464 00000100:00100000:3.0:1789395135.532644:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23521 00000100:00100000:3.0:1789395135.532655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18266:x1876316231742464:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.532708:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.532733:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316aeb4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fbe expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.532751:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:3.0:1789395135.532763:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395135.532810:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.532819:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.532829:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.532864:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689472:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1789395135.532908:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.532964:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.533012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689472 00000100:00100000:2.0:1789395135.533016:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689472 00000100:00100000:2.0:1789395135.533049:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:2.0:1789395135.533056:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:6513:x1876316239689472:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395135.533065:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.533079:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b03c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533101:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b03c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b035 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533112:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b03c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b035 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533120:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:2.0:1789395135.533123:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395135.533126:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395135.533161:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239689472:12345-0@lo:101:mdt00_002.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.533167:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00000100:00100000:2.0:1789395135.533199:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689472:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395135.533213:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533223:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395135.533240:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.533257:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533263:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533270:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.533280:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689600:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1789395135.533319:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.533333:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.533374:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689600 00000100:00100000:1.0:1789395135.533378:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689600 00000100:00100000:1.0:1789395135.533432:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:1.0:1789395135.533438:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239689600:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395135.533445:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.533456:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b04a lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b043 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.533471:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b04a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b043 expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.533480:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b04a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b043 expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.533487:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a4df47a300) 00010000:00010000:1.0:1789395135.533490:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.533492:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:1.0:1789395135.533516:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239689600:12345-0@lo:101:mdt00_002.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.533522:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00000100:00100000:2.0:1789395135.533675:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689600:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395135.533685:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.533694:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395135.533706:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:2.0:1789395135.533735:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689728:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395135.533760:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.533786:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395135.533978:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689728 00000100:00100000:3.0:1789395135.533983:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689728 00000100:00100000:3.0:1789395135.534008:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1789395135.534015:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239689728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395135.534070:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239689728:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.534077:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:2.0:1789395135.534140:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689728:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395135.534176:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689856:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395135.534198:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.534219:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.534269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689856 00000100:00100000:1.0:1789395135.534273:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689856 00000100:00100000:2.0:1789395135.534577:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:2.0:1789395135.534585:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239689856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395135.534658:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239689856:12345-0@lo:1000:mdt00_002.0 Request processed in 74us (459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395135.534665:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00000100:00100000:2.0:1789395135.534693:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239689856:0@lo:1000:mdt00_002.0 00000004:00080000:2.0:1789395135.534710:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.534716:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.534724:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.534731:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.534753:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395135.534759:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1789395135.534763:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.534769:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.534775:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.534785:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395135.534841:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18266:x1876316231742464:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2188us (2690us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395135.534848:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23521 00010000:00010000:1.0:1789395135.535590:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789395135.535600:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535609:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.535615:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.535622:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535653:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535660:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.535680:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535687:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d400/0xff35729af316b035 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b03c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535704:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.535708:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535715:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.535719:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.535726:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535743:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535749:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.535755:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535762:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b043 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b04a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.535774:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.535775:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.535777:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.535791:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239690112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.535828:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.535863:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395135.535869:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239689984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.535890:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.535914:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239690112 00000100:00100000:1.0:1789395135.535919:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239690112 00000100:00100000:1.0:1789395135.535964:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239689984 00000100:00100000:1.0:1789395135.535967:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239689984 00000100:00100000:1.0:1789395135.535988:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1789395135.535995:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+23:3639:x1876316239690112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.536006:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395135.536022:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b04a lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b043 expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.536034:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x18618557 (ffff89a4df47a300) 00010000:00010000:1.0:1789395135.536042:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.536070:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239690112:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.536076:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1789395135.536089:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1789395135.536095:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239689984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395135.536102:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395135.536112:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b03c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b035 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.536121:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:1.0:1789395135.536127:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395135.536145:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239689984:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.536150:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1789395135.536186:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239689984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.536195:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239690112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.539642:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:2.0:1789395135.539795:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395135.539854:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231742720 00000100:00100000:3.0:1789395135.539865:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231742720 00000100:00100000:3.0:1789395135.539923:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23522 00000100:00100000:3.0:1789395135.539942:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18266:x1876316231742720:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395135.540020:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540035:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540045:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540055:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540061:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540070:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540124:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540130:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540137:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395135.540372:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00010000:00010000:3.0:1789395135.540684:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540695:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540702:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540709:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540715:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540720:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540741:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395135.540759:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540764:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540770:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540775:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.540779:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540786:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540797:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:3.0:1789395135.540800:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395135.540804:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540812:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b05f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540831:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540837:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540842:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540851:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540856:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395135.540858:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540864:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540870:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:3.0:1789395135.540873:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395135.540875:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540880:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b051 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395135.540893:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089185837 reply state 0000000084e20f70 transno 4294968488 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540902:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.540908:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x18618557 (ffff89a3ca363b00) 00010000:00010000:3.0:1789395135.540910:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395135.540912:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395135.541021:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18266:x1876316231742720:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1089us (1386us total) trans 4294968488 rc 0/0 00000100:00100000:3.0:1789395135.541030:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23522 00010000:00010000:1.0:1789395135.541170:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.541177:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.541182:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395135.541185:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.541191:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.541200:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff89a3ca363e00) 00010000:00010000:1.0:1789395135.541202:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395135.541205:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.541209:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316b066 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.541222:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.541224:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.541225:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395135.548305:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395135.548443:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231742848 00000100:00100000:0.0:1789395135.548455:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231742848 00000100:00100000:0.0:1789395135.548521:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1357 00000100:00100000:0.0:1789395135.548532:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231742848:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:0.0:1789395135.548558:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395135.548583:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316a9c8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e6e expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.548601:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca366f00) 00010000:00010000:0.0:1789395135.548612:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395135.548665:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231742848:12345-192.168.203.54@tcp:103:rm.0 Request processed in 135us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.548672:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1357 00000100:00100000:2.0:1789395135.551640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395135.551786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231743104 00000100:00100000:1.0:1789395135.551796:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231743104 00000100:00100000:1.0:1789395135.551854:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5074 00000100:00100000:1.0:1789395135.551864:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18266:x1876316231743104:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:1.0:1789395135.552102:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18266:x1876316231743104:12345-192.168.203.54@tcp:35:rm.0 Request processed in 238us (469us total) trans 4294968489 rc 0/0 00000100:00100000:1.0:1789395135.552110:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5074 00000100:00100000:1.0:1789395135.561112:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395135.561340:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231743360 00000100:00100000:0.0:1789395135.561351:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231743360 00000100:00100000:0.0:1789395135.561438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23523 00000100:00100000:0.0:1789395135.561450:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18266:x1876316231743360:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395135.561511:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395135.561550:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0c00/0xff35729af316acd8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ede expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.561574:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316acae lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105ec9 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.561584:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:0.0:1789395135.561603:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395135.561656:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.561665:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.561673:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395135.561693:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690240:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1789395135.561753:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.561813:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.562019:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239690240 00000100:00100000:2.0:1789395135.562024:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239690240 00000100:00100000:2.0:1789395135.562063:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:2.0:1789395135.562070:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6512:x1876316239690240:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395135.562079:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.562095:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b06d expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.562118:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 9 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.562132:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.562155:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 9 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.562168:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 9 pid: 7813 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.562178:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239690368:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395135.562322:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.571437:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395135.571567:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231743488 00000100:00100000:3.0:1789395135.571577:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231743488 00010000:00010000:3.0:1789395135.571616:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 10 pid: 7813 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.571660:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1571 00000100:00100000:3.0:1789395135.571671:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231743488:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.571686:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.571693:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 10 pid: 7813 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.571706:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 10 pid: 7813 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.571731:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395135.571737:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.571749:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.571759:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.571793:0:16674:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.571808:0:16674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239690496:0@lo:105: 00000100:00100000:3.0:1789395135.571876:0:16674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.571916:0:16674:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.571972:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239690496 00000100:00100000:0.0:1789395135.571978:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239690496 00000100:00100000:0.0:1789395135.572012:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1789395135.572020:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:16674:x1876316239690496:12345-0@lo:105: 00010000:00010000:0.0:1789395135.572032:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.572041:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.572049:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.572055:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.572062:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.572075:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.572090:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2ab400) 00000100:00100000:0.0:1789395135.572134:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:16674:x1876316239690496:12345-0@lo:105: Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.572141:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00010000:00010000:1.0:1789395135.572198:0:11908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316a9ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105e67 expref: 10 pid: 7813 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.572215:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239690368:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395135.572223:0:16674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:16674:1876316239690496:0@lo:105: 00010000:00010000:3.0:1789395135.572231:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395135.572238:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.572245:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395135.572248:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.572250:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:3.0:1789395135.572270:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231743488:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 602us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.572277:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1571 00000100:00100000:1.0:1789395135.572444:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6512:x1876316239690240:12345-0@lo:101:mdt00_001.0 Request processed in 10373us (10689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.572453:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:2.0:1789395135.574041:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690240:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395135.574068:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395135.574094:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789395135.574136:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.574144:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.574153:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395135.574170:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690624:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1789395135.574261:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395135.574409:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.574514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239690624 00000100:00100000:1.0:1789395135.574521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239690624 00000100:00100000:1.0:1789395135.574609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:1.0:1789395135.574619:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:6512:x1876316239690624:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395135.574635:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395135.574652:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b082 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.574678:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b082 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b07b expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.574693:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b082 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b07b expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.574702:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4df47a300) 00010000:00010000:1.0:1789395135.574706:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395135.574709:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:1.0:1789395135.574755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239690624:12345-0@lo:101:mdt00_001.0 Request processed in 137us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395135.574763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:0.0:1789395135.574838:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690624:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1789395135.574858:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.574866:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395135.574880:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1789395135.574914:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690752:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395135.574952:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.575191:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.575225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239690752 00000100:00100000:2.0:1789395135.575230:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239690752 00000100:00100000:2.0:1789395135.575265:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:2.0:1789395135.575272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239690752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395135.575355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239690752:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.575362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1789395135.575590:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690752:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395135.575633:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690880:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789395135.575658:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.575711:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395135.575724:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239690880 00000100:00100000:0.0:1789395135.575728:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239690880 00000100:00100000:2.0:1789395135.575770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:2.0:1789395135.575777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239690880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395135.575944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239690880:12345-0@lo:1000:mdt00_001.0 Request processed in 167us (284us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395135.575951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1789395135.576014:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239690880:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789395135.576062:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.576071:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.576080:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.576092:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239691008:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1789395135.576116:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.576137:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.576619:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691008 00000100:00100000:2.0:1789395135.576624:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691008 00000100:00100000:2.0:1789395135.576661:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:2.0:1789395135.576668:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239691008:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395135.576679:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.576695:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b090 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.576718:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b090 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b089 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.576731:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b090 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b089 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.576744:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395135.576747:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395135.576750:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dee00, rc 0) 00000100:00100000:2.0:1789395135.576796:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:6512:x1876316239691008:12345-0@lo:101:mdt00_001.0 Request processed in 128us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.576802:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:3.0:1789395135.576877:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239691008:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.576892:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576903:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576928:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576945:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576953:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576973:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576980:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.576986:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.577009:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.577016:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.577024:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395135.577038:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239691136:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395135.577065:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.577183:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.577218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691136 00000100:00100000:2.0:1789395135.577222:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691136 00000100:00100000:2.0:1789395135.577253:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:2.0:1789395135.577260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:6512:x1876316239691136:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395135.577268:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395135.577281:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b0ac lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b0a5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.577295:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b0ac lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b0a5 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.577305:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b0ac lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b0a5 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395135.577312:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395135.577315:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395135.577317:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395135.577473:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6512:x1876316239691136:12345-0@lo:101:mdt00_001.0 Request processed in 213us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.577480:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:3.0:1789395135.577548:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239691136:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395135.577559:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.577568:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395135.579212:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239691264:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1789395135.579268:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395135.579425:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395135.579487:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691264 00000100:00100000:2.0:1789395135.579493:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691264 00000100:00100000:2.0:1789395135.579576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:2.0:1789395135.579585:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6512:x1876316239691264:12345-0@lo:403:mdt00_001.0 00000100:00100000:2.0:1789395135.582686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6512:x1876316239691264:12345-0@lo:403:mdt00_001.0 Request processed in 3091us (3406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395135.582701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00000100:00100000:1.0:1789395135.582795:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239691264:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1789395135.584929:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].390, 960 off583600 00000040:00080000:1.0:1789395135.585139:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].390, 1040 off637688 00000004:00080000:1.0:1789395135.585147:0:6512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c80b3c00 with version 744 00000004:00080000:3.0:1789395135.586808:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 744 rpc_version 744 00000020:00100000:3.0:1789395135.586942:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395135.586955:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c93e4a80 x1876316239691520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2624/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395135.586982:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239691520:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395135.587062:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.587141:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395135.587240:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691520 00000100:00100000:1.0:1789395135.587248:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691520 00000100:00100000:1.0:1789395135.587517:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:1.0:1789395135.587529:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239691520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395135.588002:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239691520:12345-0@lo:1000:osp_up0-1.0 Request processed in 475us (938us total) trans 4294983533 rc 0/0 00000100:00100000:1.0:1789395135.588009:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00000100:00100000:3.0:1789395135.588123:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239691520:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1789395135.588497:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:0.0:1789395135.588523:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588535:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588545:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588551:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.588556:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588563:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588578:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:0.0:1789395135.588581:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395135.588585:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588592:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b09e lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588610:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588618:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588625:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588653:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395135.588662:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:0.0:1789395135.588669:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588676:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588682:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588687:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395135.588690:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588696:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588711:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca363200) 00010000:00010000:0.0:1789395135.588714:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395135.588718:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588724:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316b097 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588737:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588744:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588751:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588768:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1789395135.588777:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789395135.588786:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395135.588791:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588799:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395135.588803:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395135.588810:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588847:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588854:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395135.588875:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 1/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588882:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10c000/0xff35729af316b0a5 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b0ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588895:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395135.588899:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588905:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395135.588909:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395135.588916:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588940:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588946:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395135.588952:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588959:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0c00/0xff35729af316b089 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b090 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.588976:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.588977:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395135.588979:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395135.588996:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239691648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.589017:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395135.589046:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395135.589083:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395135.589089:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239691776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395135.589113:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.589122:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691648 00000100:00100000:3.0:1789395135.589128:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691648 00000100:00100000:0.0:1789395135.589141:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691776 00000100:00100000:0.0:1789395135.589144:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691776 00000100:00100000:3.0:1789395135.589165:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1789395135.589171:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+26:3636:x1876316239691648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.589183:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.589199:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b0ac lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b0a5 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.589211:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395135.589218:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.589249:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+25:3636:x1876316239691648:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.589726:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1789395135.589736:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+25:3636:x1876316239691776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395135.589747:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395135.589760:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b090 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b089 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.589772:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395135.589778:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395135.589806:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+24:3636:x1876316239691776:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395135.589812:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1789395135.589850:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239691776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395135.589860:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239691648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395135.589887:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.589896:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.589904:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.589927:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395135.589941:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789395135.589946:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395135.589958:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395135.590093:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18266:x1876316231743360:12345-192.168.203.54@tcp:36:rm.0 Request processed in 28643us (28986us total) trans 4294968490 rc 0/0 00000100:00100000:0.0:1789395135.590101:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23523 00010000:00010000:1.0:1789395135.590152:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395135.590159:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.590167:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395135.590171:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395135.590179:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.590206:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.590212:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395135.590238:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.590245:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab400/0xff35729af316b06d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b074 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395135.590256:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.590257:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395135.590259:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395135.590265:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395135.590275:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239691904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395135.590320:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395135.591903:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1789395135.591938:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239691904 00000100:00100000:3.0:1789395135.591946:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239691904 00000100:00100000:3.0:1789395135.592043:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1789395135.592053:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2f05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3639:x1876316239691904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395135.592067:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395135.592089:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b074 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b06d expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395135.592106:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395135.592111:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395135.592163:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2f05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239691904:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395135.592169:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1789395135.592215:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239691904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395136.241596:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395136.377153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.377235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231743616 00000100:00100000:3.0:1789395136.377246:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231743616 00000100:00100000:3.0:1789395136.377306:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23524 00000100:00100000:3.0:1789395136.377317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18277:x1876316231743616:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395136.377336:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.377359:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b0b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106019 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.377468:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316b0ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.377483:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.377495:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395136.377539:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395136.377542:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395136.377561:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.377585:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b0b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106019 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.377601:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316b0ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106019 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.377609:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395136.377613:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395136.377616:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c200, rc 0) 00000100:00100000:3.0:1789395136.377666:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18277:x1876316231743616:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 352us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.377674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23524 00000100:00100000:2.0:1789395136.392316:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395136.392421:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.392577:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231743744 00000100:00100000:3.0:1789395136.392596:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231743744 00000100:00100000:3.0:1789395136.392648:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23525 00000100:00100000:3.0:1789395136.392656:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18277:x1876316231743744:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395136.392675:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.392695:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b0c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106020 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392753:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392768:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392780:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.392794:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231743872 00010000:00010000:3.0:1789395136.392795:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.392802:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231743872 00010000:00010000:3.0:1789395136.392805:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392814:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.392840:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3374 00000100:00100000:1.0:1789395136.392848:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231743872:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:3.0:1789395136.392865:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392871:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.392875:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392883:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106027 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392884:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392903:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392910:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395136.392914:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.392922:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392934:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392953:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392966:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392979:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392985:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.392991:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394011:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395136.394018:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395136.394025:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394035:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b0c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394052:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394059:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394065:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394072:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395136.394075:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394082:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394094:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395136.394097:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395136.394100:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394106:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b0cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394145:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b0c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106020 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394158:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395136.394160:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395136.394164:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b0c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106020 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.394184:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:3.0:1789395136.394262:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18277:x1876316231743744:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 1605us (1953us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395136.394270:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23525 00010000:00010000:1.0:1789395136.400084:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400105:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400113:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400120:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.400125:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400134:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400152:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.400156:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.400162:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400168:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400185:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400191:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400196:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400201:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.400204:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400210:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400216:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x861f4748 (ffff89a4df47aa00) 00010000:00010000:1.0:1789395136.400219:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.400222:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400227:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400269:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106027 expref: 11 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400279:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.400281:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395136.400285:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106027 expref: 11 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.400293:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc -2) 00000100:00100000:1.0:1789395136.400400:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231743872:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 7534us (7959us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395136.400411:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3374 00000100:00100000:2.0:1789395136.411275:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.411365:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231744128 00000100:00100000:1.0:1789395136.411375:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231744128 00000100:00100000:1.0:1789395136.411443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23526 00000100:00100000:1.0:1789395136.411454:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18277:x1876316231744128:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395136.411510:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395136.411536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316b0ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106019 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.411553:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.411559:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395136.411632:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.411646:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.411657:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.411672:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.411679:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.411685:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:02000000:1.0:1789395136.411816:0:6512:0:(lod_object.c:2112:lod_mdt_alloc_specific()) *** cfs_fail_loc=189, val=0*** 00010000:00010000:1.0:1789395136.423616:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423645:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423663:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423683:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423690:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423697:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395136.423705:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb2bb7ce reply state 000000001ed469e2 transno 4294983534 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423716:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423723:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:1.0:1789395136.423726:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395136.423729:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1789395136.423736:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb2bb7ce reply state 000000001ed469e2 transno 4294983534 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423744:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423750:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:1.0:1789395136.423753:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395136.423754:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1789395136.423759:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:1.0:1789395136.423769:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423776:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423783:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423790:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423796:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.423801:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423808:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423819:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.423821:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.423825:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423832:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b0eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395136.423845:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb2bb7ce reply state 000000001ed469e2 transno 4294983534 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423853:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.423860:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4df47aa00) 00010000:00010000:1.0:1789395136.423862:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395136.423864:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1789395136.423957:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18277:x1876316231744128:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 12501us (12688us total) trans 4294983534 rc 0/0 00000100:00100000:1.0:1789395136.423966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23526 00000100:00100000:1.0:1789395136.435183:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.435442:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231744256 00000100:00100000:3.0:1789395136.435457:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231744256 00000100:00100000:3.0:1789395136.435521:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23527 00000100:00100000:3.0:1789395136.435532:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18090:x1876316231744256:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.435558:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.435579:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b107 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210602e expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.435650:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b10e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.435671:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b10e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.435682:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b10e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395136.435729:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395136.435733:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395136.435753:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b10e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.435784:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210602e expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.435801:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b10e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210602e expref: 12 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.435810:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395136.435814:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395136.435817:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10dc00, rc 0) 00000100:00100000:3.0:1789395136.436012:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18090:x1876316231744256:12345-192.168.203.54@tcp:101:bash.0 Request processed in 481us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.436019:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23527 00000100:00100000:3.0:1789395136.438861:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.438945:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231744384 00000100:00100000:1.0:1789395136.438955:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231744384 00000100:00100000:1.0:1789395136.439014:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23528 00000100:00100000:1.0:1789395136.439025:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18090:x1876316231744384:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395136.439044:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.439063:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106035 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439120:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439134:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439146:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439158:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439165:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439171:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439329:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b12a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439338:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439346:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395136.439453:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00000004:00200000:1.0:1789395136.439458:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1789395136.439479:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439492:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439606:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439614:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439621:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439626:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.439630:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439637:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439648:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.439652:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.439656:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439663:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439673:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439678:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439683:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439688:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.439691:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439760:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439768:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4df47aa00) 00010000:00010000:1.0:1789395136.439771:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.439774:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439779:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439802:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316b115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106035 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439820:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b12a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106035 expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.439827:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:1.0:1789395136.439830:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789395136.439833:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0200, rc 0) 00000100:00100000:1.0:1789395136.439923:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231744384:12345-192.168.203.54@tcp:101:bash.0 Request processed in 899us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.439939:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23528 00000100:00100000:0.0:1789395136.451828:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.451892:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231744512 00000100:00100000:3.0:1789395136.451908:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231744512 00000100:00100000:3.0:1789395136.451979:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23529 00000100:00100000:3.0:1789395136.451989:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231744512:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.452009:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.452028:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b131 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210603c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.452083:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b138 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.452097:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b138 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.452109:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b138 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395136.452153:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcd:0x0]: returning size 4096 00000004:00200000:3.0:1789395136.452158:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1789395136.452190:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b131 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210603c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.452217:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b138 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210603c expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.452231:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:3.0:1789395136.452234:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395136.452238:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:3.0:1789395136.452292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18090:x1876316231744512:12345-192.168.203.54@tcp:101:bash.0 Request processed in 304us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.452300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23529 00000100:00100000:3.0:1789395136.456156:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.456288:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231744768 00000100:00100000:0.0:1789395136.456297:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231744768 00000100:00100000:0.0:1789395136.456357:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23530 00000100:00100000:0.0:1789395136.456368:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18090:x1876316231744768:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395136.456404:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395136.456408:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789395136.456436:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316b138 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210603c expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456453:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:0.0:1789395136.456457:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395136.456470:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b13f lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106043 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456585:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456598:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456608:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456622:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456629:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.456636:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395136.458183:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cb:0x0], index 1: 0 00010000:00010000:0.0:1789395136.459261:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459278:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459289:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459325:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459333:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459340:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459347:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459354:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395136.459358:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459366:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459462:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:0.0:1789395136.459466:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395136.459472:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459479:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b146 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395136.459491:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000271e9959 reply state 000000005cf0981b transno 4294983535 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459502:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459510:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a4cbc0ea00) 00010000:00010000:0.0:1789395136.459513:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395136.459516:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395136.459554:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b13f lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106043 expref: 16 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459570:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106043 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.459582:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395136.459585:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395136.459588:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab400, rc 0) 00000100:00100000:0.0:1789395136.459660:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231744768:12345-192.168.203.54@tcp:101:bash.0 Request processed in 3293us (3513us total) trans 4294983535 rc 0/0 00000100:00100000:0.0:1789395136.459668:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23530 00000100:00100000:3.0:1789395136.471362:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.471524:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231744896 00000100:00100000:1.0:1789395136.471535:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231744896 00000100:00100000:1.0:1789395136.471581:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5209 00000100:00100000:1.0:1789395136.471591:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18090:x1876316231744896:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395136.471609:0:14652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.471630:0:14652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210604a expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395136.471656:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395136.471677:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1789395136.471682:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395136.471692:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 16 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.471724:0:14652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 16 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.471743:0:14652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395136.471801:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231744896:12345-192.168.203.54@tcp:101:bash.0 Request processed in 211us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.471808:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5209 00000100:00100000:0.0:1789395136.480145:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395136.481724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231745152 00000100:00100000:2.0:1789395136.481736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231745152 00000100:00100000:2.0:1789395136.481842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5075 00000100:00100000:2.0:1789395136.481855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231745152:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:2.0:1789395136.482168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231745152:12345-192.168.203.54@tcp:35:bash.0 Request processed in 315us (2032us total) trans 4294983536 rc 0/0 00000100:00100000:2.0:1789395136.482178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5075 00000100:00100000:0.0:1789395136.501374:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.502091:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231745408 00000100:00100000:3.0:1789395136.502101:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231745408 00000100:00100000:3.0:1789395136.502179:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23531 00000100:00100000:3.0:1789395136.502189:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231745408:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.502223:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.502245:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b169 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106051 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.502603:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.502618:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.502630:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.502643:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.502654:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.502660:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395136.502967:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cb:0x0], index 0: 0 00010000:00010000:3.0:1789395136.503104:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316b17e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503114:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316b17e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503122:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316b17e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503156:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503163:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503168:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503175:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503181:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395136.503185:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503196:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503208:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:3.0:1789395136.503211:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395136.503216:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503222:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b170 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395136.503235:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004e57dca reply state 00000000bd801b4a transno 4294983537 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503246:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503253:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395136.503255:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395136.503258:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395136.503286:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316b169 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106051 expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.503314:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316b17e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106051 expref: 19 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.505706:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:3.0:1789395136.505711:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395136.505715:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:3.0:1789395136.506356:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18090:x1876316231745408:12345-192.168.203.54@tcp:101:bash.0 Request processed in 4162us (4985us total) trans 4294983537 rc 0/0 00000100:00100000:3.0:1789395136.506366:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23531 00000100:00100000:3.0:1789395136.531977:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.532014:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231745536 00000100:00100000:3.0:1789395136.532024:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231745536 00000100:00100000:3.0:1789395136.532076:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5210 00000100:00100000:3.0:1789395136.532087:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231745536:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.532105:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.532127:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106058 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395136.532153:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395136.532174:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1789395136.532179:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395136.532188:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 17 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.532205:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 17 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.532220:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d400, rc 0) 00000100:00100000:3.0:1789395136.532287:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231745536:12345-192.168.203.54@tcp:101:bash.0 Request processed in 201us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.532294:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5210 00000100:00100000:0.0:1789395136.539010:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.539125:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231745792 00000100:00100000:3.0:1789395136.539136:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231745792 00000100:00100000:3.0:1789395136.539186:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5076 00000100:00100000:3.0:1789395136.539197:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18090:x1876316231745792:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395136.540095:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18090:x1876316231745792:12345-192.168.203.54@tcp:35:bash.0 Request processed in 896us (1091us total) trans 4294983538 rc 0/0 00000100:00100000:3.0:1789395136.540104:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5076 00000100:00100000:2.0:1789395136.550704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.551445:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231746048 00000100:00100000:0.0:1789395136.551455:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231746048 00000100:00100000:0.0:1789395136.551514:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23532 00000100:00100000:0.0:1789395136.551523:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18090:x1876316231746048:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395136.551549:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395136.551572:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b193 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210605f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.551858:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.551872:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.551883:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.551897:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.551905:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.551911:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395136.552223:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cc:0x0], index 1: 0 00010000:00010000:0.0:1789395136.552871:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b1a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.552882:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.552890:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.552922:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553032:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553040:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553048:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553052:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395136.553057:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553068:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553080:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:0.0:1789395136.553083:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395136.553088:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553094:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b19a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395136.553109:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058555178 reply state 00000000903f71b1 transno 4294983539 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553119:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553125:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4cbc0e700) 00010000:00010000:0.0:1789395136.553127:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395136.553130:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395136.553161:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b193 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210605f expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553176:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210605f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.553183:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:0.0:1789395136.553185:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395136.553188:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aaa00, rc 0) 00000100:00100000:0.0:1789395136.553262:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:18090:x1876316231746048:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1740us (2567us total) trans 4294983539 rc 0/0 00000100:00100000:0.0:1789395136.553270:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23532 00000100:00100000:0.0:1789395136.567654:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395136.568113:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231746176 00000100:00100000:2.0:1789395136.568123:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231746176 00000100:00100000:2.0:1789395136.568179:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5211 00000100:00100000:2.0:1789395136.568189:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18090:x1876316231746176:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395136.568208:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395136.568237:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106066 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395136.568267:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395136.568289:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1789395136.568295:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395136.568304:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 17 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.568320:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 17 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.568334:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:2.0:1789395136.568434:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231746176:12345-192.168.203.54@tcp:101:bash.0 Request processed in 245us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.568441:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5211 00000100:00100000:2.0:1789395136.573721:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.573875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231746432 00000100:00100000:0.0:1789395136.573885:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231746432 00000100:00100000:0.0:1789395136.573953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5077 00000100:00100000:0.0:1789395136.573963:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:18090:x1876316231746432:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395136.574312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18090:x1876316231746432:12345-192.168.203.54@tcp:35:bash.0 Request processed in 349us (599us total) trans 4294983540 rc 0/0 00000100:00100000:0.0:1789395136.574320:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5077 00000100:00100000:3.0:1789395136.581075:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.581752:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231746688 00000100:00100000:0.0:1789395136.581764:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231746688 00000100:00100000:1.0:1789395136.581999:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23533 00000100:00100000:1.0:1789395136.582011:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18090:x1876316231746688:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395136.582037:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.582059:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b1bd lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210606d expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.582156:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.582171:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.582182:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.582196:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.582204:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.582211:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395136.582812:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cc:0x0], index 0: 0 00010000:00010000:1.0:1789395136.584161:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b1d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584178:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584188:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584537:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584545:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584552:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584559:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584565:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.584570:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584578:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584591:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:1.0:1789395136.584594:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.584599:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584605:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b1c4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395136.584619:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057b6e641 reply state 00000000d88d2184 transno 4294983541 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584630:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584635:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c8e8dd00) 00010000:00010000:1.0:1789395136.584638:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395136.584640:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395136.584673:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b1bd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210606d expref: 28 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584688:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210606d expref: 27 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.584695:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:1.0:1789395136.584697:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395136.584700:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:1.0:1789395136.585281:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:18090:x1876316231746688:12345-192.168.203.54@tcp:101:bash.0 Request processed in 3270us (4212us total) trans 4294983541 rc 0/0 00000100:00100000:1.0:1789395136.585291:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23533 00000100:00100000:2.0:1789395136.607689:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.612614:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231746816 00000100:00100000:3.0:1789395136.612629:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231746816 00000100:00100000:3.0:1789395136.612752:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5212 00000100:00100000:3.0:1789395136.612764:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231746816:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.612783:0:14650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.612806:0:14650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106074 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395136.612832:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395136.612855:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1789395136.612860:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395136.612870:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 18 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.612886:0:14650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 18 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.612898:0:14650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:3.0:1789395136.612977:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18090:x1876316231746816:12345-192.168.203.54@tcp:101:bash.0 Request processed in 214us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.612984:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5212 00000100:00100000:2.0:1789395136.626902:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.626990:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231747072 00000100:00100000:3.0:1789395136.626999:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231747072 00000100:00100000:3.0:1789395136.627056:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5078 00000100:00100000:3.0:1789395136.627067:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:18090:x1876316231747072:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:3.0:1789395136.627284:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983542 00000100:00100000:3.0:1789395136.627429:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231747072:12345-192.168.203.54@tcp:35:bash.0 Request processed in 362us (535us total) trans 4294983543 rc 0/0 00000100:00100000:3.0:1789395136.627722:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5078 00000020:00080000:3.0:1789395136.627728:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395136.639089:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.639180:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231747328 00000100:00100000:3.0:1789395136.639190:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231747328 00000100:00100000:3.0:1789395136.639253:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23534 00000100:00100000:3.0:1789395136.639263:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231747328:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.639290:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.639310:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b1e7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210607b expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.639537:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.639552:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.639563:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.639579:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.639585:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.639590:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395136.639900:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cd:0x0], index 1: 0 00010000:00010000:2.0:1789395136.640046:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b1fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640055:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640062:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640094:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640101:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640108:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640114:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640121:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395136.640125:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640138:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640150:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:2.0:1789395136.640154:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395136.640159:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640166:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b1ee lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395136.640180:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049c43563 reply state 000000004c536120 transno 4294983544 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640191:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640198:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395136.640200:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395136.640202:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395136.640228:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b1e7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210607b expref: 33 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640243:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b1fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210607b expref: 32 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.640251:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395136.640254:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395136.640256:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395136.640317:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:18090:x1876316231747328:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1056us (1238us total) trans 4294983544 rc 0/0 00000100:00100000:2.0:1789395136.640324:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23534 00000100:00100000:2.0:1789395136.676154:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.678212:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231747456 00000100:00100000:3.0:1789395136.678226:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231747456 00000100:00100000:3.0:1789395136.678302:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5213 00000100:00100000:3.0:1789395136.678314:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18090:x1876316231747456:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.678335:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.678359:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106082 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395136.678447:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395136.678471:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1789395136.678475:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395136.678485:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 18 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.678503:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 18 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.678516:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:3.0:1789395136.678584:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18090:x1876316231747456:12345-192.168.203.54@tcp:101:bash.0 Request processed in 272us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.678591:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5213 00000100:00100000:0.0:1789395136.692641:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.692769:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231747712 00000100:00100000:1.0:1789395136.692779:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231747712 00000100:00100000:1.0:1789395136.692833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5079 00000100:00100000:1.0:1789395136.692843:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:18090:x1876316231747712:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395136.693137:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:18090:x1876316231747712:12345-192.168.203.54@tcp:35:bash.0 Request processed in 295us (504us total) trans 4294983545 rc 0/0 00000100:00100000:1.0:1789395136.693144:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5079 00000100:00100000:2.0:1789395136.711500:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.711709:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231747968 00000100:00100000:0.0:1789395136.711721:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231747968 00000100:00100000:0.0:1789395136.711785:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23535 00000100:00100000:0.0:1789395136.711796:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:18090:x1876316231747968:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395136.711821:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395136.711842:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b211 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106089 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.711960:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.711986:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.712003:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.712019:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.712026:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.712032:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395136.712312:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cd:0x0], index 0: 0 00010000:00010000:0.0:1789395136.714161:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714179:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714189:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714224:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714231:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714238:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714245:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714256:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395136.714261:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714268:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714281:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:0.0:1789395136.714284:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395136.714288:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714294:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316b218 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395136.714308:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d56d85ef reply state 0000000089ad1a6a transno 4294983546 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714318:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714324:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a4cbc0e100) 00010000:00010000:0.0:1789395136.714327:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395136.714330:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395136.714359:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b211 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106089 expref: 37 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714372:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106089 expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.714634:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:0.0:1789395136.714637:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395136.714640:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab000, rc 0) 00000100:00100000:0.0:1789395136.714715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+37:18090:x1876316231747968:12345-192.168.203.54@tcp:101:bash.0 Request processed in 2920us (3225us total) trans 4294983546 rc 0/0 00000100:00100000:0.0:1789395136.714724:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23535 00000100:00100000:2.0:1789395136.725966:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.726053:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231748096 00000100:00100000:3.0:1789395136.726063:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231748096 00000100:00100000:3.0:1789395136.726121:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5214 00000100:00100000:3.0:1789395136.726131:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18090:x1876316231748096:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395136.726158:0:14638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.726180:0:14638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106090 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395136.726205:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395136.726227:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1789395136.726232:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395136.726241:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 19 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.726257:0:14638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 19 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.726268:0:14638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d800, rc 0) 00000100:00100000:3.0:1789395136.726345:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18090:x1876316231748096:12345-192.168.203.54@tcp:101:bash.0 Request processed in 215us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.726352:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5214 00000100:00100000:2.0:1789395136.734124:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.735288:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231748352 00000100:00100000:3.0:1789395136.735309:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231748352 00000100:00100000:3.0:1789395136.735375:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5080 00000100:00100000:3.0:1789395136.735413:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+37:18090:x1876316231748352:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395136.735717:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:18090:x1876316231748352:12345-192.168.203.54@tcp:35:bash.0 Request processed in 333us (1600us total) trans 4294983547 rc 0/0 00000100:00100000:3.0:1789395136.735725:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5080 00000100:00100000:2.0:1789395136.765357:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.765479:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231748608 00000100:00100000:1.0:1789395136.765490:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231748608 00000100:00100000:1.0:1789395136.765549:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23536 00000100:00100000:1.0:1789395136.765559:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:18278:x1876316231748608:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395136.765583:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.765605:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b23b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106097 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395136.765748:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:1.0:1789395136.765842:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b23b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106097 expref: 40 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.765873:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.765876:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395136.765882:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b23b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106097 expref: 40 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.765896:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1a00, rc 0) 00000100:00100000:1.0:1789395136.766022:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:18278:x1876316231748608:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 463us (671us total) trans 4294983548 rc 301/301 00000100:00100000:1.0:1789395136.766029:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23536 00000100:00100000:2.0:1789395136.781718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.781808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231748736 00000100:00100000:0.0:1789395136.781818:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231748736 00000100:00100000:0.0:1789395136.781878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5081 00000100:00100000:0.0:1789395136.781888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:18278:x1876316231748736:12345-192.168.203.54@tcp:33:lfs.0 00000004:00200000:0.0:1789395136.782034:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00000004:00200000:0.0:1789395136.782039:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1789395136.782111:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:18278:x1876316231748736:12345-192.168.203.54@tcp:33:lfs.0 Request processed in 224us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.782120:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5081 00000100:00100000:0.0:1789395136.793791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.794236:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231748992 00000100:00100000:1.0:1789395136.794247:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231748992 00000100:00100000:1.0:1789395136.794319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5082 00000100:00100000:1.0:1789395136.794330:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:18278:x1876316231748992:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:1.0:1789395136.794590:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:18278:x1876316231748992:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 260us (807us total) trans 4294983549 rc 0/0 00000100:00100000:1.0:1789395136.794598:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5082 00000100:00100000:2.0:1789395136.828329:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.828431:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231749248 00000100:00100000:1.0:1789395136.828443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231749248 00000100:00100000:1.0:1789395136.828504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23537 00000100:00100000:1.0:1789395136.828514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:18279:x1876316231749248:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395136.828551:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.828574:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210609e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.828733:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b250 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.828747:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.828759:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395136.828771:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:1.0:1789395136.828870:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210609e expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.828891:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b250 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210609e expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.828904:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:1.0:1789395136.828907:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789395136.828911:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:1.0:1789395136.828984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:18279:x1876316231749248:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 471us (664us total) trans 4294983550 rc 0/0 00000100:00100000:1.0:1789395136.828991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23537 00000100:00100000:2.0:1789395136.836012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.836084:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231749632 00000100:00100000:3.0:1789395136.836093:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231749632 00000100:00100000:3.0:1789395136.836152:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5083 00000100:00100000:3.0:1789395136.836161:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:18279:x1876316231749632:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:3.0:1789395136.836374:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:18279:x1876316231749632:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 213us (368us total) trans 4294983551 rc 0/0 00000100:00100000:3.0:1789395136.836381:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5083 00000100:00100000:0.0:1789395136.838840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.838937:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231749376 00000100:00100000:1.0:1789395136.838947:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231749376 00000100:00100000:1.0:1789395136.839009:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1361 00000100:00100000:1.0:1789395136.839020:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:2397:x1876316231749376:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:1.0:1789395136.839035:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395136.839060:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b10e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210602e expref: 43 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.839081:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.839086:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395136.839142:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:2397:x1876316231749376:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.839150:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1361 00000100:00100000:2.0:1789395136.844104:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395136.844152:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.844240:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231750016 00000100:00100000:0.0:1789395136.844251:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231750016 00000100:00100000:0.0:1789395136.844324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:0.0:1789395136.844334:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18279:x1876316231750016:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:0.0:1789395136.844696:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.844708:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.844719:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395136.844740:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692032:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1789395136.844785:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.844880:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692032 00000100:00100000:2.0:1789395136.844884:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692032 00000100:00100000:3.0:1789395136.844949:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231749760 00000100:00100000:3.0:1789395136.844954:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231749760 00000100:00100000:0.0:1789395136.844993:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395136.852356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375 00000100:00100000:2.0:1789395136.852380:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6526:x1876316239692032:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395136.852431:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395136.852456:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b265 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b25e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.852489:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b265 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b25e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.852506:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b265 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b25e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395136.852513:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1362 00010000:00010000:2.0:1789395136.852520:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:2.0:1789395136.852525:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395136.852530:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:2395:x1876316231749760:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:2.0:1789395136.852531:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00010000:00010000:3.0:1789395136.852546:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789395136.852565:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316b250 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210609e expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.852581:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b12a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106035 expref: 41 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.852587:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:3.0:1789395136.852590:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395136.852632:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:2395:x1876316231749760:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 110us (8480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.852637:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1362 00000100:00100000:2.0:1789395136.853544:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692032:12345-0@lo:101:mdt_io00_002.0 Request processed in 1174us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.853552:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375 00000100:00100000:3.0:1789395136.853553:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692032:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395136.853573:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.853587:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395136.853610:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:0.0:1789395136.855458:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1789395136.855526:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692160:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.855589:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.855648:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395136.857311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692160 00000100:00100000:2.0:1789395136.857325:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692160 00000100:00100000:1.0:1789395136.857525:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:1.0:1789395136.857538:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692160:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395136.857675:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692160:12345-0@lo:1000:mdt_io00_002.0 Request processed in 140us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.857683:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:0.0:1789395136.857832:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692160:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.857907:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692288:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.857954:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.857993:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395136.858049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692288 00000100:00100000:2.0:1789395136.858054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692288 00000100:00100000:2.0:1789395136.858093:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:2.0:1789395136.858100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692288:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.858163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692288:12345-0@lo:1000:mdt_io00_002.0 Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.858170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:0.0:1789395136.858272:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692288:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.858319:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692416:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.858342:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.858366:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395136.858563:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692416 00000100:00100000:2.0:1789395136.858568:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692416 00000100:00100000:2.0:1789395136.858601:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:2.0:1789395136.858608:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692416:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.858787:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692416:12345-0@lo:1000:mdt_io00_002.0 Request processed in 179us (443us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395136.858795:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000100:00100000:0.0:1789395136.858917:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692416:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.858982:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692544:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.859006:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.860267:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.862787:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692544 00000100:00100000:3.0:1789395136.862801:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692544 00000100:00100000:3.0:1789395136.862866:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:3.0:1789395136.862877:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692544:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.863013:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692544:12345-0@lo:1000:mdt_io00_002.0 Request processed in 137us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.863022:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00000100:00100000:1.0:1789395136.865269:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692544:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1789395136.865374:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.865411:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.865423:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.865444:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89ce680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692672:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1789395136.865498:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.865557:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.865736:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692672 00000100:00100000:3.0:1789395136.865744:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692672 00000100:00100000:3.0:1789395136.865791:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:3.0:1789395136.865801:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6526:x1876316239692672:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395136.865816:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.865831:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b273 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b26c expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.865867:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b273 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b26c expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.865880:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b273 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b26c expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.865889:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395136.865891:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395136.865895:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10dc00, rc 0) 00000100:00100000:3.0:1789395136.865939:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6526:x1876316239692672:12345-0@lo:101:mdt_io00_002.0 Request processed in 140us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.865945:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:0.0:1789395136.866175:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89ce680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692672:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395136.866193:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.866204:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395136.866220:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789395136.866246:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.866254:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.866262:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395136.866275:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692800:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1789395136.866301:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.866331:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395136.866516:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239692800 00000100:00100000:1.0:1789395136.866521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239692800 00000100:00100000:1.0:1789395136.866555:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:1.0:1789395136.866563:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6526:x1876316239692800:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395136.866571:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.866583:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b27a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.866599:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.866608:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.866687:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1789395136.866721:0:6517:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1789395136.866756:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.866764:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4df47aa00) 00010000:00010000:1.0:1789395136.866767:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.866771:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.866778:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1600, rc 0) 00000100:00100000:1.0:1789395136.866809:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239692800:12345-0@lo:101:mdt_io00_002.0 Request processed in 247us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.866815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00000100:00100000:0.0:1789395136.867566:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239692800:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395136.867583:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.867592:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395136.870823:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983551 is committed 00000001:00080000:0.0:1789395136.870858:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983533 is committed 00000020:00080000:0.0:1789395136.870863:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 407 batchid updated 00000020:00080000:3.0:1789395136.870898:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 407 00000004:00080000:3.0:1789395136.870966:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca3493c0 with version 762 00000020:00080000:3.0:1789395136.870978:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 402 cancel update log [0x240000401:0x3:0x0].396: rc = 0 00000020:00080000:3.0:1789395136.871051:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 402 cancel update log [0x200000400:0x3:0x0].399: rc = 0 00000004:00080000:3.0:1789395136.871077:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca349900 with version 763 00000020:00080000:3.0:1789395136.871081:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 403 cancel update log [0x240000401:0x3:0x0].397: rc = 0 00000020:00080000:3.0:1789395136.871100:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 403 cancel update log [0x200000400:0x3:0x0].400: rc = 0 00000004:00080000:3.0:1789395136.871149:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca349e40 with version 764 00000020:00080000:3.0:1789395136.871153:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 404 cancel update log [0x240000401:0x3:0x0].398: rc = 0 00000020:00080000:3.0:1789395136.871175:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 404 cancel update log [0x200000400:0x3:0x0].401: rc = 0 00000004:00080000:3.0:1789395136.871195:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca349180 with version 765 00000020:00080000:3.0:1789395136.871198:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 405 cancel update log [0x240000401:0x3:0x0].399: rc = 0 00000020:00080000:3.0:1789395136.871217:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 405 cancel update log [0x200000400:0x3:0x0].402: rc = 0 00000004:00080000:3.0:1789395136.871236:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34fcc0 with version 766 00000020:00080000:3.0:1789395136.871239:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 406 cancel update log [0x240000401:0x3:0x0].401: rc = 0 00000020:00080000:3.0:1789395136.871257:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 406 cancel update log [0x200000400:0x3:0x0].403: rc = 0 00000004:00080000:3.0:1789395136.871275:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34fd80 with version 767 00000020:00080000:3.0:1789395136.871277:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 407 cancel update log [0x240000401:0x3:0x0].402: rc = 0 00000020:00080000:3.0:1789395136.871294:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 407 cancel update log [0x200000400:0x3:0x0].404: rc = 0 00000020:00080000:3.0:1789395136.871313:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 407 00000004:00080000:3.0:1789395136.871322:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 762 rpc_version 762 00000020:00100000:3.0:1789395136.871354:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395136.871365:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c93e7480 x1876316239693056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395136.871484:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239693056:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.871547:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.871582:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.871605:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239693056 00000100:00100000:3.0:1789395136.871612:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239693056 00000100:00100000:3.0:1789395136.871942:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3382 00000100:00100000:3.0:1789395136.871951:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239693056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.872076:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239693056:12345-0@lo:1000:osp_up1-0.0 Request processed in 126us (529us total) trans 4294968491 rc 0/0 00000100:00100000:3.0:1789395136.872084:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3382 00000100:00100000:3.0:1789395136.872131:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239693056:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395136.872142:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 763 rpc_version 763 00000020:00100000:3.0:1789395136.872154:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395136.872159:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c93e4000 x1876316239693312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395136.872173:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239693312:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.872199:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.872214:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.872226:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239693312 00000100:00100000:3.0:1789395136.872229:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239693312 00000100:00100000:3.0:1789395136.872253:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383 00000100:00100000:3.0:1789395136.872260:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239693312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.872346:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239693312:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (146us total) trans 4294968492 rc 0/0 00000100:00100000:3.0:1789395136.872353:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383 00000100:00100000:3.0:1789395136.872418:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239693312:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395136.872426:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 764 rpc_version 764 00000020:00100000:3.0:1789395136.872437:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395136.872442:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c93e6a00 x1876316239693568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395136.872454:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239693568:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.872479:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.872500:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.872512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239693568 00000100:00100000:3.0:1789395136.872516:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239693568 00000100:00100000:3.0:1789395136.872540:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:3.0:1789395136.872546:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239693568:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1789395136.872722:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872733:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872740:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872746:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.872751:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872759:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872780:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4df47aa00) 00010000:00010000:1.0:1789395136.872783:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.872788:0:3622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872800:0:3622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872810:0:3622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.872838:0:3622:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.872849:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3622:1876316239693696:0@lo:105: 00000100:00100000:1.0:1789395136.872880:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.872905:0:3622:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395136.872939:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789395136.872949:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239693696 00000100:00100000:1.0:1789395136.872953:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239693696 00000100:00100000:1.0:1789395136.872983:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1789395136.872991:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c78ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3622:x1876316239693696:12345-0@lo:105: 00010000:00010000:1.0:1789395136.873002:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873011:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873025:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873033:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873040:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873049:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873068:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2ab800) 00000100:00100000:1.0:1789395136.873099:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c78ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3622:x1876316239693696:12345-0@lo:105: Request processed in 109us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.873105:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1789395136.873159:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3622:1876316239693696:0@lo:105: 00010000:00010000:1.0:1789395136.873174:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873182:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b0f2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873195:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873202:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873208:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873213:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873216:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873222:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873230:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:1.0:1789395136.873233:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873236:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873242:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b0f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873257:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873263:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873268:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873273:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873276:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873286:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873293:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4df47a200) 00010000:00010000:1.0:1789395136.873296:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873298:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873303:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b100 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873317:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873323:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873328:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873333:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873336:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873341:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873349:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a4cbc0ea00) 00010000:00010000:1.0:1789395136.873351:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873353:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873359:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316b14d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873372:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873378:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873406:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873412:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873415:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873420:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873428:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3ca363f00) 00010000:00010000:1.0:1789395136.873430:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873433:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873439:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b177 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873452:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873458:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873463:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873467:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873469:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873474:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873481:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4cbc0e700) 00010000:00010000:1.0:1789395136.873483:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873485:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873490:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316b1a1 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873501:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873507:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873511:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873515:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873518:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873527:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873534:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c8e8dd00) 00010000:00010000:1.0:1789395136.873536:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873539:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873544:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b1cb lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873556:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873562:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873568:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873572:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.873575:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873581:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873588:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3ca35fc00) 00010000:00010000:1.0:1789395136.873591:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.873594:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.873600:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b1f5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.876998:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877025:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877034:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877041:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.877047:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877058:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877077:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a4cbc0e100) 00010000:00010000:1.0:1789395136.877081:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.877086:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877093:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b21f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877142:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877158:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395136.877186:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395136.877244:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877253:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.877264:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.877288:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239693824:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1789395136.877350:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.877414:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.877573:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239693568:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (136us total) trans 4294968493 rc 0/0 00000100:00100000:3.0:1789395136.877585:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:3.0:1789395136.877612:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239693824 00000100:00100000:3.0:1789395136.877619:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239693824 00000100:00100000:3.0:1789395136.877648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:3.0:1789395136.877656:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6526:x1876316239693824:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395136.877672:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.877689:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b28f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b288 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.877715:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b28f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b288 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.877726:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b28f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b288 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.877733:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a3c90d5b00) 00010000:00010000:3.0:1789395136.877735:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1789395136.877738:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ce00, rc 0) 00000100:00100000:3.0:1789395136.877779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239693824:12345-0@lo:101:mdt_io00_002.0 Request processed in 124us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.877785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000100:00100000:3.0:1789395136.877837:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239693568:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395136.877865:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 765 rpc_version 765 00000020:00100000:3.0:1789395136.877881:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395136.877887:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c93e4380 x1876316239694080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395136.877901:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239694080:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.877939:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.877952:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.877965:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239694080 00000100:00100000:3.0:1789395136.877969:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239694080 00000100:00100000:3.0:1789395136.877994:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:3.0:1789395136.878000:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239694080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.878124:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239694080:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (184us total) trans 4294968494 rc 0/0 00000100:00100000:3.0:1789395136.878131:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000100:00100000:3.0:1789395136.878162:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239694080:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395136.878169:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 766 rpc_version 766 00000020:00100000:3.0:1789395136.878181:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395136.878186:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c93e5c00 x1876316239694336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395136.878198:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239694336:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.878223:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.878238:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.878248:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239694336 00000100:00100000:3.0:1789395136.878252:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239694336 00000100:00100000:3.0:1789395136.878273:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:3.0:1789395136.878279:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239694336:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.878363:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239694336:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (139us total) trans 4294968495 rc 0/0 00000100:00100000:3.0:1789395136.878370:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387 00000100:00100000:3.0:1789395136.878431:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239694336:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1789395136.878439:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 767 rpc_version 767 00000020:00100000:3.0:1789395136.878451:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395136.878456:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a49500 x1876316239694592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395136.878468:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239694592:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.878494:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.878512:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.878526:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239694592 00000100:00100000:3.0:1789395136.878530:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239694592 00000100:00100000:3.0:1789395136.878559:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:3.0:1789395136.878566:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239694592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395136.878634:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239694592:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (139us total) trans 4294968496 rc 0/0 00000100:00100000:3.0:1789395136.878642:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:2.0:1789395136.878668:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239694592:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395136.878971:0:6526:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983533 gen 2 00000004:00080000:1.0:1789395136.878977:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983533 committed transno 4294983533 00000100:00100000:1.0:1789395136.878997:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239693824:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395136.879012:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.879023:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395136.879039:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1523:0x0] 00000100:00100000:1.0:1789395136.879067:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239694720:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395136.879094:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.879120:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.879554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239694720 00000100:00100000:0.0:1789395136.879559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239694720 00000100:00100000:0.0:1789395136.879595:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00000100:00100000:0.0:1789395136.879603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239694720:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.879678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239694720:12345-0@lo:1000:mdt_io00_002.0 Request processed in 76us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.879685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00000100:00100000:1.0:1789395136.879975:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239694720:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1789395136.879998:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1523:0x0] 00000100:00100000:1.0:1789395136.880024:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239694848:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395136.880048:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.880072:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.880118:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239694848 00000100:00100000:3.0:1789395136.880123:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239694848 00000100:00100000:3.0:1789395136.880155:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1789395136.880161:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239694848:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.880295:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239694848:12345-0@lo:1000:mdt_io00_002.0 Request processed in 133us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.880312:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:1.0:1789395136.882722:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239694848:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.885582:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239694976:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1789395136.885999:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.886093:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.889753:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239694976 00000100:00100000:3.0:1789395136.889768:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239694976 00000100:00100000:3.0:1789395136.889897:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391 00000100:00100000:3.0:1789395136.889910:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239694976:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1789395136.891718:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239694976:12345-0@lo:403:mdt_io00_002.0 Request processed in 1804us (5712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.891731:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391 00000100:00100000:0.0:1789395136.892562:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cc700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239694976:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1789395136.893259:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695104:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.893819:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.893857:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.893937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695104 00000100:00100000:3.0:1789395136.893945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695104 00000100:00100000:3.0:1789395136.894050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3392 00000100:00100000:3.0:1789395136.894059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695104:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.894142:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695104:12345-0@lo:1000:mdt_io00_002.0 Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.894149:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3392 00000100:00100000:2.0:1789395136.894216:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695104:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.894262:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695232:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.894322:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.894708:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.894833:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695232 00000100:00100000:0.0:1789395136.894839:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695232 00000100:00100000:0.0:1789395136.894890:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393 00000100:00100000:0.0:1789395136.894898:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695232:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.894962:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695232:12345-0@lo:1000:mdt_io00_002.0 Request processed in 65us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.894969:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393 00000100:00100000:2.0:1789395136.895642:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695232:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.896201:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695360:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395136.896241:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.896259:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.896423:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695360 00000100:00100000:0.0:1789395136.896428:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695360 00000100:00100000:0.0:1789395136.896463:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394 00000100:00100000:0.0:1789395136.896470:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695360:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1789395136.899488:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695360:12345-0@lo:403:mdt_io00_002.0 Request processed in 3010us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.899502:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394 00000100:00100000:2.0:1789395136.899706:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695360:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395136.900551:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695488:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.900589:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.900652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695488 00000100:00100000:3.0:1789395136.900659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695488 00000100:00100000:2.0:1789395136.900675:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.900698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395 00000100:00100000:3.0:1789395136.900778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695488:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.901012:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695488:12345-0@lo:1000:mdt_io00_002.0 Request processed in 305us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.901013:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695488:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.901019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395 00000100:00100000:2.0:1789395136.901058:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695616:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.901083:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.901154:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395136.901212:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695616 00000100:00100000:1.0:1789395136.901217:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695616 00000100:00100000:1.0:1789395136.901274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1789395136.901283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695616:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395136.901349:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695616:12345-0@lo:1000:mdt_io00_002.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.901356:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:2.0:1789395136.901425:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695616:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.901453:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695744:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.901482:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.901507:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.901566:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695744 00000100:00100000:3.0:1789395136.901571:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695744 00000100:00100000:3.0:1789395136.901598:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397 00000100:00100000:3.0:1789395136.901605:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695744:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.901664:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695744:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.901674:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397 00000100:00100000:2.0:1789395136.901706:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695744:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.901740:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695872:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.901762:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.901785:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239695872 00000100:00100000:2.0:1789395136.901786:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.901790:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239695872 00000100:00100000:0.0:1789395136.901822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:0.0:1789395136.901830:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695872:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.901891:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239695872:12345-0@lo:1000:mdt_io00_002.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.901906:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:2.0:1789395136.902066:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239695872:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.902096:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696000:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.902180:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.902199:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.902246:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696000 00000100:00100000:3.0:1789395136.902251:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696000 00000100:00100000:3.0:1789395136.902282:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:3.0:1789395136.902288:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696000:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.902517:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696000:12345-0@lo:1000:mdt_io00_002.0 Request processed in 228us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.902564:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696000:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.902843:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:2.0:1789395136.903273:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696128:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395136.903467:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.903562:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.903638:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696128 00000100:00100000:0.0:1789395136.903643:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696128 00000100:00100000:0.0:1789395136.903686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400 00000100:00100000:0.0:1789395136.903694:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696128:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1789395136.906974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696128:12345-0@lo:403:mdt_io00_002.0 Request processed in 3267us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.906989:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400 00000100:00100000:2.0:1789395136.907422:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696128:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395136.908169:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696256:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.908213:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.908238:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.908432:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696256 00000100:00100000:0.0:1789395136.908439:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696256 00000100:00100000:0.0:1789395136.908485:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:0.0:1789395136.908494:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696256:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.908572:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696256:12345-0@lo:1000:mdt_io00_002.0 Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.908580:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000100:00100000:2.0:1789395136.908649:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696256:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.908721:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696384:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.908746:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.908771:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.908833:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696384 00000100:00100000:3.0:1789395136.908838:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696384 00000100:00100000:3.0:1789395136.908873:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3402 00000100:00100000:3.0:1789395136.908880:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696384:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395136.908948:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696384:12345-0@lo:1000:mdt_io00_002.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.908954:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3402 00000100:00100000:2.0:1789395136.909058:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696384:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.909092:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696512:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395136.909115:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.909138:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.909201:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696512 00000100:00100000:0.0:1789395136.909206:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696512 00000100:00100000:0.0:1789395136.909235:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403 00000100:00100000:0.0:1789395136.909241:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696512:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395136.909306:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6526:x1876316239696512:12345-0@lo:1000:mdt_io00_002.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.909316:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403 00000100:00100000:2.0:1789395136.909476:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696512:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1789395136.910453:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].391, 2464 off586064 00000040:00080000:2.0:1789395136.910515:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].391, 2544 off640232 00000004:00080000:2.0:1789395136.910521:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca6cd3c0 with version 745 00000004:00080000:0.0:1789395136.910716:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 745 rpc_version 745 00000020:00100000:0.0:1789395136.910751:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395136.910759:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d4000 x1876316239696768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395136.910778:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239696768:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395136.910826:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.910857:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395136.910916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696768 00000100:00100000:3.0:1789395136.910931:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696768 00000100:00100000:3.0:1789395136.910972:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3404 00000100:00100000:3.0:1789395136.910980:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239696768:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395136.912816:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+26:7455:x1876316239696768:12345-0@lo:1000:osp_up0-1.0 Request processed in 1831us (1983us total) trans 4294983552 rc 0/0 00000100:00100000:3.0:1789395136.912828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3404 00000100:00100000:0.0:1789395136.912956:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239696768:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1789395136.913042:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913059:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913072:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913095:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913102:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913109:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913209:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913257:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.913276:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395136.913295:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696896:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1789395136.913334:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.913456:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.914026:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239696896 00000100:00100000:0.0:1789395136.914033:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239696896 00000100:00100000:0.0:1789395136.914136:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3405 00000100:00100000:0.0:1789395136.914167:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:6526:x1876316239696896:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395136.914247:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395136.914351:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b2a4 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.914535:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b2a4 expref: 27 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.914566:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b2a4 expref: 27 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.914575:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:0.0:1789395136.914578:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395136.914602:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab600, rc 0) 00000100:00100000:0.0:1789395136.914674:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:6526:x1876316239696896:12345-0@lo:101:mdt_io00_002.0 Request processed in 530us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.914694:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3405 00000100:00100000:1.0:1789395136.914727:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6526:1876316239696896:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395136.914744:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914766:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395136.914790:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061c3ebb4 reply state 000000003145dbcb transno 4294968497 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914802:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914809:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:1.0:1789395136.914811:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395136.914815:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395136.914821:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914828:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395136.914840:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000004:00010000:1.0:1789395136.914851:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061c3ebb4 reply state 000000003145dbcb transno 4294968497 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914859:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914865:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3c90d5400) 00010000:00010000:1.0:1789395136.914867:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395136.914869:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1789395136.914878:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1523:0x0] 00010000:00010000:1.0:1789395136.914886:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914893:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395136.914914:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395136.914927:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914940:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914947:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914969:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395136.914973:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395136.914977:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.914984:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395136.914995:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1789395136.914999:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.915005:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.915012:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.915023:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789395136.915087:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:18279:x1876316231750016:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 70753us (70991us total) trans 4294968497 rc 0/0 00000100:00100000:1.0:1789395136.915099:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00010000:00010000:0.0:1789395136.915250:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395136.915257:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915508:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395136.915554:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395136.915564:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915624:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915631:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395136.915686:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.915705:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239697024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395136.915719:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b26c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915738:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395136.915742:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.915747:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395136.915749:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395136.915753:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395136.915760:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915820:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915827:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789395136.915854:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697024 00010000:00010000:0.0:1789395136.915857:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.915860:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697024 00010000:00010000:0.0:1789395136.915878:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b25e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.915894:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395136.915895:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00010000:00010000:0.0:1789395136.915895:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395136.915897:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395136.915940:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239697152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395136.915975:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+27:3639:x1876316239697024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395136.915985:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789395136.915987:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395136.916003:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b273 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b26c expref: 27 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.916014:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.916018:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395136.916018:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697152 00000100:00100000:0.0:1789395136.916021:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697152 00000100:00100000:0.0:1789395136.916046:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1789395136.916047:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+27:3639:x1876316239697024:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.916052:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+27:3636:x1876316239697152:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395136.916053:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00010000:00010000:0.0:1789395136.916060:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395136.916070:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b265 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b25e expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.916083:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239697024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395136.916085:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:0.0:1789395136.916091:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395136.916127:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+25:3636:x1876316239697152:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.916133:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1789395136.916231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239697152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395136.916509:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395136.921622:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.921719:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231750144 00000100:00100000:0.0:1789395136.921729:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231750144 00000100:00100000:0.0:1789395136.921790:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23538 00000100:00100000:0.0:1789395136.921801:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18279:x1876316231750144:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395136.921823:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395136.921844:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316b2b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.921909:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.921933:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.921945:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395136.921994:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:0.0:1789395136.921997:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395136.922017:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.922042:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316b2b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.922062:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.922071:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395136.922075:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789395136.922078:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab200, rc 0) 00000100:00100000:0.0:1789395136.922350:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18279:x1876316231750144:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 550us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.922359:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23538 00000100:00100000:0.0:1789395136.929589:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395136.929700:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231750400 00000100:00100000:2.0:1789395136.929709:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231750400 00000100:00100000:1.0:1789395136.929886:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23539 00000100:00100000:1.0:1789395136.929902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18279:x1876316231750400:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395136.929933:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.929956:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b2c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060ac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930034:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930048:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930060:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930071:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930080:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b27a expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930088:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.930124:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b27a expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.930137:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239697280:0@lo:104: 00000100:00100000:1.0:1789395136.930247:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395136.930346:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697280 00000100:00100000:0.0:1789395136.930352:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697280 00000100:00100000:1.0:1789395136.930370:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395136.930433:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1789395136.930441:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239697280:12345-0@lo:104: 00010000:00010000:0.0:1789395136.930454:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.930498:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789395136.930502:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239697280:12345-0@lo:104: Request processed in 64us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.930508:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1789395136.930526:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239697280:0@lo:104: 00010000:00010000:1.0:1789395136.930545:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.930599:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395136.930606:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.930615:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395136.930621:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395136.930630:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.930655:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.930662:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395136.930688:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.930696:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2ab800/0xff35729af316b27a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.930715:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395136.930716:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789395136.930718:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395136.930722:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395136.930731:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239697408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395136.930764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395136.930877:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697408 00000100:00100000:3.0:1789395136.930881:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697408 00010000:00010000:3.0:1789395136.930903:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b27a expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395136.930943:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1789395136.930952:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+25:3636:x1876316239697408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395136.930964:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789395136.933513:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983552 is committed 00010000:00010000:3.0:1789395136.933844:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b281 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b27a expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.933873:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4df47aa00) 00010000:00010000:3.0:1789395136.933879:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.933887:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.933895:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.933933:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395136.933990:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934000:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395136.934025:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+23:3636:x1876316239697408:12345-0@lo:103:ldlm_bl.0 Request processed in 3064us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.934035:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1789395136.934125:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239697536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395136.934167:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.934207:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395136.934279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697536 00000100:00100000:2.0:1789395136.934287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697536 00000100:00100000:2.0:1789395136.934342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3406 00000100:00100000:0.0:1789395136.934352:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239697408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395136.934354:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6513:x1876316239697536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395136.934477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6513:x1876316239697536:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.934484:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3406 00000100:00100000:1.0:1789395136.934618:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239697536:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789395136.934662:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b2d5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934674:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b2d5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934683:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b2d5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934696:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934703:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934710:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934716:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934722:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.934727:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934734:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934743:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395136.934746:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.934750:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934756:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b2c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934766:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934772:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934778:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934783:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395136.934786:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934791:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934797:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a4df47aa00) 00010000:00010000:1.0:1789395136.934799:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395136.934802:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934807:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934843:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b2c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060ac expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934857:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b2d5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060ac expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.934863:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a4c8e8dd00) 00010000:00010000:1.0:1789395136.934865:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395136.934867:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1200, rc 0) 00000100:00100000:1.0:1789395136.934933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18279:x1876316231750400:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 5035us (5352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395136.934940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23539 00000100:00100000:2.0:1789395136.938329:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395136.938434:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231750656 00000100:00100000:3.0:1789395136.938445:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231750656 00000100:00100000:3.0:1789395136.938502:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23540 00000100:00100000:3.0:1789395136.938512:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:18279:x1876316231750656:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395136.938538:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395136.938565:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b2dc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395136.938768:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:2.0:1789395136.938860:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b2dc lrc: 1/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060b3 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.938875:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3c90d5400) 00010000:00010000:2.0:1789395136.938878:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395136.938883:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316b2dc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060b3 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.939009:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10dc00, rc 0) 00000100:00100000:2.0:1789395136.939075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231750656:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 564us (755us total) trans 4294968498 rc 301/301 00000100:00100000:2.0:1789395136.939084:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23540 00000100:00100000:2.0:1789395136.945253:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.945473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231750784 00000100:00100000:0.0:1789395136.945483:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231750784 00000100:00100000:0.0:1789395136.945542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23541 00000100:00100000:0.0:1789395136.945550:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231750784:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395136.945571:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395136.945588:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b2ea lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.945634:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b2f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.945645:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b2f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.945653:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b2f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395136.945690:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xca:0x0]: returning size 4096 00000004:00200000:0.0:1789395136.945693:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1789395136.945718:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b2ea lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060ba expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.945730:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b2f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060ba expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395136.945736:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:0.0:1789395136.945738:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395136.945740:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa200, rc 0) 00000100:00100000:0.0:1789395136.945791:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:18279:x1876316231750784:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 240us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395136.945799:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23541 00000100:00100000:0.0:1789395136.954092:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.954330:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231750912 00000100:00100000:1.0:1789395136.954340:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231750912 00000100:00100000:1.0:1789395136.954472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23542 00000100:00100000:1.0:1789395136.954485:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18279:x1876316231750912:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395136.954507:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395136.954527:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b2f8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060c1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.954586:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.954606:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b2a4 expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.954615:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 4/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395136.954647:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b2a4 expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.954661:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239697664:0@lo:104: 00000100:00100000:1.0:1789395136.954707:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395136.954757:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395136.955002:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697664 00000100:00100000:2.0:1789395136.955008:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697664 00000100:00100000:2.0:1789395136.955051:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1789395136.955058:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239697664:12345-0@lo:104: 00010000:00010000:2.0:1789395136.955072:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.955131:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789395136.955137:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239697664:12345-0@lo:104: Request processed in 81us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.955144:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00010000:00010000:2.0:1789395136.955164:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395136.955170:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.955179:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395136.955184:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395136.955195:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.955556:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395136.956026:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239697664:0@lo:104: 00010000:00010000:1.0:1789395136.956049:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.956382:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395136.956435:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.956444:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca10d000/0xff35729af316b2a4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b2ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.956465:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395136.956467:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395136.956470:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395136.956579:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395136.956595:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239697792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395136.956643:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395136.957109:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239697792 00000100:00100000:2.0:1789395136.957116:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239697792 00010000:00010000:2.0:1789395136.957145:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b2a4 expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395136.957179:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:2.0:1789395136.957188:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+23:3639:x1876316239697792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395136.957202:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395136.959123:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b2ab lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b2a4 expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.959144:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:2.0:1789395136.959150:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.959159:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.959167:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.959202:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395136.959332:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239697792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395136.959437:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.959446:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395136.959488:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239697792:12345-0@lo:103:ldlm_bl.0 Request processed in 2299us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.959497:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000004:00200000:3.0:1789395136.959502:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcd:0x0]: returning size 4096 00000004:00200000:3.0:1789395136.959508:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1789395136.959552:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b2f8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060c1 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.959568:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060c1 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395136.959576:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:3.0:1789395136.959578:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395136.959581:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0600, rc 0) 00000100:00100000:3.0:1789395136.959636:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18279:x1876316231750912:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 5154us (5554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395136.959644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23542 00000100:00100000:3.0:1789395136.966674:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395136.966751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751040 00000100:00100000:2.0:1789395136.966761:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751040 00000100:00100000:2.0:1789395136.966820:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23543 00000100:00100000:2.0:1789395136.966831:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:18279:x1876316231751040:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395136.966852:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395136.966875:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316b306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.966949:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b30d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.966964:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b30d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.966977:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b30d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395136.967061:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00000004:00200000:2.0:1789395136.967066:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1789395136.967085:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b30d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.967108:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dea00/0xff35729af316b306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060c8 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.967129:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b30d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060c8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395136.967138:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3c90d5400) 00010000:00010000:2.0:1789395136.967141:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395136.967145:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395136.967216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231751040:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 387us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.967223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23543 00000100:00100000:2.0:1789395136.973427:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395136.973500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751168 00000100:00100000:0.0:1789395136.973510:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751168 00000100:00100000:0.0:1789395136.973566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5084 00000100:00100000:0.0:1789395136.973576:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231751168:12345-192.168.203.54@tcp:37:lfs.0 00000100:00100000:2.0:1789395136.987749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231751168:12345-192.168.203.54@tcp:37:lfs.0 Request processed in 14164us (14360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395136.987960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5084 00000100:00100000:2.0:1789395136.994561:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395136.994799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751296 00000100:00100000:1.0:1789395136.994807:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751296 00000100:00100000:1.0:1789395136.994877:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5085 00000100:00100000:1.0:1789395136.994885:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18279:x1876316231751296:12345-192.168.203.54@tcp:37:lfs.0 00000100:00100000:1.0:1789395137.001936:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18279:x1876316231751296:12345-192.168.203.54@tcp:37:lfs.0 Request processed in 7025us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.001954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5085 00000100:00100000:2.0:1789395137.024365:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.026370:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751424 00000100:00100000:0.0:1789395137.026662:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751424 00000100:00100000:1.0:1789395137.028145:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23544 00000100:00100000:1.0:1789395137.028158:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18279:x1876316231751424:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:1.0:1789395137.028238:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028254:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028267:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028281:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028288:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028295:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028349:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028358:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028366:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395137.028441:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028456:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028462:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028469:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028476:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028482:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.028486:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028493:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028504:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:1.0:1789395137.028507:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.028511:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028518:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b314 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028530:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028536:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028543:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028549:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.028552:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028557:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028563:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4c8e8dc00) 00010000:00010000:1.0:1789395137.028565:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.028568:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028574:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b31b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028586:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028591:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028597:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028602:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.028604:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028805:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028814:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:1.0:1789395137.028817:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.028820:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.028826:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.028901:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18279:x1876316231751424:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 745us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.028909:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23544 00000100:00080000:2.0:1789395137.029964:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395137.033988:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.034114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751680 00000100:00100000:3.0:1789395137.034123:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751680 00000100:00100000:3.0:1789395137.034179:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23545 00000100:00100000:3.0:1789395137.034189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18279:x1876316231751680:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395137.034209:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.034230:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060cf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.034339:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.034354:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.034365:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395137.034378:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1526:0x0]: returning size 2 00010000:00010000:3.0:1789395137.034795:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316b329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1526:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.034813:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.034822:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:3.0:1789395137.034825:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789395137.034828:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d000, rc 0) 00000100:00100000:3.0:1789395137.034886:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18279:x1876316231751680:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 698us (907us total) trans 4294983553 rc 0/0 00000100:00100000:3.0:1789395137.034893:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23545 00000100:00100000:0.0:1789395137.039203:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.039280:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751808 00000100:00100000:3.0:1789395137.039290:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751808 00000100:00080000:2.0:1789395137.039358:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789395137.039369:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5215 00000100:00100000:3.0:1789395137.039380:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231751808:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:2.0:1789395137.039502:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.039522:0:14651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 18 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.039531:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789395137.039536:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.039541:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.039577:0:14651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 18 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.039593:0:14651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 18 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.039611:0:14651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14651:1876316239697920:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395137.039702:0:14651:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.043079:0:14651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14651:1876316239697920:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395137.043110:0:14651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.044057:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.044468:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231751936 00000100:00100000:1.0:1789395137.044477:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231751936 00002000:00100000:1.0:1789395137.044528:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff89a4ffb48380 x1876316231751936/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395137.044538:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb48380 with x1876316231751936 ext(0->1) 00010000:00010000:1.0:1789395137.044551:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 19 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.044568:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 19 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395137.044575:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a4ffb48380 00000100:00100000:1.0:1789395137.044611:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:1.0:1789395137.044801:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231751936:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395137.046334:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789395137.046349:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789395137.046851:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231751936:12345-192.168.203.54@tcp:4:bash.0 Request processed in 2049us (2793us total) trans 4294969887 rc 0/0 00000100:00100000:2.0:1789395137.046862:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00002000:00100000:2.0:1789395137.046873:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff89a4ffb48380 x1876316231751936/t4294969887(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/448 e 0 to 0 dl 1789395148 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.046882:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb48380 with x1876316231751936 ext(0->1) 00010000:00010000:2.0:1789395137.046891:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 21 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.046910:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 21 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.046917:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a4ffb48380 00000100:00100000:0.0:1789395137.052724:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.052809:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752064 00000100:00100000:2.0:1789395137.052819:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752064 00010000:00010000:2.0:1789395137.052859:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 21 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.052899:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1574 00000100:00100000:2.0:1789395137.052909:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231752064:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.052945:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789395137.052964:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1789395137.052967:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1789395136 00002000:00010000:2.0:1789395137.052969:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1789395136 00002000:00010000:2.0:1789395137.052971:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789395137.052977:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 21 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.052991:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 21 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.053026:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316b1b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106066 expref: 21 pid: 14655 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.053042:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.053047:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.053054:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.053063:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.053097:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.053152:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231752064:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 245us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.053160:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1574 00010000:00010000:1.0:1789395137.054934:0:14651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.054953:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.054982:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.054991:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.054998:0:14651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.055005:0:14651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395137.055009:0:14651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.055018:0:14651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.055035:0:14651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.055048:0:14651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090fc5006/0xff35729af316b33e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.055143:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231751808:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 15761us (15943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.055152:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5215 00000100:00100000:0.0:1789395137.061762:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.061813:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.061892:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752320 00000100:00100000:2.0:1789395137.061902:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752320 00000100:00100000:2.0:1789395137.061973:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752192 00000100:00100000:2.0:1789395137.061977:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752192 00000100:00100000:2.0:1789395137.062023:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1365 00000100:00100000:2.0:1789395137.062033:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231752320:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:2.0:1789395137.062049:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.062072:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b2ff lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060c1 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.062089:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c875dd00) 00010000:00010000:2.0:1789395137.062100:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.062150:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231752320:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 118us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.062158:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1365 00000100:00100000:2.0:1789395137.062176:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1366 00000100:00100000:2.0:1789395137.062184:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2398:x1876316231752192:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:2.0:1789395137.062194:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.062208:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b30d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060c8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.062220:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3c90d5400) 00000100:00080000:1.0:1789395137.062222:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789395137.062223:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.062242:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2398:x1876316231752192:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 60us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.062249:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1366 00000100:00100000:3.0:1789395137.067270:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.069567:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.069649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752704 00000100:00100000:3.0:1789395137.069659:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752704 00000100:00100000:3.0:1789395137.069724:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:3.0:1789395137.069735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18279:x1876316231752704:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:3.0:1789395137.069789:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395137.069816:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b1a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210605f expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.069836:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:3.0:1789395137.069841:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395137.069880:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.069893:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.069904:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395137.069931:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:3.0:1789395137.069990:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698048:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.070041:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.070073:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.070221:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698048 00000100:00100000:0.0:1789395137.070226:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698048 00000100:00100000:0.0:1789395137.070265:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3407 00000100:00100000:0.0:1789395137.070272:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698048:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.070365:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698048:12345-0@lo:1000:mdt_io00_000.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.070373:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3407 00000100:00100000:3.0:1789395137.071962:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698048:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.072598:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698176:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1789395137.072657:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.072692:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.072714:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698176 00000100:00100000:3.0:1789395137.072719:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698176 00000100:00100000:3.0:1789395137.072766:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3408 00000100:00100000:3.0:1789395137.072774:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698176:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1789395137.074333:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698176:12345-0@lo:403:mdt_io00_000.0 Request processed in 1553us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.074345:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3408 00000100:00100000:1.0:1789395137.074428:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698176:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395137.074822:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752448 00000100:00100000:2.0:1789395137.074829:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752448 00000100:00100000:2.0:1789395137.074874:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1367 00000100:00100000:2.0:1789395137.074881:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:2397:x1876316231752448:12345-192.168.203.54@tcp:103:lfs.0 00010000:00010000:2.0:1789395137.074893:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.074915:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b2f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060ba expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.074948:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:2.0:1789395137.074953:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.074993:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:2397:x1876316231752448:12345-192.168.203.54@tcp:103:lfs.0 Request processed in 112us (7733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.074999:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1367 00000100:00100000:2.0:1789395137.075051:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.075072:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752960 00000100:00100000:2.0:1789395137.075076:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752960 00000100:00100000:2.0:1789395137.075108:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 400 00000100:00100000:2.0:1789395137.075114:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231752960:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395137.075145:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231752960:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.075151:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 400 00000100:00080000:2.0:1789395137.075168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395137.075207:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89ce300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698304:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.075242:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.075266:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.075281:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698304 00000100:00100000:1.0:1789395137.075285:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698304 00000100:00100000:1.0:1789395137.075319:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3409 00000100:00100000:1.0:1789395137.075326:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698304:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.076003:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698304:12345-0@lo:1000:mdt_io00_000.0 Request processed in 675us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.076010:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3409 00000100:00100000:1.0:1789395137.076044:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89ce300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698304:0@lo:1000:mdt_io00_000.0 00010000:00010000:1.0:1789395137.076102:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.076111:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.076124:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.076135:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89ce300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698432:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1789395137.076159:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.076183:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.076212:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698432 00000100:00100000:0.0:1789395137.076217:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698432 00000100:00100000:0.0:1789395137.076253:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410 00000100:00100000:0.0:1789395137.076260:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c89ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:6524:x1876316239698432:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1789395137.076269:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395137.076283:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b34c expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.076313:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.076323:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 4/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.076337:0:11908:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1789395137.076378:0:11908:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1789395137.076444:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.076453:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:0.0:1789395137.076456:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.076459:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.076467:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aac00, rc 0) 00000100:00100000:0.0:1789395137.076772:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c89ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239698432:12345-0@lo:101:mdt_io00_000.0 Request processed in 512us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.076778:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410 00000100:00100000:1.0:1789395137.080063:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89ce300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239698432:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395137.080088:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 4/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.080102:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 4/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.081042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.081174:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231752832 00000100:00100000:3.0:1789395137.081182:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231752832 00000100:00100000:3.0:1789395137.081234:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 437 00000100:00100000:3.0:1789395137.081243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231752832:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395137.081322:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231752832:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.081329:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 437 00010000:00010000:2.0:1789395137.082825:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.082844:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.082889:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.082896:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.082943:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e0e00/0xff35729af316b288 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b28f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.082963:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.082971:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.082989:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.082996:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.083012:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3dfe00/0xff35729af316b07b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395137.083025:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968498 is committed 00000001:00080000:2.0:1789395137.083040:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968496 is committed 00000020:00080000:2.0:1789395137.083053:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3c80b3240 refcount 2 committed 0 result 0 batchid 396 00000020:00080000:2.0:1789395137.083057:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c80b3c00 00000020:00080000:2.0:1789395137.083061:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].390 00000020:00080000:2.0:1789395137.083063:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a4efe92400 00000020:00080000:2.0:1789395137.083065:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].390 00000004:00080000:2.0:1789395137.083086:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000004:00080000:2.0:1789395137.083098:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000020:00080000:2.0:1789395137.083109:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 395 batchid updated 00000100:00100000:2.0:1789395137.083129:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395137.083145:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239698560:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1789395137.083196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.083236:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239698688:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1789395137.083260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789395137.083291:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 396 committed batchid 395 00000004:00080000:2.0:1789395137.083438:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca6cd9c0 with version 746 00000020:00080000:2.0:1789395137.083448:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 395 cancel update log [0x200000401:0x3:0x0].389: rc = 0 00000020:00080000:2.0:1789395137.083485:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 395 cancel update log [0x240000400:0x3:0x0].389: rc = 0 00000020:00080000:2.0:1789395137.083495:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 395 00000004:00080000:2.0:1789395137.083583:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 746 rpc_version 746 00000020:00100000:2.0:1789395137.083599:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395137.083605:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3ca20f800 x1876316239699200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395137.083620:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239699200:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395137.083650:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.083667:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.083680:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239698816:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1789395137.083705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.083738:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698816 00000100:00100000:2.0:1789395137.083744:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698816 00000100:00100000:2.0:1789395137.083791:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216 00000100:00100000:2.0:1789395137.083799:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239698816:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1789395137.083821:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2506 count 1 00010000:00010000:2.0:1789395137.083842:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.083861:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 18 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.083869:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789395137.083873:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395137.083877:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.083903:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 18 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.083917:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 18 pid: 14655 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.083939:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1876316239699328:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395137.083993:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00080000:2.0:1789395137.084011:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395137.084023:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239698944:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1789395137.084049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.084078:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698560 00000100:00100000:2.0:1789395137.084082:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698560 00000100:00100000:2.0:1789395137.084111:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698688 00000100:00100000:2.0:1789395137.084114:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698688 00000100:00100000:2.0:1789395137.084135:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1789395137.084142:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+23:3638:x1876316239698560:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1789395137.084152:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.084170:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316b28f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b288 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.084186:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff89a3c90d5b00) 00010000:00010000:2.0:1789395137.084195:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.084227:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+22:3638:x1876316239698560:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 85us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.084234:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1789395137.084251:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1789395137.084258:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239698688:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1789395137.084265:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.084276:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b082 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b07b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.084287:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff89a4df47a300) 00010000:00010000:2.0:1789395137.084294:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.084319:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239698688:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 63us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.084325:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1789395137.084362:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239698688:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1789395137.084413:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239698560:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1789395137.084438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239699200 00000100:00100000:2.0:1789395137.084441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239699200 00000100:00100000:2.0:1789395137.084465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3411 00000100:00100000:2.0:1789395137.084472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:7455:x1876316239699200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395137.084587:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239699200:12345-0@lo:1000:osp_up0-1.0 Request processed in 115us (936us total) trans 4294983554 rc 0/0 00000100:00100000:2.0:1789395137.084594:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3411 00000100:00100000:2.0:1789395137.084620:0:7455:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983552 gen 2 00000004:00080000:2.0:1789395137.084625:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983552 committed transno 4294983552 00000020:00080000:2.0:1789395137.084629:0:7455:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca6cda80 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:2.0:1789395137.084632:0:7455:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c7468000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca6cd3c0 00000020:00080000:2.0:1789395137.084635:0:7455:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].391 00000020:00080000:2.0:1789395137.084637:0:7455:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c7468300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c921c200 00000020:00080000:2.0:1789395137.084640:0:7455:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].391 00000100:00100000:2.0:1789395137.084681:0:7455:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a3ca20f800 x1876316239699200/t4294983554(4294983554) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395153 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789395137.084696:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239699200:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1789395137.084709:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 397 committed batchid 395 00000020:00080000:2.0:1789395137.084730:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 395 00000100:00100000:3.0:1789395137.085084:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239698944 00000100:00100000:3.0:1789395137.085089:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239698944 00000100:00100000:3.0:1789395137.085127:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5217 00000100:00100000:3.0:1789395137.085135:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239698944:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1789395137.085151:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2505 count 1 00010000:00010000:3.0:1789395137.085168:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.085184:0:14650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 18 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.085192:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789395137.085196:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395137.085201:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.085225:0:14650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 18 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.085240:0:14650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 18 pid: 8425 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.085251:0:14650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14650:1876316239699456:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395137.085305:0:14650:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789395137.085322:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789395137.085681:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085692:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085700:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085710:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.085715:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085722:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085735:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x391d5834 (ffff89a3ca363400) 00010000:00010000:0.0:1789395137.085738:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.085742:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085749:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d200/0xff35729af316af40 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085769:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085775:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085780:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085786:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.085789:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085795:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085806:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x84832a57 (ffff89a3ca363900) 00010000:00010000:0.0:1789395137.085809:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.085812:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085818:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316af78 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085830:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085836:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085841:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085846:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.085848:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085854:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085862:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xbc0ca3a9 (ffff89a3ca35f200) 00010000:00010000:0.0:1789395137.085864:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.085867:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085873:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316afb0 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085887:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085894:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085899:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085904:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.085908:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085913:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085929:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xb62e0cbf (ffff89a3ca363600) 00010000:00010000:0.0:1789395137.085932:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.085935:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085949:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316afe8 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085964:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085970:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085977:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085982:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.085985:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085991:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.085998:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0xdcc87686 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395137.086001:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.086003:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086009:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b020 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086023:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086029:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086034:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086038:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.086041:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086047:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086058:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x18618557 (ffff89a3ca363b00) 00010000:00010000:0.0:1789395137.086060:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.086063:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.086068:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316b058 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086707:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086717:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086724:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086729:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.086732:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086739:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086753:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3c90d5400) 00010000:00010000:1.0:1789395137.086755:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.086758:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086764:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316b296 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086780:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086786:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086792:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086797:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.086799:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086806:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086812:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:1.0:1789395137.086814:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.086820:0:3622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086831:0:3622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086840:0:3622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.086871:0:3622:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 9 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.086883:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3622:1876316239699584:0@lo:105: 00000100:00100000:1.0:1789395137.086945:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.086984:0:3622:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.087034:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239699584 00000100:00100000:3.0:1789395137.087041:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239699584 00000100:00100000:3.0:1789395137.087086:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1789395137.087094:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:3622:x1876316239699584:12345-0@lo:105: 00010000:00010000:3.0:1789395137.087105:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 5/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087114:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 5/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087124:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 5/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087131:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087139:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087147:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087173:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca0e0c00) 00000100:00100000:3.0:1789395137.087210:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:3622:x1876316239699584:12345-0@lo:105: Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.087217:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1789395137.087252:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c89cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3622:1876316239699584:0@lo:105: 00010000:00010000:3.0:1789395137.087269:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087277:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316b29d lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.087563:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.087573:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395137.087592:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.087626:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.087633:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.087642:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.087656:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239699712:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1789395137.087687:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.087714:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.087761:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239699712 00000100:00100000:3.0:1789395137.087766:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239699712 00000100:00100000:3.0:1789395137.087801:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:3.0:1789395137.087808:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6524:x1876316239699712:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1789395137.087822:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.087839:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b368 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087860:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b368 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087872:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b368 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.087879:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x391d5834 (ffff89a3c90d5600) 00010000:00010000:3.0:1789395137.087882:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.087885:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015000, rc 0) 00000100:00100000:3.0:1789395137.087930:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239699712:12345-0@lo:101:mdt_io00_000.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.087943:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:1.0:1789395137.088048:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968496 gen 2 00000004:00080000:1.0:1789395137.088054:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968482 committed transno 4294968496 00000004:00080000:1.0:1789395137.088067:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968491 committed transno 4294968496 00000004:00080000:1.0:1789395137.088077:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968492 committed transno 4294968496 00000004:00080000:1.0:1789395137.088084:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968493 committed transno 4294968496 00000004:00080000:1.0:1789395137.088091:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968494 committed transno 4294968496 00000004:00080000:1.0:1789395137.088098:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968495 committed transno 4294968496 00000004:00080000:1.0:1789395137.088104:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968496 committed transno 4294968496 00000100:00100000:1.0:1789395137.088114:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239699712:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395137.088128:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088137:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.088148:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.088166:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088175:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088183:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088196:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088203:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088209:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088251:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088262:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088292:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088328:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.088338:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 18 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.088354:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239699840:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395137.088545:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00010000:00010000:0.0:1789395137.099159:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@00000000b918b8fd x1876316239699840) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 18 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099188:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 18 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099213:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316b330 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060cf expref: 18 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.099228:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239699840:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395137.099248:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:0.0:1789395137.099253:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099261:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099268:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099286:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099307:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.099313:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.099505:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239699968:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.099559:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.099585:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.099768:0:14650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14650:1876316239699456:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395137.099784:0:14650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.099867:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1876316239699328:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395137.099884:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.099909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239699968 00000100:00100000:2.0:1789395137.099916:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239699968 00000100:00100000:2.0:1789395137.099981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3413 00000100:00100000:2.0:1789395137.099990:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239699968:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.100108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239699968:12345-0@lo:1000:mdt_io00_000.0 Request processed in 118us (547us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395137.100115:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3413 00000100:00100000:3.0:1789395137.100192:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239699968:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.100239:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700096:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.100267:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.100292:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.100567:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700096 00000100:00100000:2.0:1789395137.100572:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700096 00000100:00100000:2.0:1789395137.100607:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3414 00000100:00100000:2.0:1789395137.100614:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239700096:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.100674:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239700096:12345-0@lo:1000:mdt_io00_000.0 Request processed in 61us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.100682:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3414 00000100:00100000:3.0:1789395137.100779:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700096:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.100875:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700224:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.100899:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.100929:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.101006:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700224 00000100:00100000:0.0:1789395137.101011:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700224 00000100:00100000:0.0:1789395137.101046:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3415 00000100:00100000:0.0:1789395137.101053:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239700224:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.101121:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239700224:12345-0@lo:1000:mdt_io00_000.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.101129:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3415 00000100:00100000:1.0:1789395137.101194:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700224:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.101256:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700352:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.101285:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.101317:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.101482:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700352 00000100:00100000:3.0:1789395137.101486:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700352 00000100:00100000:3.0:1789395137.101518:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3416 00000100:00100000:3.0:1789395137.101524:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239700352:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.101576:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6524:x1876316239700352:12345-0@lo:1000:mdt_io00_000.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.101583:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3416 00000100:00100000:1.0:1789395137.101973:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700352:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.102044:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700480:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.102072:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.102097:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.102194:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700480 00000100:00100000:3.0:1789395137.102199:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700480 00000100:00100000:3.0:1789395137.102250:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3417 00000100:00100000:3.0:1789395137.102257:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1876316239700480:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1789395137.102335:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1876316239700480:12345-0@lo:1000:mdt_io00_000.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.102342:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3417 00000100:00100000:1.0:1789395137.102517:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700480:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1789395137.102855:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].405, 1240 off604888 00000040:00080000:1.0:1789395137.102910:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].403, 1320 off659368 00000100:00100000:1.0:1789395137.102955:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700608:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.102982:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.103008:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.103124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700608 00000100:00100000:0.0:1789395137.103129:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700608 00000100:00100000:0.0:1789395137.103158:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3418 00000100:00100000:0.0:1789395137.103167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6524:x1876316239700608:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.103273:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239700608:12345-0@lo:1000:mdt_io00_000.0 Request processed in 107us (290us total) trans 4294969888 rc 0/0 00000100:00100000:0.0:1789395137.103280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3418 00000100:00080000:2.0:1789395137.103421:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395137.103636:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239700608:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1789395137.103646:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca33ae40 with version 768 00000004:00080000:2.0:1789395137.103691:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 768 rpc_version 768 00000020:00100000:2.0:1789395137.103715:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395137.103722:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a501d04380 x1876316239700864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3320/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395137.103738:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239700864:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395137.103774:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.103798:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.103847:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700864 00000100:00100000:3.0:1789395137.103852:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700864 00000100:00100000:3.0:1789395137.103887:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3419 00000100:00100000:3.0:1789395137.103894:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239700864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395137.104240:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239700864:12345-0@lo:1000:osp_up1-0.0 Request processed in 345us (463us total) trans 4294968499 rc 0/0 00000100:00100000:3.0:1789395137.104248:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3419 00000100:00100000:2.0:1789395137.104591:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239700864:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1789395137.104659:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000214cf31d reply state 00000000c1590743 transno 4294983555 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104680:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104693:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:1.0:1789395137.104695:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1789395137.104699:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395137.104707:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104715:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104721:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104728:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104734:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.104739:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104747:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104756:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c8e8df00) 00010000:00010000:1.0:1789395137.104759:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.104763:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104769:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b376 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395137.104787:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000214cf31d reply state 00000000c1590743 transno 4294983555 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104796:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104802:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4c8e8d900) 00010000:00010000:1.0:1789395137.104804:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395137.104806:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1789395137.104809:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.104816:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104823:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104829:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104858:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395137.104863:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.104868:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104876:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.104889:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1789395137.104897:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104903:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104909:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104915:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.104926:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104933:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104949:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3c90d5700) 00010000:00010000:1.0:1789395137.104951:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.104955:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.104961:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316b345 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.105036:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18279:x1876316231752704:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 35301us (35474us total) trans 4294983555 rc 0/0 00000100:00100000:1.0:1789395137.105044:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00010000:00010000:2.0:1789395137.107196:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395137.107208:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.107219:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395137.107226:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.107236:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.107275:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.107282:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.107321:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.107330:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0c00/0xff35729af316b34c lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b353 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.107349:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.107351:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.107353:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.108747:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239700992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.108810:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.113199:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239700992 00000100:00100000:2.0:1789395137.113214:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239700992 00000100:00100000:2.0:1789395137.113284:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1789395137.114069:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3639:x1876316239700992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.114092:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.114117:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b353 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b34c expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.114138:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:2.0:1789395137.114149:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.114230:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239700992:12345-0@lo:103:ldlm_bl.0 Request processed in 938us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.114238:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1789395137.114588:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239700992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395137.115955:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.115997:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.116048:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.116116:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753344 00000100:00100000:0.0:1789395137.116125:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753344 00010000:00010000:0.0:1789395137.116160:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 19 pid: 8425 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.116207:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753216 00000100:00100000:0.0:1789395137.116210:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753216 00010000:00010000:0.0:1789395137.116226:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 19 pid: 14655 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.116247:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1575 00000100:00100000:0.0:1789395137.116257:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231753344:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395137.116268:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395137.116272:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 19 pid: 8425 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116280:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 19 pid: 8425 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116296:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316ae6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f94 expref: 19 pid: 8425 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116316:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395137.116319:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395137.116324:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116331:0:20671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116347:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395137.116380:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231753344:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 125us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.116409:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1575 00000100:00100000:0.0:1789395137.116444:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1576 00000100:00100000:0.0:1789395137.116449:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231753216:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395137.116457:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395137.116460:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 19 pid: 14655 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116467:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 19 pid: 14655 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116478:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f6d726c/0xff35729af316ae2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f7f expref: 19 pid: 14655 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116485:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395137.116487:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395137.116490:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116495:0:20671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.116504:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395137.116517:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231753216:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 68us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.116521:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1576 00010000:00010000:2.0:1789395137.116606:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.116616:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.116627:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.116635:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.116658:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395137.116822:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876316239698816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 33023us (33115us total) trans 4294969888 rc 0/0 00000100:00100000:2.0:1789395137.116830:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216 00000004:00080000:2.0:1789395137.116873:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20d180/2, rc 0, transno 4294969888 00000100:00100000:2.0:1789395137.116884:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239698816:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1789395137.116906:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753088 00000100:00100000:2.0:1789395137.116909:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753088 00000100:00100000:2.0:1789395137.116948:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23546 00000100:00100000:2.0:1789395137.116955:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18279:x1876316231753088:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:2.0:1789395137.117019:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117032:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117040:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117051:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117058:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117064:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117110:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117118:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117125:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.117169:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117180:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117185:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117190:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117197:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117207:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.117211:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117218:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117227:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35f300) 00010000:00010000:2.0:1789395137.117229:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.117234:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117240:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b38b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117255:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117261:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117266:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117271:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.117273:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117280:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117291:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a3ca35f400) 00010000:00010000:2.0:1789395137.117293:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.117296:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117301:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b392 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117312:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117318:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117323:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117327:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.117330:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117335:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117341:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:2.0:1789395137.117343:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.117345:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.117351:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.117583:0:14650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.117593:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.117600:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.117607:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.117624:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789395137.117750:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395137.117756:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117769:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395137.117772:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117779:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117792:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117800:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316b35a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117816:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395137.117820:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117826:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395137.117829:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117837:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117847:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117854:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016430204/0xff35729af316b361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.117866:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395137.117868:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395137.117870:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395137.117940:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18279:x1876316231753088:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 984us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.117947:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23546 00000100:00100000:3.0:1789395137.120427:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239698944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 35285us (36368us total) trans 4294969889 rc 0/0 00000100:00100000:3.0:1789395137.120442:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5217 00010000:00010000:3.0:1789395137.120477:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395137.120510:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20fb80/2, rc 0, transno 4294969889 00000100:00100000:2.0:1789395137.120531:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239698944:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1789395137.125864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.125957:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753600 00000100:00100000:2.0:1789395137.125968:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753600 00000100:00100000:2.0:1789395137.126025:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23547 00000100:00100000:2.0:1789395137.126035:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18279:x1876316231753600:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395137.126057:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.126082:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316b3a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060d6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.126194:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.126208:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.126220:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.126232:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1529:0x0]: returning size 3 00010000:00010000:2.0:1789395137.126347:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316b3a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1529:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.126366:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.126375:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:2.0:1789395137.126378:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789395137.126381:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:2.0:1789395137.126464:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18279:x1876316231753600:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 431us (608us total) trans 4294983556 rc 0/0 00000100:00100000:2.0:1789395137.126471:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23547 00000100:00100000:1.0:1789395137.137985:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.138071:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753728 00000100:00100000:3.0:1789395137.138081:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753728 00000100:00100000:3.0:1789395137.138140:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5218 00000100:00100000:3.0:1789395137.138150:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231753728:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:3.0:1789395137.138195:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.138215:0:14639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 18 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.138224:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789395137.138228:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395137.138233:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.138270:0:14639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 18 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.138286:0:14639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 18 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.138318:0:14639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14639:1876316239701120:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395137.138589:0:14639:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.152357:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.152595:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753856 00000100:00100000:2.0:1789395137.152604:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753856 00002000:00100000:2.0:1789395137.152655:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->2) req@ffff89a3cac41c00 x1876316231753856/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.152668:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac41c00 with x1876316231753856 ext(0->2) 00010000:00010000:2.0:1789395137.152678:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 19 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.152695:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 19 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.152703:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3cac41c00 00000100:00100000:2.0:1789395137.152748:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:2.0:1789395137.152757:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231753856:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395137.154042:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231753856:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1281us (1689us total) trans 4294969889 rc 0/0 00000100:00100000:2.0:1789395137.154052:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00002000:00100000:2.0:1789395137.154060:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->2) req@ffff89a3cac41c00 x1876316231753856/t4294969889(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/448 e 0 to 0 dl 1789395148 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.154070:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac41c00 with x1876316231753856 ext(0->2) 00010000:00010000:2.0:1789395137.154078:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 21 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.154092:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 21 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.154098:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a3cac41c00 00000100:00100000:3.0:1789395137.158151:0:14639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14639:1876316239701120:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395137.158180:0:14639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.158296:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.158642:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231753984 00000100:00100000:3.0:1789395137.158650:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231753984 00010000:00010000:3.0:1789395137.158684:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 21 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.158725:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1577 00000100:00100000:3.0:1789395137.158734:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2398:x1876316231753984:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395137.158749:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789395137.158766:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:3.0:1789395137.158769:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1789395137 00002000:00010000:3.0:1789395137.158771:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1789395137 00002000:00010000:3.0:1789395137.158773:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789395137.158779:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 21 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.158792:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 21 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.158822:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316b234 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106090 expref: 21 pid: 14638 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.158839:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395137.158843:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395137.158964:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.158975:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.159099:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395137.159157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231753984:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 424us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.159164:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1577 00010000:00010000:1.0:1789395137.160662:0:14639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160683:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160710:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160719:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160737:0:14639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160744:0:14639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395137.160748:0:14639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160756:0:14639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160771:0:14639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.160778:0:14639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f512852/0xff35729af316b3b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.160861:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231753728:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 22710us (22882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.160870:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5218 00000100:00100000:0.0:1789395137.166629:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.166722:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231754240 00000100:00100000:1.0:1789395137.166731:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231754240 00000100:00100000:1.0:1789395137.166794:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:1.0:1789395137.166806:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18279:x1876316231754240:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395137.166871:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395137.166897:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106089 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.166915:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:1.0:1789395137.166928:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395137.166953:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.166966:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.166976:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.166993:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:1.0:1789395137.167051:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701248:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.167103:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.167128:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.167232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239701248 00000100:00100000:0.0:1789395137.167237:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239701248 00000100:00100000:0.0:1789395137.167272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3420 00000100:00100000:0.0:1789395137.167280:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239701248:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.167374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239701248:12345-0@lo:1000:mdt_io00_002.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.167382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3420 00000100:00100000:2.0:1789395137.167503:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701248:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.168082:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701376:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395137.168120:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.168146:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.168266:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239701376 00000100:00100000:0.0:1789395137.168271:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239701376 00000100:00100000:0.0:1789395137.168306:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3421 00000100:00100000:0.0:1789395137.168312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239701376:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395137.171650:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239701376:12345-0@lo:403:mdt_io00_002.0 Request processed in 3330us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.171663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3421 00000100:00100000:0.0:1789395137.171743:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701376:0@lo:403:mdt_io00_002.0 00010000:00010000:0.0:1789395137.172838:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.172971:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.172987:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.173007:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701504:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1789395137.173050:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.173141:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.173189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239701504 00000100:00100000:3.0:1789395137.173196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239701504 00000100:00100000:3.0:1789395137.173276:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3422 00000100:00100000:3.0:1789395137.173285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239701504:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395137.173308:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.173325:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b3ca lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b3c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.173351:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b3ca lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b3c3 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.173368:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b3ca lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b3c3 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.173375:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.173378:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.173381:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015400, rc 0) 00000100:00100000:3.0:1789395137.173513:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6526:x1876316239701504:12345-0@lo:101:mdt_io00_002.0 Request processed in 228us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.173519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3422 00000100:00100000:2.0:1789395137.173984:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701504:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395137.174003:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.174013:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395137.174030:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:2.0:1789395137.174058:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.174068:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.174076:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.174089:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701632:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395137.174120:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.174188:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.174232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239701632 00000100:00100000:3.0:1789395137.174236:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239701632 00000100:00100000:0.0:1789395137.174505:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423 00000100:00100000:0.0:1789395137.174514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6526:x1876316239701632:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1789395137.174526:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395137.174540:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b3d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.174558:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b3d1 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.174570:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b3d1 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.174578:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x84832a57 (ffff89a4df47a200) 00010000:00010000:0.0:1789395137.174581:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.174583:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab800, rc 0) 00000100:00100000:0.0:1789395137.174617:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239701632:12345-0@lo:101:mdt_io00_002.0 Request processed in 104us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.174622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423 00000100:00100000:3.0:1789395137.174681:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701632:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395137.174692:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174701:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395137.174713:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1789395137.174728:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174736:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174744:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174760:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174767:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174774:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174821:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174833:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174841:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174885:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.174899:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 20 pid: 6511 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.174911:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239701760:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395137.174983:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00010000:00010000:1.0:1789395137.177948:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@00000000ddd6fd63 x1876316239701760) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 20 pid: 6511 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.177973:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 20 pid: 6511 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.177997:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316b3a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060d6 expref: 20 pid: 6511 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.178013:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239701760:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395137.178035:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:1.0:1789395137.178042:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.178051:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.178059:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.178078:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.178087:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.178094:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.178232:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701888:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.178283:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.178835:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.178906:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239701888 00000100:00100000:2.0:1789395137.178914:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239701888 00000100:00100000:2.0:1789395137.178992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3424 00000100:00100000:2.0:1789395137.179001:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239701888:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.179122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239701888:12345-0@lo:1000:mdt_io00_002.0 Request processed in 122us (837us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395137.179129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3424 00000100:00100000:1.0:1789395137.180310:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239701888:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.180402:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.180445:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.180466:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.180610:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239702016 00000100:00100000:2.0:1789395137.180617:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239702016 00000100:00100000:2.0:1789395137.180660:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3425 00000100:00100000:2.0:1789395137.180668:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239702016:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.180732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239702016:12345-0@lo:1000:mdt_io00_002.0 Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.180739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3425 00000100:00100000:1.0:1789395137.180818:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.180916:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702144:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.180951:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.181083:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.181543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239702144 00000100:00100000:0.0:1789395137.181549:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239702144 00000100:00100000:0.0:1789395137.181591:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3426 00000100:00100000:0.0:1789395137.181599:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239702144:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.181659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6526:x1876316239702144:12345-0@lo:1000:mdt_io00_002.0 Request processed in 60us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.181665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3426 00000100:00100000:1.0:1789395137.181747:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702144:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.181837:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702272:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.181865:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.181889:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.182143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239702272 00000100:00100000:0.0:1789395137.182148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239702272 00000100:00100000:0.0:1789395137.182196:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3427 00000100:00100000:0.0:1789395137.182203:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6526:x1876316239702272:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.182275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6526:x1876316239702272:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.182281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3427 00000100:00080000:1.0:1789395137.182434:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395137.182465:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702272:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1789395137.182800:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].406, 1264 off606152 00000040:00080000:1.0:1789395137.182850:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].404, 1344 off660712 00000100:00100000:1.0:1789395137.182878:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702400:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.182908:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.182935:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.183043:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239702400 00000100:00100000:0.0:1789395137.183048:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239702400 00000100:00100000:0.0:1789395137.183085:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428 00000100:00100000:0.0:1789395137.183093:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6526:x1876316239702400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.183193:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6526:x1876316239702400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 101us (284us total) trans 4294969890 rc 0/0 00000100:00100000:0.0:1789395137.183201:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428 00000100:00100000:1.0:1789395137.183565:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239702400:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1789395137.183575:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c80b3300 with version 769 00000004:00080000:3.0:1789395137.183667:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 769 rpc_version 769 00000020:00100000:3.0:1789395137.183692:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789395137.183699:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a6e680 x1876316239702656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789395137.183716:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239702656:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1789395137.183751:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.183776:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.183826:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239702656 00000100:00100000:0.0:1789395137.183831:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239702656 00000100:00100000:0.0:1789395137.183865:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3429 00000100:00100000:0.0:1789395137.183873:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239702656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395137.184286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239702656:12345-0@lo:1000:osp_up1-0.0 Request processed in 414us (533us total) trans 4294968500 rc 0/0 00000100:00100000:0.0:1789395137.184294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3429 00000100:00100000:3.0:1789395137.184585:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239702656:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1789395137.184658:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061d85530 reply state 00000000803524be transno 4294983557 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184680:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184689:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:1.0:1789395137.184692:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1789395137.184696:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395137.184704:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184711:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184718:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184724:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184729:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.184734:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184742:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184752:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5c00) 00010000:00010000:1.0:1789395137.184755:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.184759:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184765:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b3df lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395137.184784:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061d85530 reply state 00000000803524be transno 4294983557 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184793:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184799:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a3c90d5a00) 00010000:00010000:1.0:1789395137.184802:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395137.184804:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1789395137.184807:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.184814:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184822:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184830:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184856:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395137.184861:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.184866:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184874:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.184885:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1789395137.184892:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184898:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184904:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184909:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.184912:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184925:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184935:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c8e8df00) 00010000:00010000:1.0:1789395137.184937:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.184940:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.184945:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b3bc lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.185016:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18279:x1876316231754240:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 18210us (18405us total) trans 4294983557 rc 0/0 00000100:00100000:1.0:1789395137.185022:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00010000:00010000:3.0:1789395137.189008:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395137.189022:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.189034:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aae00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395137.189040:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395137.189050:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.189090:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.189096:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395137.189130:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.189138:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2aae00/0xff35729af316b3c3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b3ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.189159:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395137.189161:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395137.189163:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.189171:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395137.189190:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239702784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.189250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.189291:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239702784 00000100:00100000:3.0:1789395137.189309:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239702784 00000100:00100000:3.0:1789395137.189356:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1789395137.189365:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+14:3637:x1876316239702784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395137.189377:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789395137.189519:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:3.0:1789395137.189645:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b3ca lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b3c3 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.189660:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.189670:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395137.189751:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+13:3637:x1876316239702784:12345-0@lo:103:ldlm_bl.0 Request processed in 387us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.189759:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1789395137.190057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231754368 00000100:00100000:2.0:1789395137.190062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231754368 00000100:00100000:2.0:1789395137.190097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23548 00000100:00100000:2.0:1789395137.190104:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18279:x1876316231754368:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:2.0:1789395137.190164:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190177:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190185:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190197:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190204:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190209:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190260:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190269:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190276:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.190339:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190353:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190364:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190371:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190377:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190496:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.190501:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190509:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190518:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35f300) 00010000:00010000:2.0:1789395137.190520:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.190523:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190529:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316b3f4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190543:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190548:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190554:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190559:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.190561:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190566:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190572:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395137.190573:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.190576:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190580:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b3fb lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190588:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190593:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190598:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190602:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.190604:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190609:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190619:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:2.0:1789395137.190621:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.190624:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.190629:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316b402 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.190685:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18279:x1876316231754368:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 580us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.190692:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23548 00000100:00100000:3.0:1789395137.194134:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.194219:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231754624 00000100:00100000:2.0:1789395137.194229:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231754624 00000100:00100000:2.0:1789395137.194294:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23549 00000100:00100000:2.0:1789395137.194314:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18279:x1876316231754624:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395137.194336:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.194358:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b409 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060dd expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.194491:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.194505:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.194515:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.194527:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1527:0x0]: returning size 2 00010000:00010000:2.0:1789395137.194626:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b409 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1527:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 24 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.194646:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 23 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.194655:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:2.0:1789395137.194658:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789395137.194661:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfc00, rc 0) 00000100:00100000:2.0:1789395137.194722:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18279:x1876316231754624:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 409us (595us total) trans 4294983558 rc 0/0 00000100:00100000:2.0:1789395137.194731:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23549 00000100:00100000:1.0:1789395137.194996:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239702784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.199952:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.200061:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231754752 00000100:00100000:1.0:1789395137.200071:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231754752 00000100:00100000:1.0:1789395137.200128:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5219 00000100:00100000:1.0:1789395137.200140:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231754752:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:1.0:1789395137.200183:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.200203:0:14652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 19 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.200211:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789395137.200226:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789395137.200231:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.200267:0:14652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 19 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.200281:0:14652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 19 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.200306:0:14652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14652:1876316239702912:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395137.200508:0:14652:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.205162:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.205235:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231754880 00000100:00100000:2.0:1789395137.205245:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231754880 00002000:00100000:2.0:1789395137.205294:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff89a4d8355f80 x1876316231754880/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.205316:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4d8355f80 with x1876316231754880 ext(0->1) 00010000:00010000:2.0:1789395137.205325:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 20 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.205342:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 20 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.205350:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a4d8355f80 00000100:00100000:2.0:1789395137.205413:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:2.0:1789395137.205425:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231754880:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395137.206104:0:14652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14652:1876316239702912:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395137.206129:0:14652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.206557:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231754880:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1133us (1399us total) trans 4294969891 rc 0/0 00000100:00100000:2.0:1789395137.206566:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00002000:00100000:2.0:1789395137.206575:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff89a4d8355f80 x1876316231754880/t4294969891(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/448 e 0 to 0 dl 1789395148 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.206584:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4d8355f80 with x1876316231754880 ext(0->1) 00010000:00010000:2.0:1789395137.206591:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 22 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.206604:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 22 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.206612:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a4d8355f80 00000100:00100000:3.0:1789395137.211570:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.211746:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231755008 00000100:00100000:2.0:1789395137.211756:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231755008 00010000:00010000:2.0:1789395137.211795:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 22 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.211843:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1578 00000100:00100000:2.0:1789395137.211861:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231755008:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.211876:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789395137.211893:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1789395137.211896:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1789395137 00002000:00010000:2.0:1789395137.211898:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1789395137 00002000:00010000:2.0:1789395137.211901:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789395137.211907:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 22 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.211931:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 22 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.211954:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316b1e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106074 expref: 22 pid: 14650 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.211969:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.211973:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.211979:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.211988:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.212108:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.212166:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231755008:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 307us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.212175:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1578 00010000:00010000:1.0:1789395137.213700:0:14652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213717:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213749:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213757:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213764:0:14652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213771:0:14652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395137.213775:0:14652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213784:0:14652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213800:0:14652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.213808:0:14652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316b41e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.213898:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231754752:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 13757us (13952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.213910:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5219 00000100:00100000:3.0:1789395137.218818:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.219071:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231755264 00000100:00100000:1.0:1789395137.219080:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231755264 00000100:00100000:1.0:1789395137.219141:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:1.0:1789395137.219152:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18279:x1876316231755264:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395137.219206:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395137.219232:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b1d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210606d expref: 23 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.219251:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:1.0:1789395137.219255:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395137.219280:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.219293:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.219315:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.219333:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:1.0:1789395137.219380:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703040:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.219456:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.219493:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.219554:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703040 00000100:00100000:2.0:1789395137.219560:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703040 00000100:00100000:2.0:1789395137.219599:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3430 00000100:00100000:2.0:1789395137.219606:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239703040:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.219702:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239703040:12345-0@lo:1000:mdt_io00_000.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.219713:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3430 00000100:00100000:1.0:1789395137.220110:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703040:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.220763:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703168:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1789395137.220808:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.220836:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.225367:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703168 00000100:00100000:2.0:1789395137.225406:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703168 00000100:00100000:2.0:1789395137.225470:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431 00000100:00100000:2.0:1789395137.225480:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239703168:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395137.228493:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239703168:12345-0@lo:403:mdt_io00_000.0 Request processed in 3007us (7677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.228505:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1789395137.228678:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703168:0@lo:403:mdt_io00_000.0 00010000:00010000:0.0:1789395137.230017:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.230031:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.230040:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.230061:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703296:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1789395137.230107:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.230184:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.230225:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703296 00000100:00100000:2.0:1789395137.230232:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703296 00000100:00100000:2.0:1789395137.230311:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3432 00000100:00100000:2.0:1789395137.230320:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6524:x1876316239703296:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395137.230334:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.230350:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b433 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b42c expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.230376:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b433 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b42c expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.230518:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b433 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b42c expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.230528:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395137.230599:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.230604:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395137.230689:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:6524:x1876316239703296:12345-0@lo:101:mdt_io00_000.0 Request processed in 370us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.230700:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3432 00000100:00100000:1.0:1789395137.230916:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703296:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395137.230944:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.230954:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.230970:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.230995:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231002:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231009:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.231022:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703424:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1789395137.231052:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.231117:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.231152:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703424 00000100:00100000:2.0:1789395137.231157:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703424 00000100:00100000:2.0:1789395137.231191:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3433 00000100:00100000:2.0:1789395137.231198:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:6524:x1876316239703424:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395137.231206:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.231216:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b43a expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.231232:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b43a expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.231241:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b43a expref: 15 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.231248:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x18618557 (ffff89a3ca35f300) 00010000:00010000:2.0:1789395137.231251:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.231253:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfe00, rc 0) 00000100:00100000:2.0:1789395137.231288:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703424:12345-0@lo:101:mdt_io00_000.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.231294:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3433 00000100:00100000:1.0:1789395137.231433:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703424:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395137.231445:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231454:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.231471:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.231487:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231496:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231504:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231516:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231524:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231541:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231585:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231598:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 22 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231606:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231630:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 22 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.231648:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 22 pid: 7813 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.231659:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239703552:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395137.231725:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3480 going to sleep for 11 seconds 00010000:00010000:1.0:1789395137.235194:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@000000005bf493f5 x1876316239703552) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 22 pid: 7813 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235218:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 22 pid: 7813 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235241:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b410 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060dd expref: 22 pid: 7813 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.235257:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239703552:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395137.235279:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:1.0:1789395137.235284:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235292:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235370:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235504:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235514:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.235519:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.235720:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703680:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.235769:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.235832:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.235872:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703680 00000100:00100000:0.0:1789395137.235879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703680 00000100:00100000:0.0:1789395137.235939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434 00000100:00100000:0.0:1789395137.235949:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703680:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.236147:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703680:12345-0@lo:1000:mdt_io00_000.0 Request processed in 199us (377us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395137.236155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434 00000100:00100000:1.0:1789395137.236206:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703680:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.236245:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703808:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.236268:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.236419:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.238524:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703808 00000100:00100000:0.0:1789395137.238537:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703808 00000100:00100000:0.0:1789395137.238724:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3435 00000100:00100000:0.0:1789395137.238734:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703808:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.238852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703808:12345-0@lo:1000:mdt_io00_000.0 Request processed in 119us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.238865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3435 00000100:00100000:1.0:1789395137.238950:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703808:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.239077:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703936:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.239113:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.239195:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.239257:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239703936 00000100:00100000:2.0:1789395137.239262:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239703936 00000100:00100000:2.0:1789395137.239307:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3436 00000100:00100000:2.0:1789395137.239315:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703936:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.239368:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6524:x1876316239703936:12345-0@lo:1000:mdt_io00_000.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.239377:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3436 00000100:00100000:1.0:1789395137.239598:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239703936:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.239687:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239704064:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.239716:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.239738:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.239782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239704064 00000100:00100000:0.0:1789395137.239787:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239704064 00000100:00100000:0.0:1789395137.239820:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3437 00000100:00100000:0.0:1789395137.239827:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239704064:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.239893:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239704064:12345-0@lo:1000:mdt_io00_000.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.239900:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3437 00000100:00100000:1.0:1789395137.239977:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239704064:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1789395137.240484:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].407, 1264 off607416 00000040:00080000:1.0:1789395137.240538:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].405, 1344 off662056 00000100:00100000:1.0:1789395137.240562:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239704192:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.240589:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.240603:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.240770:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239704192 00000100:00100000:0.0:1789395137.240775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239704192 00000100:00100000:0.0:1789395137.240808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3438 00000100:00100000:0.0:1789395137.240814:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239704192:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.240909:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6524:x1876316239704192:12345-0@lo:1000:mdt_io00_000.0 Request processed in 95us (318us total) trans 4294969892 rc 0/0 00000100:00100000:0.0:1789395137.240916:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3438 00000100:00100000:1.0:1789395137.241040:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239704192:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1789395137.241051:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c80b3900 with version 770 00000004:00080000:2.0:1789395137.241104:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 770 rpc_version 770 00000020:00100000:2.0:1789395137.241126:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395137.241133:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a501d06300 x1876316239704448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395137.241148:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239704448:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395137.241178:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.241200:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.241247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239704448 00000100:00100000:0.0:1789395137.241251:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239704448 00000100:00100000:0.0:1789395137.241282:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3439 00000100:00100000:0.0:1789395137.241288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239704448:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395137.241764:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7874:x1876316239704448:12345-0@lo:1000:osp_up1-0.0 Request processed in 474us (584us total) trans 4294968501 rc 0/0 00000100:00100000:0.0:1789395137.241772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3439 00000100:00100000:1.0:1789395137.241861:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239704448:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1789395137.241977:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddd6fd63 reply state 00000000f0fd0800 transno 4294983559 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.241997:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242008:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:0.0:1789395137.242011:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1789395137.242014:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395137.242023:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242031:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242037:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242045:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242051:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.242056:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242064:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242074:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c8e8dc00) 00010000:00010000:0.0:1789395137.242076:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.242080:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242087:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b448 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395137.242105:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddd6fd63 reply state 00000000f0fd0800 transno 4294983559 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242114:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242120:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c8e8d800) 00010000:00010000:0.0:1789395137.242123:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395137.242125:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1789395137.242129:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.242136:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242145:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242152:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242176:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395137.242180:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.242185:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242192:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395137.242204:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:0.0:1789395137.242211:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242218:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242224:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242230:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.242233:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242239:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242247:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c8e8df00) 00010000:00010000:0.0:1789395137.242250:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.242253:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.242260:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b425 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242559:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395137.242565:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242572:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395137.242577:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.242585:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242612:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242619:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.242639:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242646:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2ab600/0xff35729af316b42c lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b433 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242665:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.242666:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.242668:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395137.242674:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395137.242688:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239704576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395137.242725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.242760:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239704576 00000100:00100000:2.0:1789395137.242765:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239704576 00000100:00100000:2.0:1789395137.242803:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1789395137.242810:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+16:3636:x1876316239704576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.242822:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.242839:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b433 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b42c expref: 16 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.242850:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395137.242857:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.242885:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+15:3636:x1876316239704576:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.242891:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1789395137.242935:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239704576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395137.242985:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18279:x1876316231755264:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 23834us (24175us total) trans 4294983559 rc 0/0 00000100:00100000:0.0:1789395137.242993:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:2.0:1789395137.247198:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.247289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231755392 00000100:00100000:3.0:1789395137.247370:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231755392 00000100:00100000:3.0:1789395137.247655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23550 00000100:00100000:3.0:1789395137.247666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3d8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18279:x1876316231755392:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:3.0:1789395137.247746:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247766:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247777:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247791:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247798:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247805:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247870:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247879:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247886:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395137.247944:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247958:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247963:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247972:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247978:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247984:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.247988:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.247996:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248008:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.248011:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.248016:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248022:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b45d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248038:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248043:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248049:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248053:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.248057:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248062:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248069:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395137.248071:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.248074:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248080:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b464 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248092:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248098:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248104:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248109:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.248112:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248117:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248124:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:3.0:1789395137.248127:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.248130:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.248135:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b46b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.248241:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3d8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18279:x1876316231755392:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 576us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.248249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23550 00000100:00100000:0.0:1789395137.253361:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.253493:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231755648 00000100:00100000:3.0:1789395137.253503:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231755648 00000100:00100000:3.0:1789395137.253589:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23551 00000100:00100000:3.0:1789395137.253599:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18279:x1876316231755648:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395137.253619:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.253641:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316b472 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060e4 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.253748:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.253763:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.253774:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395137.253786:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1525:0x0]: returning size 2 00010000:00010000:3.0:1789395137.253905:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316b472 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1525:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 26 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.253935:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 25 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.253944:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:3.0:1789395137.253948:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789395137.253952:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014e00, rc 0) 00000100:00100000:3.0:1789395137.254010:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231755648:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 412us (722us total) trans 4294983560 rc 0/0 00000100:00100000:3.0:1789395137.254018:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23551 00000100:00100000:0.0:1789395137.258575:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.258754:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231755776 00000100:00100000:1.0:1789395137.258765:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231755776 00000100:00100000:1.0:1789395137.258821:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5220 00000100:00100000:1.0:1789395137.258832:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231755776:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:1.0:1789395137.258874:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.258894:0:14651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 20 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.258903:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789395137.258907:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789395137.258912:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.258957:0:14651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 20 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.258971:0:14651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 20 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.258990:0:14651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14651:1876316239704704:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395137.259058:0:14651:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.263066:0:14651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14651:1876316239704704:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395137.263096:0:14651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.264811:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.265053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231755904 00000100:00100000:2.0:1789395137.265063:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231755904 00002000:00100000:2.0:1789395137.265112:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff89a4ffb4bb80 x1876316231755904/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.265123:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb4bb80 with x1876316231755904 ext(0->1) 00010000:00010000:2.0:1789395137.265132:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 21 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.265149:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 21 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.265158:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a4ffb4bb80 00000100:00100000:2.0:1789395137.265191:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:2.0:1789395137.265201:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231755904:12345-192.168.203.54@tcp:4:bash.0 00010000:00010000:0.0:1789395137.266010:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395137.266633:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2396:x1876316231755904:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1429us (1822us total) trans 4294969893 rc 0/0 00000100:00100000:2.0:1789395137.266644:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00002000:00100000:2.0:1789395137.266653:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff89a4ffb4bb80 x1876316231755904/t4294969893(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/448 e 0 to 0 dl 1789395148 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.266663:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb4bb80 with x1876316231755904 ext(0->1) 00010000:00010000:2.0:1789395137.266671:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 23 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.266687:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 23 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.266694:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89a4ffb4bb80 00000100:00100000:2.0:1789395137.270644:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.270730:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231756032 00000100:00100000:3.0:1789395137.270739:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231756032 00010000:00010000:3.0:1789395137.270778:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 23 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.270826:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1579 00000100:00100000:3.0:1789395137.270836:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2397:x1876316231756032:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395137.270853:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789395137.270870:0:20671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1789395137.270874:0:20671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1789395136 00002000:00010000:3.0:1789395137.270876:0:20671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1789395136 00002000:00010000:3.0:1789395137.270879:0:20671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789395137.270885:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 23 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.270898:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 23 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.270929:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc66c3a4/0xff35729af316b18c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106058 expref: 23 pid: 8427 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.270947:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395137.270952:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395137.270957:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.270966:0:20671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.270998:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395137.271052:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2397:x1876316231756032:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 217us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.271060:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1579 00010000:00010000:2.0:1789395137.271164:0:14651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271179:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271200:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271208:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271215:0:14651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271221:0:14651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395137.271225:0:14651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271235:0:14651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271249:0:14651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.271256:0:14651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b487 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.271325:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231755776:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 12494us (12760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.271333:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5220 00000100:00100000:0.0:1789395137.278271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.278369:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231756288 00000100:00100000:1.0:1789395137.278379:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231756288 00000100:00100000:1.0:1789395137.278480:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:1.0:1789395137.278489:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231756288:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395137.278541:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395137.278567:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316b17e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106051 expref: 25 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.278585:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:1.0:1789395137.278590:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395137.278734:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.278749:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.278759:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.278778:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:1.0:1789395137.278831:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239704832:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.278883:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.278977:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.279083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239704832 00000100:00100000:0.0:1789395137.279088:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239704832 00000100:00100000:0.0:1789395137.279127:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3440 00000100:00100000:0.0:1789395137.279136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239704832:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.279229:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239704832:12345-0@lo:1000:mdt_io00_002.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.279237:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3440 00000100:00100000:1.0:1789395137.279337:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239704832:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.285375:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239704960:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1789395137.285474:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.285523:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.285758:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239704960 00000100:00100000:2.0:1789395137.285766:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239704960 00000100:00100000:2.0:1789395137.285827:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3441 00000100:00100000:2.0:1789395137.285837:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239704960:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395137.288001:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239704960:12345-0@lo:403:mdt_io00_002.0 Request processed in 2158us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.288014:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3441 00000100:00100000:1.0:1789395137.288126:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239704960:0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1789395137.288898:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.288911:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.288930:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.288950:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705088:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1789395137.288988:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.289022:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.289128:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705088 00000100:00100000:2.0:1789395137.289135:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705088 00000100:00100000:2.0:1789395137.289178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3442 00000100:00100000:2.0:1789395137.289186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6526:x1876316239705088:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395137.289203:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.289220:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b49c lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b495 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.289247:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b49c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b495 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.289261:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b49c lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b495 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.289269:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395137.289272:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.289276:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395137.289317:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6526:x1876316239705088:12345-0@lo:101:mdt_io00_002.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.289323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3442 00000100:00100000:1.0:1789395137.289459:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705088:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395137.289473:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289484:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.289499:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.289523:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289530:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289538:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.289550:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705216:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1789395137.289573:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.289597:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.289700:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705216 00000100:00100000:3.0:1789395137.289705:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705216 00000100:00100000:3.0:1789395137.289732:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1789395137.289739:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:6526:x1876316239705216:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395137.289747:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.289759:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b4a3 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.289775:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b4a3 expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.289785:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b4a3 expref: 17 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.289798:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xbc0ca3a9 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395137.289800:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.289803:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:3.0:1789395137.289837:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705216:12345-0@lo:101:mdt_io00_002.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.289843:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:1.0:1789395137.289901:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705216:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395137.289913:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289930:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.289942:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.289958:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289966:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289974:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289986:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.289997:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.290004:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.290045:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.290056:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 24 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.290064:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.290087:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 24 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.290101:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 24 pid: 10512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.290113:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239705344:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395137.290216:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcd840 going to sleep for 11 seconds 00010000:00010000:1.0:1789395137.295744:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@000000004e161bb4 x1876316239705344) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 24 pid: 10512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295769:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 24 pid: 10512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295794:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b479 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060e4 expref: 24 pid: 10512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.295810:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239705344:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395137.295830:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:1.0:1789395137.295835:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295844:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295852:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295873:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295882:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.295887:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.296036:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705472:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.296087:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.296122:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.296262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705472 00000100:00100000:2.0:1789395137.296269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705472 00000100:00100000:2.0:1789395137.296325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:2.0:1789395137.296334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705472:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.296493:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705472:12345-0@lo:1000:mdt_io00_002.0 Request processed in 159us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395137.296500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:1.0:1789395137.296596:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705472:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.296752:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705600:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.296778:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.296797:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.296819:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705600 00000100:00100000:3.0:1789395137.296825:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705600 00000100:00100000:3.0:1789395137.296856:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:3.0:1789395137.296864:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705600:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395137.296929:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705600:12345-0@lo:1000:mdt_io00_002.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.296937:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1789395137.296960:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705600:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.297051:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705728:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.297076:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.297097:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fedcdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.297197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705728 00000100:00100000:3.0:1789395137.297202:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705728 00000100:00100000:3.0:1789395137.297229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446 00000100:00100000:3.0:1789395137.297235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705728:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395137.297300:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6526:x1876316239705728:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.297307:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446 00000100:00100000:1.0:1789395137.297458:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705728:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.297541:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705856:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.297569:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.297593:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.297626:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705856 00000100:00100000:3.0:1789395137.297630:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705856 00000100:00100000:3.0:1789395137.297663:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447 00000100:00100000:3.0:1789395137.297669:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239705856:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395137.297724:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239705856:12345-0@lo:1000:mdt_io00_002.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.297732:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447 00000100:00100000:1.0:1789395137.298553:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705856:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1789395137.298964:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].408, 1000 off608416 00000040:00080000:1.0:1789395137.299015:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].406, 1080 off663136 00000100:00100000:1.0:1789395137.299044:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705984:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.299081:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.299107:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.299133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239705984 00000100:00100000:3.0:1789395137.299143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239705984 00000100:00100000:3.0:1789395137.299172:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1789395137.299183:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239705984:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395137.299502:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239705984:12345-0@lo:1000:mdt_io00_002.0 Request processed in 321us (419us total) trans 4294969894 rc 0/0 00000100:00100000:3.0:1789395137.299509:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3448 00000100:00100000:1.0:1789395137.299879:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239705984:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1789395137.299888:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4fedcd840 with version 771 00000004:00080000:2.0:1789395137.300007:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 771 rpc_version 771 00000020:00100000:2.0:1789395137.300031:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395137.300039:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d7800 x1876316239706240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2568/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395137.300055:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239706240:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395137.300090:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.300138:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.300177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239706240 00000100:00100000:0.0:1789395137.300182:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239706240 00000100:00100000:0.0:1789395137.300223:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3449 00000100:00100000:0.0:1789395137.300232:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:7874:x1876316239706240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395137.305581:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:7874:x1876316239706240:12345-0@lo:1000:osp_up1-0.0 Request processed in 5341us (5480us total) trans 4294968502 rc 0/0 00000100:00100000:0.0:1789395137.305596:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3449 00000100:00100000:2.0:1789395137.309455:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239706240:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1789395137.309731:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfb80399 reply state 0000000022e71e0a transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309754:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309763:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:1.0:1789395137.309767:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1789395137.309771:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395137.309780:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309787:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309794:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309801:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309808:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.309812:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309819:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309829:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:1.0:1789395137.309831:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.309835:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309841:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316b4b1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395137.309861:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfb80399 reply state 0000000022e71e0a transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309869:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309875:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3ca363e00) 00010000:00010000:1.0:1789395137.309877:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395137.309879:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1789395137.309883:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.309892:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309907:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309914:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309945:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395137.309950:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1789395137.309955:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309963:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395137.309977:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1789395137.309984:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309990:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.309996:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.310002:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395137.310005:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.310011:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.310019:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4c8e8df00) 00010000:00010000:1.0:1789395137.310022:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.310025:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.310030:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316b48e lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.310120:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231756288:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 31629us (31855us total) trans 4294983561 rc 0/0 00000100:00100000:1.0:1789395137.310128:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00010000:00010000:3.0:1789395137.310214:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395137.310221:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.310229:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395137.310234:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395137.310242:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.310275:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.310282:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395137.310309:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.310317:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e0000/0xff35729af316b495 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b49c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.310339:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395137.310341:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395137.310342:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.310350:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395137.310362:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239706368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.310447:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.310548:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239706368 00000100:00100000:0.0:1789395137.310555:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239706368 00000100:00100000:0.0:1789395137.310605:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1789395137.310682:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3639:x1876316239706368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395137.310697:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395137.310714:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316b49c lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b495 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.310727:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca35fe00) 00010000:00010000:0.0:1789395137.310734:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395137.310768:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3639:x1876316239706368:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.310774:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1789395137.310829:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239706368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395137.316500:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.316924:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231756416 00000100:00100000:3.0:1789395137.316935:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231756416 00000100:00100000:3.0:1789395137.316994:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23552 00000100:00100000:3.0:1789395137.317006:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231756416:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:3.0:1789395137.317084:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317102:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317115:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317130:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317137:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317144:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317198:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317207:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317214:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395137.317259:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317273:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317279:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317285:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317292:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317810:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.317815:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317824:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317837:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.317840:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.317845:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317852:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b4c6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317874:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317881:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317887:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317892:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.317895:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317902:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317910:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a3c90d5900) 00010000:00010000:3.0:1789395137.317912:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.317915:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317932:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4cd lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317944:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317950:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317956:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317961:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.317963:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317969:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317976:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:3.0:1789395137.317978:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.317981:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.317986:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.318061:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231756416:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 1056us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.318069:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23552 00000100:00100000:0.0:1789395137.328145:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.328333:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231756672 00000100:00100000:3.0:1789395137.328344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231756672 00000100:00100000:3.0:1789395137.328436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23553 00000100:00100000:3.0:1789395137.328618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:18279:x1876316231756672:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395137.328642:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.328663:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060eb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.328770:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.328783:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.328794:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395137.328807:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1524:0x0]: returning size 2 00010000:00010000:3.0:1789395137.330483:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b4db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1524:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.330510:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.330520:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:3.0:1789395137.330523:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789395137.330526:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:3.0:1789395137.330596:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231756672:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 1982us (2460us total) trans 4294983562 rc 0/0 00000100:00100000:3.0:1789395137.333236:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23553 00000100:00100000:3.0:1789395137.334007:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.337017:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231756800 00000100:00100000:2.0:1789395137.337031:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231756800 00000100:00100000:2.0:1789395137.337103:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5221 00000100:00100000:2.0:1789395137.337114:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231756800:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:2.0:1789395137.337161:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.337181:0:14655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 18 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.337191:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789395137.337195:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.337200:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.337234:0:14655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 18 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.337248:0:14655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 18 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.337262:0:14655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14655:1876316239706496:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395137.337347:0:14655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.343494:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.344908:0:14655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14655:1876316239706496:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395137.344947:0:14655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.345006:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231756928 00000100:00100000:3.0:1789395137.345016:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231756928 00002000:00100000:3.0:1789395137.345075:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff89a4ffb48a80 x1876316231756928/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395137.345091:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb48a80 with x1876316231756928 ext(0->1) 00010000:00010000:3.0:1789395137.345100:0:20964:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 19 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.345116:0:20964:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 19 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395137.345124:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a4ffb48a80 00000100:00100000:3.0:1789395137.345160:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:3.0:1789395137.345170:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231756928:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395137.347261:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2395:x1876316231756928:12345-192.168.203.54@tcp:4:bash.0 Request processed in 2083us (3766us total) trans 4294969890 rc 0/0 00000100:00100000:2.0:1789395137.347272:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00002000:00100000:2.0:1789395137.347281:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff89a4ffb48a80 x1876316231756928/t4294969890(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/448 e 0 to 0 dl 1789395148 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.347291:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb48a80 with x1876316231756928 ext(0->1) 00010000:00010000:2.0:1789395137.347313:0:20964:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 21 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.347332:0:20964:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 21 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395137.347339:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a4ffb48a80 00000100:00100000:0.0:1789395137.366354:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.366470:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231757056 00000100:00100000:2.0:1789395137.366479:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231757056 00010000:00010000:2.0:1789395137.366527:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 21 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.366571:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1580 00000100:00100000:2.0:1789395137.366581:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2398:x1876316231757056:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.366596:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789395137.366625:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1789395137.366628:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1789395136 00002000:00010000:2.0:1789395137.366631:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1789395136 00002000:00010000:2.0:1789395137.366633:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789395137.366639:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 21 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.366653:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 21 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.366680:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316b162 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa445840210604a expref: 21 pid: 14652 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.366697:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.366702:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.366708:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.366717:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.366748:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.366841:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231757056:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 262us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.366849:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1580 00010000:00010000:0.0:1789395137.367035:0:14655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367046:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367066:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367074:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367083:0:14655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367091:0:14655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395137.367095:0:14655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367104:0:14655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367116:0:14655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.367130:0:14655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033b9fcd7/0xff35729af316b4f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.367174:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231756800:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 30062us (33169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.367182:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5221 00000100:00100000:1.0:1789395137.375488:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.375634:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231757312 00000100:00100000:0.0:1789395137.375645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231757312 00000100:00100000:0.0:1789395137.375743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:0.0:1789395137.375754:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231757312:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:0.0:1789395137.375806:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395137.375831:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106043 expref: 27 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.375850:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395137.375855:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395137.375883:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.375905:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.375915:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395137.375943:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:0.0:1789395137.375992:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239706624:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.376040:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.376075:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.376124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239706624 00000100:00100000:1.0:1789395137.376128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239706624 00000100:00100000:1.0:1789395137.376161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450 00000100:00100000:1.0:1789395137.376168:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239706624:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.376256:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239706624:12345-0@lo:1000:mdt_io00_000.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.376264:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450 00000100:00100000:2.0:1789395137.376355:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239706624:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.377104:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239706752:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1789395137.377143:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.377168:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.377222:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239706752 00000100:00100000:3.0:1789395137.377227:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239706752 00000100:00100000:3.0:1789395137.377262:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451 00000100:00100000:3.0:1789395137.377269:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239706752:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1789395137.383089:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239706752:12345-0@lo:403:mdt_io00_000.0 Request processed in 5811us (5935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.383104:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451 00000100:00100000:2.0:1789395137.383398:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239706752:0@lo:403:mdt_io00_000.0 00010000:00010000:2.0:1789395137.384062:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.384074:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.384089:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.384108:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239706880:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395137.384148:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.384169:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.384802:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239706880 00000100:00100000:1.0:1789395137.384809:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239706880 00000100:00100000:1.0:1789395137.384864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:1.0:1789395137.384874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6524:x1876316239706880:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1789395137.384889:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395137.384906:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316b505 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b4fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.384944:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316b505 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b4fe expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.384957:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316b505 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b4fe expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.384966:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:1.0:1789395137.384968:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.384972:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:1.0:1789395137.385014:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:6524:x1876316239706880:12345-0@lo:101:mdt_io00_000.0 Request processed in 141us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.385020:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:2.0:1789395137.385849:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239706880:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395137.385872:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.385885:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395137.385904:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:2.0:1789395137.385946:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.385954:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.385962:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.385978:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707008:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1789395137.386012:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.386049:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.387084:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239707008 00000100:00100000:0.0:1789395137.387095:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239707008 00000100:00100000:0.0:1789395137.387280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453 00000100:00100000:0.0:1789395137.387291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:6524:x1876316239707008:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1789395137.387308:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395137.387328:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b50c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.387353:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b50c expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.387366:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b50c expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.387374:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xdcc87686 (ffff89a4df47a500) 00010000:00010000:0.0:1789395137.387377:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.387380:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aac00, rc 0) 00000100:00100000:0.0:1789395137.387455:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707008:12345-0@lo:101:mdt_io00_000.0 Request processed in 167us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.387462:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453 00000100:00100000:2.0:1789395137.387540:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707008:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1789395137.387558:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387570:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395137.387589:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:2.0:1789395137.387606:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387616:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387624:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387635:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387642:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387649:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387694:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387705:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387714:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387744:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.387757:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 26 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.387770:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239707136:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395137.387853:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd780 going to sleep for 11 seconds 00010000:00010000:2.0:1789395137.392549:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@000000000b08d5e4 x1876316239707136) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 26 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392574:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 26 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392597:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b4e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060eb expref: 26 pid: 6513 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.392613:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6524:1876316239707136:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395137.392632:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:2.0:1789395137.392638:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392646:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392654:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392672:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392681:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.392687:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.392813:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707264:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.392860:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.392898:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.393129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239707264 00000100:00100000:1.0:1789395137.393137:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239707264 00000100:00100000:1.0:1789395137.393184:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454 00000100:00100000:1.0:1789395137.393193:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707264:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.393328:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707264:12345-0@lo:1000:mdt_io00_000.0 Request processed in 135us (467us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395137.393335:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454 00000100:00100000:2.0:1789395137.393615:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707264:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.393658:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707392:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.393682:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.393706:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.393898:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239707392 00000100:00100000:1.0:1789395137.393903:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239707392 00000100:00100000:1.0:1789395137.393943:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3455 00000100:00100000:1.0:1789395137.393951:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707392:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.394009:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707392:12345-0@lo:1000:mdt_io00_000.0 Request processed in 59us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.394016:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3455 00000100:00100000:2.0:1789395137.394098:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707392:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.394183:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707520:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.394204:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.394224:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.394511:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239707520 00000100:00100000:1.0:1789395137.394517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239707520 00000100:00100000:1.0:1789395137.394549:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3456 00000100:00100000:1.0:1789395137.394556:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707520:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.394669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6524:x1876316239707520:12345-0@lo:1000:mdt_io00_000.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.394676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3456 00000100:00100000:0.0:1789395137.395252:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707520:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.395355:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707648:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.395424:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.395443:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff9d2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.395510:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239707648 00000100:00100000:2.0:1789395137.395515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239707648 00000100:00100000:2.0:1789395137.395544:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457 00000100:00100000:2.0:1789395137.395551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239707648:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1789395137.395611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239707648:12345-0@lo:1000:mdt_io00_000.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.395621:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457 00000100:00100000:0.0:1789395137.395811:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707648:0@lo:1000:mdt_io00_000.0 00000040:00080000:0.0:1789395137.396117:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].409, 1000 off609416 00000040:00080000:0.0:1789395137.396162:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].407, 1080 off664216 00000100:00100000:0.0:1789395137.396183:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707776:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1789395137.396207:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.396229:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff9d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.396272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239707776 00000100:00100000:1.0:1789395137.396276:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239707776 00000100:00100000:1.0:1789395137.396313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:1.0:1789395137.396320:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6524:x1876316239707776:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1789395137.396446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6524:x1876316239707776:12345-0@lo:1000:mdt_io00_000.0 Request processed in 126us (237us total) trans 4294969891 rc 0/0 00000100:00100000:1.0:1789395137.396452:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00000100:00100000:0.0:1789395137.396694:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6524:1876316239707776:0@lo:1000:mdt_io00_000.0 00000004:00080000:0.0:1789395137.396702:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3ca34be40 with version 772 00000004:00080000:2.0:1789395137.396740:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 772 rpc_version 772 00000020:00100000:2.0:1789395137.396761:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395137.396768:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d6300 x1876316239708032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2568/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395137.396783:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239708032:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395137.396811:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.396832:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.396866:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239708032 00000100:00100000:0.0:1789395137.396870:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239708032 00000100:00100000:0.0:1789395137.396893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:0.0:1789395137.396899:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:7874:x1876316239708032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395137.397264:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:7874:x1876316239708032:12345-0@lo:1000:osp_up1-0.0 Request processed in 364us (451us total) trans 4294968503 rc 0/0 00000100:00100000:0.0:1789395137.397272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:2.0:1789395137.397427:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239708032:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1789395137.397783:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa29b0dc reply state 000000004ecc9513 transno 4294983563 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397803:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397813:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395137.397816:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1789395137.397820:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395137.397827:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397835:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397847:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397855:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397860:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.397865:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397873:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397884:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35f600) 00010000:00010000:0.0:1789395137.397895:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.397900:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397907:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b51a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395137.397933:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa29b0dc reply state 000000004ecc9513 transno 4294983563 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397942:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397948:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a3ca35fe00) 00010000:00010000:0.0:1789395137.397950:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395137.397952:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1789395137.397956:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.397963:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397970:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.397977:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398001:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395137.398005:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.398010:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398018:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395137.398030:0:6524:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:0.0:1789395137.398037:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398043:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398049:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398054:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.398058:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398067:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398076:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a4df47aa00) 00010000:00010000:0.0:1789395137.398078:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.398081:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.398087:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316b4f7 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.398157:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231757312:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 22404us (22779us total) trans 4294983563 rc 0/0 00000100:00100000:0.0:1789395137.398165:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 12 00010000:00010000:2.0:1789395137.398268:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395137.398274:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.398283:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395137.398288:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.398305:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.398333:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.398340:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.398364:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.398377:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3de400/0xff35729af316b4fe lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b505 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.398415:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.398416:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.398418:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.398552:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789395137.398566:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239708160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.398602:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.398749:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239708160 00000100:00100000:2.0:1789395137.398755:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239708160 00000100:00100000:2.0:1789395137.398798:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1789395137.398805:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+20:3638:x1876316239708160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.398816:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.398831:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316b505 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b4fe expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.398843:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:2.0:1789395137.398849:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.398885:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+19:3638:x1876316239708160:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.398899:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1789395137.399028:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239708160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395137.403481:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.403631:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231757440 00000100:00100000:3.0:1789395137.403640:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231757440 00000100:00100000:3.0:1789395137.403691:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23554 00000100:00100000:3.0:1789395137.403701:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231757440:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:3.0:1789395137.403777:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403792:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403802:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403814:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403821:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403828:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403880:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403889:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403903:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395137.403955:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403968:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403980:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403986:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403993:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.403999:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.404003:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404011:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404022:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5900) 00010000:00010000:3.0:1789395137.404025:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.404030:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404037:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b52f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404054:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404061:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404067:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404072:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.404075:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404081:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404088:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.404090:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.404092:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404097:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b536 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404106:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404113:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404119:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404124:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.404126:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404132:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404142:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395137.404145:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.404148:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.404153:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b53d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.404216:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231757440:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 516us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.404223:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23554 00000100:00100000:2.0:1789395137.414815:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.414881:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231757696 00000100:00100000:3.0:1789395137.414891:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231757696 00000100:00100000:3.0:1789395137.414955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23555 00000100:00100000:3.0:1789395137.414965:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:18279:x1876316231757696:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395137.414986:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.415006:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b544 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.415102:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.415116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.415127:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395137.415138:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 2 00010000:00010000:3.0:1789395137.415231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b544 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.415248:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.415257:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395137.415260:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789395137.415264:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:3.0:1789395137.415318:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18279:x1876316231757696:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 354us (513us total) trans 4294983564 rc 0/0 00000100:00100000:3.0:1789395137.415325:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23555 00000100:00100000:0.0:1789395137.428036:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.428137:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231757824 00000100:00100000:1.0:1789395137.428148:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231757824 00000100:00100000:2.0:1789395137.429468:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5222 00000100:00100000:2.0:1789395137.429488:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231757824:12345-192.168.203.54@tcp:1:lfs.0 00010000:00010000:2.0:1789395137.429538:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.429558:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 19 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.429567:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789395137.429571:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395137.429575:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.429611:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 19 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.429624:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 19 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.429636:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1876316239708288:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395137.429725:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.436680:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.436957:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231757952 00000100:00100000:1.0:1789395137.436967:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231757952 00002000:00100000:1.0:1789395137.437016:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->1) req@ffff89a3c77d5f80 x1876316231757952/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395137.437027:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5f80 with x1876316231757952 ext(0->1) 00010000:00010000:1.0:1789395137.437036:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 20 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.437054:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 20 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395137.437063:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a3c77d5f80 00000100:00100000:1.0:1789395137.437096:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:1.0:1789395137.437106:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231757952:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395137.437885:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1876316239708288:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395137.437910:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.438162:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231757952:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1055us (1489us total) trans 4294969892 rc 0/0 00000100:00100000:1.0:1789395137.438171:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00002000:00100000:1.0:1789395137.438180:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->1) req@ffff89a3c77d5f80 x1876316231757952/t4294969892(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 496/448 e 0 to 0 dl 1789395148 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395137.438188:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5f80 with x1876316231757952 ext(0->1) 00010000:00010000:1.0:1789395137.438195:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 22 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.438208:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 22 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395137.438217:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89a3c77d5f80 00000100:00100000:1.0:1789395137.453616:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.453714:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231758080 00000100:00100000:0.0:1789395137.453724:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231758080 00010000:00010000:0.0:1789395137.453760:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 22 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.453829:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1581 00000100:00100000:0.0:1789395137.453840:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231758080:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395137.453856:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789395137.453873:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1789395137.453876:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1789395137 00002000:00010000:0.0:1789395137.453879:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1789395137 00002000:00010000:0.0:1789395137.453882:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789395137.453887:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 22 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.453906:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 22 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.453935:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316b20a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106082 expref: 22 pid: 8426 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.453952:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395137.453956:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789395137.453963:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.453972:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.454005:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395137.454057:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231758080:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 219us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.454065:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1581 00010000:00010000:2.0:1789395137.454131:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454143:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454162:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454171:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454179:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454186:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395137.454190:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454200:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454211:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.454218:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316b559 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.454264:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231757824:12345-192.168.203.54@tcp:1:lfs.0 Request processed in 24785us (26237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.454272:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5222 00000100:00100000:1.0:1789395137.469744:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.469821:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231758336 00000100:00100000:2.0:1789395137.469831:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231758336 00000100:00100000:2.0:1789395137.469889:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:2.0:1789395137.469899:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18279:x1876316231758336:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:2.0:1789395137.469961:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.469988:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b1fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210607b expref: 29 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.470006:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395137.470011:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395137.470034:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.470048:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.470059:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395137.470076:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:2.0:1789395137.470235:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708416:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.470285:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.470531:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.470720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239708416 00000100:00100000:1.0:1789395137.470725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239708416 00000100:00100000:1.0:1789395137.470764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460 00000100:00100000:1.0:1789395137.470771:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239708416:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.470982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239708416:12345-0@lo:1000:mdt_io00_002.0 Request processed in 211us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.470990:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460 00000100:00100000:2.0:1789395137.471291:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708416:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.473058:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708544:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1789395137.473467:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.473501:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.473510:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239708544 00000100:00100000:0.0:1789395137.473519:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239708544 00000100:00100000:0.0:1789395137.473570:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3461 00000100:00100000:0.0:1789395137.473579:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239708544:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1789395137.476707:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239708544:12345-0@lo:403:mdt_io00_002.0 Request processed in 3121us (3234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.476720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3461 00000100:00100000:2.0:1789395137.478617:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708544:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1789395137.479835:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.479853:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.479863:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.479885:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708672:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395137.479994:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.480052:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.480060:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239708672 00000100:00100000:3.0:1789395137.480068:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239708672 00000100:00100000:3.0:1789395137.480119:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3462 00000100:00100000:3.0:1789395137.480128:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6526:x1876316239708672:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395137.480144:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.480159:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b56e lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b567 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.480186:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b56e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b567 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.480199:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b56e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b567 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.480208:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.480211:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.480215:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015a00, rc 0) 00000100:00100000:3.0:1789395137.480257:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:6526:x1876316239708672:12345-0@lo:101:mdt_io00_002.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.480264:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3462 00000100:00100000:2.0:1789395137.482512:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708672:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1789395137.482541:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.482555:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395137.482577:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:2.0:1789395137.482624:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.482631:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.482812:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.482833:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708800:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1789395137.482883:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.482942:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.484101:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239708800 00000100:00100000:1.0:1789395137.484111:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239708800 00000100:00100000:1.0:1789395137.484171:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3463 00000100:00100000:1.0:1789395137.484180:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:6526:x1876316239708800:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1789395137.484201:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395137.484220:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b575 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.484246:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b575 expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.484259:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b575 expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.484268:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xb62e0cbf (ffff89a3ca363d00) 00010000:00010000:1.0:1789395137.484271:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395137.484275:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:1.0:1789395137.484332:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239708800:12345-0@lo:101:mdt_io00_002.0 Request processed in 153us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.484339:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3463 00000100:00100000:3.0:1789395137.484619:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239708800:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1789395137.484635:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484646:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395137.484664:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1789395137.484682:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484691:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484699:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484710:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484716:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484723:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484761:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484774:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484782:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484809:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.484822:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 28 pid: 6512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.484835:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239708928:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395137.484901:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00010000:00010000:3.0:1789395137.490168:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@0000000095d00834 x1876316239708928) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 28 pid: 6512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490192:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 28 pid: 6512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490215:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b54b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f2 expref: 28 pid: 6512 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.490503:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6526:1876316239708928:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395137.490528:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395137.490534:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490545:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490552:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490570:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490580:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.490586:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.490711:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709056:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395137.490767:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.490800:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.490903:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709056 00000100:00100000:1.0:1789395137.490910:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709056 00000100:00100000:1.0:1789395137.490967:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3464 00000100:00100000:1.0:1789395137.490976:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239709056:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.491094:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239709056:12345-0@lo:1000:mdt_io00_002.0 Request processed in 118us (325us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395137.491100:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3464 00000100:00100000:2.0:1789395137.491177:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709056:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.491215:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8850a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709184:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.491251:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.491268:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.491466:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709184 00000100:00100000:1.0:1789395137.491470:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709184 00000100:00100000:1.0:1789395137.491609:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1789395137.491617:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239709184:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.491675:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239709184:12345-0@lo:1000:mdt_io00_002.0 Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.491681:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:0.0:1789395137.491878:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8850a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709184:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.491983:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709312:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.492067:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.492246:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff9d2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.492486:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709312 00000100:00100000:2.0:1789395137.492491:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709312 00000100:00100000:2.0:1789395137.492517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:2.0:1789395137.492524:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239709312:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1789395137.492583:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+21:6526:x1876316239709312:12345-0@lo:1000:mdt_io00_002.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.492590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:0.0:1789395137.492657:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709312:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.492736:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709440:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.492759:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.492779:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.493137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709440 00000100:00100000:3.0:1789395137.493142:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709440 00000100:00100000:3.0:1789395137.493169:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467 00000100:00100000:3.0:1789395137.493176:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239709440:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1789395137.493247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239709440:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.493254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467 00000100:00100000:0.0:1789395137.493362:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709440:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1789395137.493704:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].410, 1264 off610680 00000040:00080000:0.0:1789395137.493750:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].408, 1344 off665560 00000100:00100000:0.0:1789395137.493772:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709568:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1789395137.493799:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.493817:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.493953:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709568 00000100:00100000:1.0:1789395137.493959:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709568 00000100:00100000:1.0:1789395137.494001:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3468 00000100:00100000:1.0:1789395137.494009:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6526:x1876316239709568:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1789395137.494120:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6526:x1876316239709568:12345-0@lo:1000:mdt_io00_002.0 Request processed in 111us (319us total) trans 4294969893 rc 0/0 00000100:00100000:1.0:1789395137.494128:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3468 00000100:00100000:0.0:1789395137.496580:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6526:1876316239709568:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1789395137.496597:0:6526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a4ff9d2780 with version 773 00000004:00080000:1.0:1789395137.498321:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 773 rpc_version 773 00000020:00100000:1.0:1789395137.498361:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395137.498371:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d8354000 x1876316239709824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395137.498587:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239709824:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395137.498651:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.499582:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395137.499786:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709824 00000100:00100000:2.0:1789395137.499794:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709824 00000100:00100000:2.0:1789395137.499927:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3469 00000100:00100000:2.0:1789395137.499939:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:7874:x1876316239709824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1789395137.500856:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:7874:x1876316239709824:12345-0@lo:1000:osp_up1-0.0 Request processed in 917us (2201us total) trans 4294968504 rc 0/0 00000100:00100000:2.0:1789395137.500865:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3469 00000100:00100000:1.0:1789395137.501132:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239709824:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1789395137.501426:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000226951fa reply state 00000000e9b6c968 transno 4294983565 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501447:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501457:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395137.501460:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1789395137.501464:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395137.501472:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501479:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501485:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501494:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501500:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.501504:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501512:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501522:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5900) 00010000:00010000:0.0:1789395137.501525:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.501529:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501536:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b583 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395137.501555:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000226951fa reply state 00000000e9b6c968 transno 4294983565 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501564:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501570:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3c90d5800) 00010000:00010000:0.0:1789395137.501573:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395137.501575:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1789395137.501579:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.501585:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501594:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501601:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501626:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395137.501630:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:0.0:1789395137.501635:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501643:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395137.501655:0:6526:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:0.0:1789395137.501661:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501668:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501673:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501679:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.501682:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501688:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501696:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:0.0:1789395137.501698:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.501701:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.501707:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316b560 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.501773:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18279:x1876316231758336:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 31873us (32036us total) trans 4294983565 rc 0/0 00000100:00100000:0.0:1789395137.501780:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 13 00010000:00010000:2.0:1789395137.502725:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395137.502735:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.502744:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395137.502750:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.502764:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.502799:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.502806:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.502838:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.502846:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df400/0xff35729af316b567 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b56e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.502864:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.502866:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.502867:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395137.502908:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239709952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395137.502965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.503128:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239709952 00000100:00100000:3.0:1789395137.503135:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239709952 00000100:00100000:3.0:1789395137.503279:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1789395137.503289:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+22:3636:x1876316239709952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395137.503303:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395137.503319:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b56e lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b567 expref: 22 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.503333:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.503341:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395137.503378:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+21:3636:x1876316239709952:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.503417:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1789395137.503485:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239709952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395137.507887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.507971:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231758592 00000100:00100000:2.0:1789395137.507981:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231758592 00000100:00100000:2.0:1789395137.508035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5086 00000100:00100000:2.0:1789395137.508045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:18279:x1876316231758592:12345-192.168.203.54@tcp:35:lfs.0 00000040:00080000:2.0:1789395137.508300:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].392, 344 off586408 00000040:00080000:2.0:1789395137.508341:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].392, 424 off640656 00000004:00080000:2.0:1789395137.508347:0:6514:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca6cde40 with version 747 00000004:00080000:0.0:1789395137.508434:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 747 rpc_version 747 00000020:00100000:0.0:1789395137.508463:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395137.508471:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d6680 x1876316239710208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395137.508501:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239710208:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395137.508549:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.508571:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.508669:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239710208 00000100:00100000:1.0:1789395137.508673:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239710208 00000100:00100000:1.0:1789395137.508704:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3470 00000100:00100000:1.0:1789395137.508710:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239710208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395137.508845:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7455:x1876316239710208:12345-0@lo:1000:osp_up0-1.0 Request processed in 135us (294us total) trans 4294983566 rc 0/0 00000100:00100000:1.0:1789395137.508853:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3470 00000100:00100000:0.0:1789395137.509126:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239710208:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395137.509238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18279:x1876316231758592:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 1193us (1358us total) trans 4294968505 rc 0/0 00000100:00100000:2.0:1789395137.509246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5086 00000100:00100000:1.0:1789395137.532198:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.532470:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231758848 00000100:00100000:3.0:1789395137.532480:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231758848 00000100:00100000:3.0:1789395137.532546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23556 00000100:00100000:3.0:1789395137.532557:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18280:x1876316231758848:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395137.532579:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.532601:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021060f9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532669:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532682:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532693:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532708:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532719:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532730:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532797:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b5ad lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532805:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b5ad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532812:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b5ad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532826:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532832:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532838:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532851:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532858:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.532862:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532870:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532882:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395137.532885:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.532893:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532900:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316b59f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532913:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532929:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532936:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532941:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.532944:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532950:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532957:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.532959:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.532962:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.532968:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316b5a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.533001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f9 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.533014:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b5ad lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f9 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.533022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a4c8e8dd00) 00010000:00010000:3.0:1789395137.533024:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395137.533026:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014000, rc 0) 00000100:00100000:3.0:1789395137.533191:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18280:x1876316231758848:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 635us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.533198:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23556 00000100:00100000:1.0:1789395137.555295:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.555425:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231759104 00000100:00100000:2.0:1789395137.555435:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231759104 00000100:00100000:2.0:1789395137.555488:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23557 00000100:00100000:2.0:1789395137.555498:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:18280:x1876316231759104:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395137.555522:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.555543:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316b5b4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106100 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.555696:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:2.0:1789395137.555778:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316b5b4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106100 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.555792:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395137.555795:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395137.555800:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316b5b4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106100 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.555817:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395137.555879:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18280:x1876316231759104:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 382us (594us total) trans 4294968506 rc 301/301 00000100:00100000:2.0:1789395137.555887:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23557 00000100:00100000:1.0:1789395137.556037:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.556207:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231759232 00000100:00100000:2.0:1789395137.556211:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231759232 00000100:00100000:2.0:1789395137.556242:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1376 00000100:00100000:2.0:1789395137.556249:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2397:x1876316231759232:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.556260:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395137.556276:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316b5ad lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060f9 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.556293:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a4c8e8dd00) 00010000:00010000:2.0:1789395137.556297:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395137.556327:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:2397:x1876316231759232:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.556333:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1376 00000100:00100000:1.0:1789395137.565774:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.565873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231759360 00000100:00100000:0.0:1789395137.565883:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231759360 00000100:00100000:0.0:1789395137.565970:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5087 00000100:00100000:0.0:1789395137.565980:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18280:x1876316231759360:12345-192.168.203.54@tcp:33:lfs.0 00000004:00200000:0.0:1789395137.566112:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00000004:00200000:0.0:1789395137.566116:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:0.0:1789395137.566189:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18280:x1876316231759360:12345-192.168.203.54@tcp:33:lfs.0 Request processed in 210us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.566197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5087 00000100:00100000:1.0:1789395137.595796:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.595910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231759616 00000100:00100000:2.0:1789395137.595930:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231759616 00000100:00100000:2.0:1789395137.595994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5088 00000100:00100000:2.0:1789395137.596004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:18280:x1876316231759616:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:2.0:1789395137.596222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18280:x1876316231759616:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 218us (434us total) trans 4294968507 rc 0/0 00000100:00100000:2.0:1789395137.596230:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5088 00000100:00100000:1.0:1789395137.612115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.612632:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231759744 00000100:00100000:2.0:1789395137.612642:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231759744 00000100:00100000:2.0:1789395137.612704:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23558 00000100:00100000:2.0:1789395137.612713:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:18090:x1876316231759744:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395137.612736:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.612756:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316b5c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106107 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.612818:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316b5c9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.612832:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316b5c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.612859:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316b5c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.612957:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00000004:00200000:2.0:1789395137.612962:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1789395137.612979:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316b5c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.613002:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316b5c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106107 expref: 11 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.613024:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316b5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106107 expref: 10 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.613033:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:2.0:1789395137.613036:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395137.613039:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395137.613182:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18090:x1876316231759744:12345-192.168.203.54@tcp:101:bash.0 Request processed in 468us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.613189:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23558 00000100:00100000:1.0:1789395137.629565:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.629712:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231759872 00000100:00100000:3.0:1789395137.629722:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231759872 00000100:00100000:3.0:1789395137.629784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23559 00000100:00100000:3.0:1789395137.629794:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:18090:x1876316231759872:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395137.629813:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.629835:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b5d0 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210610e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.629893:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b5d7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.629905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b5d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.629933:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b5d7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395137.630217:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xca:0x0]: returning size 4096 00000004:00200000:3.0:1789395137.630223:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1789395137.630258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b5d0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210610e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.630278:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b5d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210610e expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.630287:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.630302:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789395137.630306:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015400, rc 0) 00000100:00100000:3.0:1789395137.630368:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18090:x1876316231759872:12345-192.168.203.54@tcp:101:bash.0 Request processed in 575us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.630375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23559 00000100:00100000:1.0:1789395137.638250:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.638336:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760000 00000100:00100000:2.0:1789395137.638346:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760000 00000100:00100000:2.0:1789395137.638428:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23560 00000100:00100000:2.0:1789395137.638438:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:18090:x1876316231760000:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395137.638460:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.638482:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b5de lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106115 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.638541:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.638554:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.638563:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.638606:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcd:0x0]: returning size 4096 00000004:00200000:2.0:1789395137.638610:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1789395137.638643:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b5de lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.638659:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.638668:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395137.638672:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789395137.638675:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395137.638728:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231760000:12345-192.168.203.54@tcp:101:bash.0 Request processed in 291us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395137.638734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23560 00000100:00100000:1.0:1789395137.646626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.646706:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760256 00000100:00100000:3.0:1789395137.646716:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760256 00000100:00100000:3.0:1789395137.646818:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23561 00000100:00100000:3.0:1789395137.646828:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18090:x1876316231760256:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395137.646848:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.646870:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b5ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210611c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.647043:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af316b5f3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.647055:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af316b5f3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.647069:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af316b5f3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395137.647080:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:3.0:1789395137.647175:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015a00/0xff35729af316b5ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210611c expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.647199:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af316b5f3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210611c expref: 13 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.647208:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:3.0:1789395137.647210:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789395137.647214:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:3.0:1789395137.647273:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231760256:12345-192.168.203.54@tcp:101:bash.0 Request processed in 446us (656us total) trans 4294968508 rc 0/0 00000100:00100000:3.0:1789395137.647281:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23561 00000100:00100000:1.0:1789395137.658038:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.658257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760384 00000100:00100000:0.0:1789395137.658268:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760384 00000100:00100000:0.0:1789395137.658335:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5089 00000100:00100000:0.0:1789395137.658346:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231760384:12345-192.168.203.54@tcp:37:bash.0 00000100:00100000:0.0:1789395137.669290:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18090:x1876316231760384:12345-192.168.203.54@tcp:37:bash.0 Request processed in 10936us (11251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395137.669303:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5089 00000100:00100000:1.0:1789395137.680073:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.680160:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760512 00000100:00100000:3.0:1789395137.680171:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760512 00000100:00100000:3.0:1789395137.680232:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5090 00000100:00100000:3.0:1789395137.680243:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231760512:12345-192.168.203.54@tcp:37:bash.0 00000100:00100000:3.0:1789395137.684539:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18090:x1876316231760512:12345-192.168.203.54@tcp:37:bash.0 Request processed in 4286us (4463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.684553:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5090 00000100:00100000:1.0:1789395137.728177:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.728260:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760640 00000100:00100000:3.0:1789395137.728270:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760640 00000100:00100000:3.0:1789395137.728336:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23562 00000100:00100000:3.0:1789395137.728347:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231760640:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.728366:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.728429:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b601 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106123 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728492:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728505:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728515:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728529:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728535:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728541:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728576:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728583:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728589:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728600:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728606:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.728610:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728618:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728629:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395137.728632:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.728637:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728644:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316b608 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728658:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728665:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728670:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728675:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.728677:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728687:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728694:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xeddcfc6c (ffff89a3c90d5f00) 00010000:00010000:3.0:1789395137.728696:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.728698:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728704:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316b60f lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728734:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b601 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106123 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728744:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395137.728746:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395137.728749:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316b601 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106123 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.728758:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015a00, rc 0) 00000100:00100000:3.0:1789395137.728819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231760640:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 473us (650us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395137.728825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23562 00000100:00100000:1.0:1789395137.735489:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.735635:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760768 00000100:00100000:3.0:1789395137.735645:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760768 00000100:00100000:3.0:1789395137.735705:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23563 00000100:00100000:3.0:1789395137.735715:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231760768:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.735737:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.735756:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316b616 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210612a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735820:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735834:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735845:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735861:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735869:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735876:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735930:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735937:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735943:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735950:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735956:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.735961:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735969:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735981:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.735984:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.735989:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.735995:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca014000/0xff35729af316b61d lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736010:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736016:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736022:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736027:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.736030:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736035:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736046:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xeddcfc6c (ffff89a3c90d5200) 00010000:00010000:3.0:1789395137.736049:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.736051:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736056:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736088:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316b616 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210612a expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736099:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.736101:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395137.736105:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015200/0xff35729af316b616 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210612a expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.736113:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015200, rc 0) 00000100:00100000:3.0:1789395137.736171:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231760768:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 457us (691us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395137.736178:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23563 00000100:00100000:1.0:1789395137.748278:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.752737:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231760896 00000100:00100000:3.0:1789395137.752751:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231760896 00000100:00100000:2.0:1789395137.756739:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23564 00000100:00100000:2.0:1789395137.756754:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231760896:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395137.756775:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.756800:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b62b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106131 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756866:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756880:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756890:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756904:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756911:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756927:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756980:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756987:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.756994:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757001:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757006:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.757012:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757020:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757033:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395137.757036:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.757041:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757047:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b632 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757061:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757068:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757074:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757079:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.757082:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757089:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757096:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3491cd4c (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395137.757099:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.757102:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757108:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b639 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757141:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b62b lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106131 expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757151:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395137.757154:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395137.757157:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316b62b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106131 expref: 31 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.757166:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395137.757235:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231760896:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 484us (8966us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395137.757242:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23564 00000100:00100000:1.0:1789395137.765114:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.765243:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231761024 00000100:00100000:3.0:1789395137.765253:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231761024 00000100:00100000:3.0:1789395137.765361:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23565 00000100:00100000:3.0:1789395137.765373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231761024:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.765411:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.765433:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b640 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106138 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765498:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765513:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765525:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765539:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765546:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765553:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765590:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765598:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765604:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765611:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765616:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.765621:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765629:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765653:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.765657:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.765662:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765670:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b647 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765685:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765692:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765698:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765714:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.765717:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765724:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765853:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3491cd4c (ffff89a3c90d5200) 00010000:00010000:3.0:1789395137.765856:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.765860:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765866:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b64e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765899:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b640 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106138 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765908:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395137.765911:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395137.765925:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a600/0xff35729af316b640 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106138 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.765935:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a600, rc 0) 00000100:00100000:3.0:1789395137.766262:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231761024:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 890us (1157us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395137.766272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23565 00000100:00100000:1.0:1789395137.774045:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.774258:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231761152 00000100:00100000:2.0:1789395137.774269:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231761152 00000100:00100000:2.0:1789395137.774325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23566 00000100:00100000:2.0:1789395137.774335:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231761152:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395137.774353:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.774373:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b655 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210613f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774468:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774487:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774498:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774512:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774531:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774538:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774575:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774581:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774587:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774603:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774610:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.774614:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774622:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774635:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395137.774638:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.774642:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774648:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316b65c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774661:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774667:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774671:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774676:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.774680:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774686:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774695:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3735a305 (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395137.774699:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.774702:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774707:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316b663 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774743:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b655 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210613f expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774753:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395137.774755:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395137.774758:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b655 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210613f expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.774768:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cce00, rc 0) 00000100:00100000:2.0:1789395137.774827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231761152:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 493us (790us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395137.774835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23566 00000100:00100000:1.0:1789395137.781186:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.781284:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231761280 00000100:00100000:2.0:1789395137.781294:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231761280 00000100:00100000:2.0:1789395137.781362:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23567 00000100:00100000:2.0:1789395137.781372:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231761280:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395137.781421:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.781442:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b66a lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106146 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.781499:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.781513:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.781522:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.781535:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.781541:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.781547:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782498:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782512:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782518:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782526:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782532:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.782537:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782545:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782559:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395137.782562:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.782567:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782575:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b671 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782590:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782596:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782602:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782608:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.782611:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782618:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782624:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3735a305 (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395137.782627:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.782630:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782635:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b678 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782681:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b66a lrc: 1/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106146 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782707:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395137.782709:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395137.782714:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b66a lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106146 expref: 14 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.782723:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cce00, rc 0) 00000100:00100000:0.0:1789395137.783136:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231761280:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 1761us (1954us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395137.783145:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23567 00000100:00100000:1.0:1789395137.792564:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.792710:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231761536 00000100:00100000:0.0:1789395137.792721:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231761536 00000100:00100000:0.0:1789395137.792781:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23568 00000100:00100000:0.0:1789395137.792791:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231761536:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395137.792812:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395137.792833:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b67f lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210614d expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.792913:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.792937:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.792958:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.792970:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.792976:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.792983:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793021:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793028:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793034:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793041:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793046:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.793051:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793059:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793070:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:0.0:1789395137.793073:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.793078:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793084:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316b686 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793098:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793104:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793110:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793115:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.793118:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793123:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793131:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a3ca35fe00) 00010000:00010000:0.0:1789395137.793133:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.793136:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793142:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b68d lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793171:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b67f lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210614d expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793182:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:0.0:1789395137.793185:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395137.793188:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316b67f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210614d expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.793198:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aba00, rc 0) 00000100:00100000:0.0:1789395137.793258:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18282:x1876316231761536:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 469us (703us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395137.793266:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23568 00000100:00100000:1.0:1789395137.799717:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.799812:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231761792 00000100:00100000:2.0:1789395137.799821:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231761792 00000100:00100000:2.0:1789395137.799884:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23569 00000100:00100000:2.0:1789395137.799894:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18282:x1876316231761792:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395137.799924:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.799945:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b694 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106154 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800023:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800037:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800049:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800060:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800070:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b50c expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800083:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.800118:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b50c expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.800132:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239710336:0@lo:104: 00000100:00100000:2.0:1789395137.800201:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.800261:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789395137.800440:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239710336 00000100:00100000:0.0:1789395137.800446:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239710336 00000100:00100000:0.0:1789395137.800489:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1789395137.800497:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239710336:12345-0@lo:104: 00010000:00010000:0.0:1789395137.800510:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.800587:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789395137.800649:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789395137.800659:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239710336:12345-0@lo:104: Request processed in 161us (456us total) trans 0 rc 0/0 00010000:00010000:1.0:1789395137.800660:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.800674:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00010000:00010000:1.0:1789395137.800676:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395137.800692:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395137.800703:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.800731:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.800738:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395137.800770:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.800779:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3dea00/0xff35729af316b50c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b513 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.800799:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.800801:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789395137.800802:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395137.800805:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.800816:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239710464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.800850:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395137.801089:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239710464 00000100:00100000:1.0:1789395137.801093:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239710464 00010000:00010000:1.0:1789395137.801115:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b50c expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395137.801158:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:1.0:1789395137.801174:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+21:3636:x1876316239710464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395137.801185:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789395137.802420:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239710336:0@lo:104: 00010000:00010000:2.0:1789395137.802443:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395137.809446:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968508 is committed 00000001:00080000:1.0:1789395137.809468:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968504 is committed 00000020:00080000:1.0:1789395137.809479:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 397 batchid updated 00000020:00080000:1.0:1789395137.809485:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 396 batchid updated 00000020:00080000:2.0:1789395137.809615:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 397 00000004:00080000:2.0:1789395137.809676:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca6cdb40 with version 748 00000020:00080000:2.0:1789395137.809685:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 396 cancel update log [0x200000401:0x3:0x0].390: rc = 0 00010000:00010000:3.0:1789395137.809745:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b513 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b50c expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789395137.809752:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 396 cancel update log [0x240000400:0x3:0x0].390: rc = 0 00010000:00010000:3.0:1789395137.809770:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xdcc87686 (ffff89a4df47a500) 00000004:00080000:2.0:1789395137.809777:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3ca6cd840 with version 749 00010000:00010000:3.0:1789395137.809778:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789395137.809781:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 397 cancel update log [0x200000401:0x3:0x0].391: rc = 0 00010000:00010000:3.0:1789395137.809794:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789395137.809800:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 397 cancel update log [0x240000400:0x3:0x0].391: rc = 0 00010000:00010000:3.0:1789395137.809804:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789395137.809808:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 397 00010000:00010000:3.0:1789395137.809850:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1789395137.809862:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 748 rpc_version 748 00000020:00100000:0.0:1789395137.809892:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395137.809909:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d7480 x1876316239710720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395137.809937:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239710720:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395137.809943:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+14:3636:x1876316239710464:12345-0@lo:103:ldlm_bl.0 Request processed in 8774us (9088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.809954:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:0.0:1789395137.810093:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.810121:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.810187:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239710464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.810239:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810248:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.810264:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239710720 00000100:00100000:3.0:1789395137.810272:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239710720 00000100:00100000:3.0:1789395137.810320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3471 00000100:00100000:3.0:1789395137.810330:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7455:x1876316239710720:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1789395137.810351:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316b6a9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810363:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316b6a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810371:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316b6a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.810415:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x197:0x0]: returning size 2 00010000:00010000:2.0:1789395137.810474:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810482:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810489:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.810498:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:7455:x1876316239710720:12345-0@lo:1000:osp_up0-1.0 Request processed in 167us (403us total) trans 4294983567 rc 0/0 00010000:00010000:2.0:1789395137.810499:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810513:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00000100:00100000:3.0:1789395137.810517:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3471 00010000:00010000:2.0:1789395137.810520:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810529:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810539:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395137.810542:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.810546:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810557:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b69b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810570:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810576:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810583:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810588:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.810591:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810597:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810603:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xdcc87686 (ffff89a4df47a500) 00010000:00010000:2.0:1789395137.810605:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.810608:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810613:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b6a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810654:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b694 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106154 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810673:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316b6a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106154 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.810680:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395137.810683:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395137.810685:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc600, rc 0) 00000100:00100000:2.0:1789395137.810731:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18282:x1876316231761792:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 10838us (11024us total) trans 4294968509 rc 0/0 00000100:00100000:2.0:1789395137.810737:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23569 00000100:00100000:0.0:1789395137.810855:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239710720:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1789395137.810865:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 749 rpc_version 749 00000020:00100000:0.0:1789395137.810876:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395137.810882:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c77d4000 x1876316239710976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395137.810895:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239710976:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395137.810936:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.811086:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.814197:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239710976 00000100:00100000:1.0:1789395137.814210:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239710976 00000100:00100000:1.0:1789395137.814270:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3472 00000100:00100000:1.0:1789395137.814279:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:7455:x1876316239710976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395137.814539:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239710976:12345-0@lo:1000:osp_up0-1.0 Request processed in 260us (3601us total) trans 4294983568 rc 0/0 00000100:00100000:1.0:1789395137.814546:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3472 00000100:00100000:0.0:1789395137.815138:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239710976:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395137.818569:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.818671:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231761920 00000100:00100000:3.0:1789395137.818679:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231761920 00000100:00100000:3.0:1789395137.818758:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5223 00000100:00100000:3.0:1789395137.818768:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231761920:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.818786:0:14650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.818807:0:14650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210615b expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395137.818832:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x6aa800c0, atime: 0x0, ctime: 0x6aa800c0, blocks: 0x8 00010000:00010000:3.0:1789395137.818851:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1789395137.818855:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395137.818864:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 21 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.818882:0:14650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 21 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.818895:0:14650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a600, rc 0) 00000100:00100000:3.0:1789395137.820602:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231761920:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 1826us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.820615:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5223 00000100:00100000:1.0:1789395137.830212:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.830653:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231762048 00000100:00100000:2.0:1789395137.830664:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231762048 00002000:00100000:2.0:1789395137.830890:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff89a3c93e4700 x1876316231762048/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 488/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.830901:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c93e4700 with x1876316231762048 ext(0->4095) 00002000:00010000:2.0:1789395137.830907:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c93e4700 00000100:00100000:2.0:1789395137.831082:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:2.0:1789395137.831093:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231762048:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:2.0:1789395137.831300:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231762048:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 200us (1089us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789395137.831308:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00002000:00100000:2.0:1789395137.831322:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff89a3c93e4700 x1876316231762048/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 488/4536 e 0 to 0 dl 1789395148 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395137.831331:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c93e4700 with x1876316231762048 ext(0->4095) 00002000:00010000:2.0:1789395137.831336:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c93e4700 00000100:00100000:1.0:1789395137.844851:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.844958:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231762304 00000100:00100000:0.0:1789395137.844975:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231762304 00000100:00100000:0.0:1789395137.845035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5091 00000100:00100000:0.0:1789395137.845046:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:18282:x1876316231762304:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:0.0:1789395137.845323:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18282:x1876316231762304:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 278us (482us total) trans 4294968510 rc 0/0 00000100:00100000:0.0:1789395137.845331:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5091 00000100:00100000:1.0:1789395137.866270:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.866371:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231762560 00000100:00100000:3.0:1789395137.866412:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231762560 00000100:00100000:3.0:1789395137.866469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23570 00000100:00100000:3.0:1789395137.866481:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18284:x1876316231762560:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.866500:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.866521:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b6be lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106162 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866593:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866618:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866629:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866641:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866652:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866659:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866704:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866711:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866717:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866723:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866729:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.866733:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866740:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866752:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395137.866755:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.866759:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866765:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b6c5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866780:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866786:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866792:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866797:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.866800:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866805:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866812:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3ca363e00) 00010000:00010000:3.0:1789395137.866814:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.866817:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866823:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b6cc lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866866:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b6be lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106162 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866877:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395137.866879:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395137.866883:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b6be lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106162 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.866892:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a800, rc 0) 00000100:00100000:3.0:1789395137.867959:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18284:x1876316231762560:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 484us (699us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395137.868031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23570 00000100:00100000:1.0:1789395137.873611:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.873709:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231762816 00000100:00100000:0.0:1789395137.873720:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231762816 00000100:00100000:0.0:1789395137.873780:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23571 00000100:00100000:0.0:1789395137.873792:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18284:x1876316231762816:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395137.873818:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395137.873837:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aba00/0xff35729af316b6d3 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106169 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.873925:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.873940:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.873951:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.873969:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.873979:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b4a3 expref: 13 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.873988:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.874021:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b4a3 expref: 13 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395137.874038:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239711104:0@lo:104: 00000100:00100000:0.0:1789395137.874082:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395137.874132:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.874247:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711104 00000100:00100000:1.0:1789395137.874251:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711104 00000100:00100000:1.0:1789395137.874285:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1789395137.874293:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239711104:12345-0@lo:104: 00010000:00010000:1.0:1789395137.874306:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.874368:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395137.874374:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239711104:12345-0@lo:104: Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.874380:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00010000:00010000:3.0:1789395137.874550:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395137.874557:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.874565:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395137.874571:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395137.874580:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.874607:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.874615:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395137.874635:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.874643:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1400/0xff35729af316b4a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b4aa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.874664:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395137.874667:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395137.874669:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.874676:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395137.874698:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239711232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395137.874733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.874766:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711232 00000100:00100000:3.0:1789395137.874770:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711232 00010000:00010000:3.0:1789395137.874791:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b4a3 expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.874812:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1789395137.874817:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+14:3639:x1876316239711232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395137.874826:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789395137.875155:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239711104:0@lo:104: 00010000:00010000:3.0:1789395137.875175:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395137.878159:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968510 is committed 00010000:00010000:3.0:1789395137.878285:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015e00/0xff35729af316b4aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b4a3 expref: 14 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.878304:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xbc0ca3a9 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395137.878310:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.878320:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.878328:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.878368:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395137.878471:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+13:3639:x1876316239711232:12345-0@lo:103:ldlm_bl.0 Request processed in 3652us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.878480:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:1.0:1789395137.878635:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239711232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395137.878711:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878720:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878829:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b6e8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878839:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b6e8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878848:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b6e8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395137.878859:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x196:0x0]: returning size 2 00010000:00010000:0.0:1789395137.878953:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878962:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878969:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878975:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878982:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.878987:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.878994:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879008:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:0.0:1789395137.879011:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.879015:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879022:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa000/0xff35729af316b6da lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879032:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879038:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879044:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879049:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.879052:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879058:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879064:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xbc0ca3a9 (ffff89a3c90d5500) 00010000:00010000:0.0:1789395137.879066:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.879069:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879075:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab600/0xff35729af316b6e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879120:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aba00/0xff35729af316b6d3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106169 expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879134:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b6e8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106169 expref: 12 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.879141:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff89a3c8b1d600) 00010000:00010000:0.0:1789395137.879143:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395137.879146:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aae00, rc 0) 00000100:00100000:0.0:1789395137.879198:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18284:x1876316231762816:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 5409us (5597us total) trans 4294968511 rc 0/0 00000100:00100000:0.0:1789395137.879205:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23571 00000100:00100000:2.0:1789395137.887837:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.887931:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231762944 00000100:00100000:1.0:1789395137.887941:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231762944 00000100:00100000:1.0:1789395137.888003:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5224 00000100:00100000:1.0:1789395137.888016:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231762944:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395137.888035:0:14639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395137.888244:0:14639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106170 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395137.888273:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x6aa800c0, atime: 0x0, ctime: 0x6aa800c0, blocks: 0x8 00010000:00010000:1.0:1789395137.888294:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1789395137.888298:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395137.888307:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 22 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.888325:0:14639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 22 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.888338:0:14639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395137.888510:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231762944:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 497us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.888517:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5224 00000100:00100000:1.0:1789395137.897564:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.898502:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231763072 00000100:00100000:0.0:1789395137.898513:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231763072 00002000:00100000:0.0:1789395137.898562:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff89a4ffb48700 x1876316231763072/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 488/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395137.898574:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb48700 with x1876316231763072 ext(0->4095) 00002000:00010000:0.0:1789395137.898579:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ffb48700 00000100:00100000:0.0:1789395137.898717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:0.0:1789395137.898727:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231763072:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:0.0:1789395137.899167:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231763072:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 440us (1610us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789395137.899176:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00002000:00100000:0.0:1789395137.899184:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff89a4ffb48700 x1876316231763072/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 488/4536 e 0 to 0 dl 1789395148 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395137.899200:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb48700 with x1876316231763072 ext(0->4095) 00002000:00010000:0.0:1789395137.899203:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ffb48700 00000100:00100000:0.0:1789395137.907835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.907884:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231763328 00000100:00100000:3.0:1789395137.907894:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231763328 00000100:00100000:0.0:1789395137.908094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5092 00000100:00100000:0.0:1789395137.908107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:18284:x1876316231763328:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:0.0:1789395137.908561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18284:x1876316231763328:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 456us (731us total) trans 4294968512 rc 0/0 00000100:00100000:0.0:1789395137.908569:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5092 00000100:00100000:2.0:1789395137.923052:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.923187:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231763584 00000100:00100000:3.0:1789395137.923196:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231763584 00000100:00100000:3.0:1789395137.923255:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23572 00000100:00100000:3.0:1789395137.923266:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18286:x1876316231763584:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.923285:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.923314:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b6fd lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106177 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923382:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923433:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923444:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923456:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923463:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923470:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923505:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923512:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923518:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923525:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923531:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.923536:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923544:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923556:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395137.923558:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.923567:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923572:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316b704 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923591:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923596:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923602:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923608:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395137.923612:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923618:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a3c90d5a00) 00010000:00010000:3.0:1789395137.923626:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395137.923629:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923635:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316b70b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923662:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b6fd lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106177 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923671:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395137.923673:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395137.923677:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b6fd lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106177 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.923684:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a800, rc 0) 00000100:00100000:3.0:1789395137.923735:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18286:x1876316231763584:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 471us (696us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395137.923744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23572 00000100:00100000:1.0:1789395137.935084:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395137.936004:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231763840 00000100:00100000:2.0:1789395137.936015:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231763840 00000100:00100000:2.0:1789395137.936078:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23573 00000100:00100000:2.0:1789395137.936088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18286:x1876316231763840:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395137.936113:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395137.936133:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b712 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210617e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936205:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936221:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936232:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936242:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936253:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b3d1 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936261:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.936292:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b3d1 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.936307:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239711360:0@lo:104: 00000100:00100000:2.0:1789395137.937000:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.937063:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789395137.937131:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711360 00000100:00100000:3.0:1789395137.937137:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711360 00000100:00100000:3.0:1789395137.937182:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1789395137.937189:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6511:x1876316239711360:12345-0@lo:104: 00010000:00010000:3.0:1789395137.937203:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.937263:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395137.937269:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6511:x1876316239711360:12345-0@lo:104: Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.937276:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1789395137.937345:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239711360:0@lo:104: 00010000:00010000:2.0:1789395137.937371:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.937507:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395137.937515:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.937525:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395137.937530:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395137.937540:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.937569:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.937576:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789395137.937606:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239711488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395137.937607:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.937625:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df600/0xff35729af316b3d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b3d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.937645:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395137.937648:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395137.937648:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395137.937652:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395137.937822:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711488 00000100:00100000:3.0:1789395137.937827:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711488 00010000:00010000:3.0:1789395137.937846:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b3d1 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.937905:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1789395137.937920:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+13:3639:x1876316239711488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395137.937932:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1789395137.940036:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968512 is committed 00010000:00010000:3.0:1789395137.940330:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b3d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b3d1 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.940350:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x84832a57 (ffff89a4df47a200) 00010000:00010000:3.0:1789395137.940355:0:16674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.940369:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.940451:0:16674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.940485:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395137.940749:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.940760:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.940816:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+12:3639:x1876316239711488:12345-0@lo:103:ldlm_bl.0 Request processed in 2902us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395137.940826:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00010000:00010000:2.0:1789395137.940864:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316b727 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.940873:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316b727 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.940879:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316b727 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395137.940889:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x194:0x0]: returning size 3 00000100:00100000:1.0:1789395137.940890:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239711488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.941130:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941140:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941147:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941154:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941160:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.941164:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941171:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941180:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395137.941183:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.941187:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941192:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc400/0xff35729af316b719 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941202:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941207:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941212:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941217:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395137.941219:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941228:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941234:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x84832a57 (ffff89a4df47a200) 00010000:00010000:2.0:1789395137.941236:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395137.941238:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941243:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941286:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b712 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210617e expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941419:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316b727 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210617e expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.941440:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:2.0:1789395137.941443:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395137.941446:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3ccc00, rc 0) 00000100:00100000:2.0:1789395137.941768:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18286:x1876316231763840:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 5681us (6693us total) trans 4294968513 rc 0/0 00000100:00100000:2.0:1789395137.941774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23573 00000100:00100000:0.0:1789395137.951777:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.951849:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231763968 00000100:00100000:1.0:1789395137.951861:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231763968 00000100:00100000:1.0:1789395137.951929:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5225 00000100:00100000:1.0:1789395137.951941:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231763968:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395137.951961:0:14652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395137.951984:0:14652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106185 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395137.952011:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 3, mtime: 0x6aa800c1, atime: 0x0, ctime: 0x6aa800c1, blocks: 0x8 00010000:00010000:1.0:1789395137.952032:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=589s v=(0 0) 00010000:00010000:1.0:1789395137.952036:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395137.952045:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 23 pid: 14652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.952065:0:14652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 23 pid: 14652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.952085:0:14652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:1.0:1789395137.956312:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2396:x1876316231763968:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 4361us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.956325:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5225 00000100:00100000:1.0:1789395137.968232:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.968435:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231764096 00000100:00100000:0.0:1789395137.968445:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231764096 00002000:00100000:0.0:1789395137.968491:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff89a4d99d7480 x1876316231764096/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 488/0 e 0 to 0 dl 1789395148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395137.968503:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4d99d7480 with x1876316231764096 ext(0->4095) 00002000:00010000:0.0:1789395137.968509:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4d99d7480 00000100:00100000:0.0:1789395137.968541:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:0.0:1789395137.968551:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2395:x1876316231764096:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:0.0:1789395137.968699:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2395:x1876316231764096:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 148us (475us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789395137.968707:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 12 00002000:00100000:0.0:1789395137.968713:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff89a4d99d7480 x1876316231764096/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:603/0 lens 488/4536 e 0 to 0 dl 1789395148 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395137.968722:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4d99d7480 with x1876316231764096 ext(0->4095) 00002000:00010000:0.0:1789395137.968725:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4d99d7480 00000100:00100000:2.0:1789395137.978522:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395137.978603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231764352 00000100:00100000:1.0:1789395137.978614:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231764352 00000100:00100000:1.0:1789395137.978662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5093 00000100:00100000:1.0:1789395137.978671:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:18286:x1876316231764352:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:1.0:1789395137.978965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18286:x1876316231764352:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 293us (452us total) trans 4294968514 rc 0/0 00000100:00100000:1.0:1789395137.978973:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5093 00000100:00100000:1.0:1789395137.993192:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395137.993343:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231764608 00000100:00100000:0.0:1789395137.993352:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231764608 00000100:00100000:0.0:1789395137.993498:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23574 00000100:00100000:0.0:1789395137.993516:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18288:x1876316231764608:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395137.993538:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395137.993560:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b73c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210618c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993635:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993650:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993663:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993673:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993680:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993686:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993726:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993733:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993738:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993749:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993755:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.993760:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993767:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993778:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:0.0:1789395137.993782:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.993786:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993792:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316b743 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993805:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993812:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993818:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993823:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395137.993826:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993836:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993843:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4c8e8d900) 00010000:00010000:0.0:1789395137.993845:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395137.993848:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993854:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316b74a lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993878:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b73c lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210618c expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993888:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:0.0:1789395137.993891:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395137.993895:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316b73c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210618c expref: 31 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395137.993904:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa000, rc 0) 00000100:00100000:0.0:1789395137.993975:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18288:x1876316231764608:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 468us (790us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395137.993983:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23574 00000100:00100000:2.0:1789395137.997966:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395137.998089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231764864 00000100:00100000:3.0:1789395137.998099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231764864 00000100:00100000:3.0:1789395137.998185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23575 00000100:00100000:3.0:1789395137.998196:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18288:x1876316231764864:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395137.998219:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395137.998238:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b751 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106193 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998319:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998333:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998346:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998356:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998371:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b368 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998379:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395137.998444:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b368 expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395137.998459:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239711616:0@lo:104: 00000100:00100000:3.0:1789395137.998524:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395137.998691:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395137.998901:0:10386:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789395137.998923:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711616 00000100:00100000:1.0:1789395137.998927:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711616 00000100:00100000:1.0:1789395137.998961:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1789395137.998968:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c7afe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239711616:12345-0@lo:104: 00010000:00010000:1.0:1789395137.998981:0:10386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395137.999030:0:10386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789395137.999036:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c7afe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6512:x1876316239711616:12345-0@lo:104: Request processed in 69us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395137.999042:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00010000:00010000:2.0:1789395137.999125:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395137.999132:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.999146:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abe00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395137.999153:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395137.999162:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.999187:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.999194:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395137.999219:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.999227:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca2abe00/0xff35729af316b368 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b36f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395137.999248:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.999249:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395137.999251:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395137.999258:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395137.999267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239711744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395137.999308:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395137.999335:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711744 00000100:00100000:2.0:1789395137.999339:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711744 00010000:00010000:2.0:1789395137.999355:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b368 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395137.999379:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:2.0:1789395137.999412:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3637:x1876316239711744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395137.999422:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789395137.999837:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6512:1876316239711616:0@lo:104: 00010000:00010000:2.0:1789395137.999855:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395138.001847:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968514 is committed 00010000:00010000:2.0:1789395138.001956:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015000/0xff35729af316b36f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b368 expref: 12 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.001975:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x391d5834 (ffff89a3c90d5600) 00010000:00010000:2.0:1789395138.001980:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.001990:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.001998:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.002027:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395138.002088:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3637:x1876316239711744:12345-0@lo:103:ldlm_bl.0 Request processed in 2702us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.002097:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00010000:00010000:3.0:1789395138.002157:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002166:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002267:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316b766 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002278:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316b766 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002286:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316b766 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395138.002297:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 2 00010000:00010000:3.0:1789395138.002371:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002416:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002423:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002431:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002436:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.002441:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002449:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002459:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395138.002462:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.002465:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002472:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b758 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002483:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002500:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.002551:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239711744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.002715:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002723:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.002726:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002733:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002742:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x391d5834 (ffff89a3c90d5600) 00010000:00010000:3.0:1789395138.002745:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.002748:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002755:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b75f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002798:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b751 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106193 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002811:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316b766 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106193 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.002819:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff89a3c90d5c00) 00010000:00010000:3.0:1789395138.002821:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395138.002824:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b600, rc 0) 00000100:00100000:3.0:1789395138.002875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18288:x1876316231764864:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 4681us (4917us total) trans 4294968515 rc 0/0 00000100:00100000:3.0:1789395138.002883:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23575 00000100:00100000:2.0:1789395138.007287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395138.007361:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231764992 00000100:00100000:1.0:1789395138.007369:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231764992 00000100:00100000:1.0:1789395138.007631:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5226 00000100:00100000:1.0:1789395138.007641:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231764992:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:1.0:1789395138.007658:0:14651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.007680:0:14651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210619a expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395138.007708:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x6aa800c0, atime: 0x0, ctime: 0x6aa800c0, blocks: 0x8 00010000:00010000:1.0:1789395138.007726:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=589s v=(0 0) 00010000:00010000:1.0:1789395138.007730:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395138.007739:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 22 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.007758:0:14651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 22 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.007770:0:14651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0c00, rc 0) 00000100:00100000:1.0:1789395138.007820:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231764992:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 181us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.007827:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5226 00000100:00100000:1.0:1789395138.010168:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.010252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231765120 00000100:00100000:3.0:1789395138.010261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231765120 00000100:00100000:3.0:1789395138.010339:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3473 00000100:00100000:3.0:1789395138.010349:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231765120:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:3.0:1789395138.010377:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395138.010430:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316b77b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010481:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010506:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010517:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010524:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010530:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010564:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010571:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010578:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010585:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.010589:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010596:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010612:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395138.010616:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.010620:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010627:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b782 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010640:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010646:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010652:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010658:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.010660:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010665:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010676:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c8e8d800) 00010000:00010000:3.0:1789395138.010678:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.010681:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010687:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b789 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010712:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316b77b lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061a1 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010721:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395138.010723:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395138.010727:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316b77b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061a1 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.010736:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ba00, rc -2) 00000100:00100000:3.0:1789395138.010791:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231765120:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 443us (629us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395138.010798:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3473 00000100:00100000:2.0:1789395138.013117:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395138.013215:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231765248 00000100:00100000:1.0:1789395138.013224:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231765248 00002000:00100000:1.0:1789395138.013314:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff89a3c8850700 x1876316231765248/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:604/0 lens 488/0 e 0 to 0 dl 1789395149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395138.013331:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8850700 with x1876316231765248 ext(0->4095) 00002000:00010000:1.0:1789395138.013338:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8850700 00000100:00100000:1.0:1789395138.013368:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:1.0:1789395138.013665:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231765248:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:1.0:1789395138.014341:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231765248:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 963us (1229us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789395138.014349:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 13 00002000:00100000:1.0:1789395138.014357:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff89a3c8850700 x1876316231765248/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:604/0 lens 488/4536 e 0 to 0 dl 1789395149 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395138.014367:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8850700 with x1876316231765248 ext(0->4095) 00002000:00010000:1.0:1789395138.014370:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8850700 00000100:00100000:2.0:1789395138.021098:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.021259:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231765504 00000100:00100000:0.0:1789395138.021268:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231765504 00000100:00100000:0.0:1789395138.021324:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5094 00000100:00100000:0.0:1789395138.021333:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:18288:x1876316231765504:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:0.0:1789395138.021792:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18288:x1876316231765504:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 459us (700us total) trans 4294968516 rc 0/0 00000100:00100000:0.0:1789395138.021800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5094 00000100:00100000:0.0:1789395138.052685:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395138.052951:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231765760 00000100:00100000:2.0:1789395138.052961:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231765760 00000100:00100000:2.0:1789395138.053019:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23576 00000100:00100000:2.0:1789395138.053030:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18292:x1876316231765760:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395138.053050:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395138.053070:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316b790 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061bd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053144:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053160:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053676:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053690:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053699:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053706:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053746:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053754:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053765:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053771:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053778:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395138.053975:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053984:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.053995:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395138.053999:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.054003:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054010:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316b797 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054023:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054029:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054035:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054039:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395138.054043:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054048:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054054:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c8e8d800) 00010000:00010000:2.0:1789395138.054057:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.054059:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054065:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316b79e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054096:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316b790 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061bd expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054105:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395138.054107:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395138.054111:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316b790 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061bd expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.054118:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd400, rc 0) 00000100:00100000:2.0:1789395138.054253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18292:x1876316231765760:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 1224us (1576us total) trans 0 rc 301/301 00000100:00100000:2.0:1789395138.054260:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23576 00000100:00100000:3.0:1789395138.059131:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.059221:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231766016 00000100:00100000:0.0:1789395138.059231:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231766016 00000100:00100000:0.0:1789395138.059289:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23577 00000100:00100000:0.0:1789395138.059299:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18292:x1876316231766016:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395138.059321:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.059340:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b7a5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061c4 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.059906:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.060045:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.060057:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.060069:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.060079:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b43a expref: 10 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.060087:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.060120:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b43a expref: 10 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.060135:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239711872:0@lo:104: 00000100:00100000:1.0:1789395138.060180:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.060261:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.060691:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239711872 00000100:00100000:2.0:1789395138.060697:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239711872 00000100:00100000:2.0:1789395138.060769:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1789395138.060778:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239711872:12345-0@lo:104: 00010000:00010000:2.0:1789395138.060792:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.060853:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789395138.060859:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7813:x1876316239711872:12345-0@lo:104: Request processed in 82us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.060865:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1789395138.060935:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239711872:0@lo:104: 00010000:00010000:3.0:1789395138.060954:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.061005:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395138.061011:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.061019:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395138.061025:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395138.061033:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.061061:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.061068:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395138.061095:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.061103:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca0e1a00/0xff35729af316b43a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b441 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.061121:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.061123:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.061125:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395138.061131:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395138.061142:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239712000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.061172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.061201:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712000 00000100:00100000:0.0:1789395138.061204:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712000 00010000:00010000:0.0:1789395138.061220:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b43a expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.061251:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1789395138.061258:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239712000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.061268:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1789395138.063870:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968516 is committed 00010000:00010000:2.0:1789395138.064017:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316b441 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b43a expref: 11 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.064181:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x18618557 (ffff89a3ca35f300) 00010000:00010000:2.0:1789395138.064186:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.064195:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.064203:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.064308:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395138.065088:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3636:x1876316239712000:12345-0@lo:103:ldlm_bl.0 Request processed in 3828us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.065099:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00010000:00010000:3.0:1789395138.065149:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065163:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065287:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316b7ba lrc: 3/1,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065454:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316b7ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065464:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316b7ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395138.065477:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x195:0x0]: returning size 2 00000100:00100000:1.0:1789395138.065562:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239712000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.065570:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065577:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065583:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065590:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065595:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.065599:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065607:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065826:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395138.065829:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.065833:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065840:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b7ac lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065852:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065858:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065864:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065868:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.065871:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065876:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065884:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x18618557 (ffff89a3ca35f300) 00010000:00010000:3.0:1789395138.065886:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.065889:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.065957:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b7b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.066008:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b7a5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061c4 expref: 16 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.066018:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316b7ba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061c4 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.066092:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff89a3c90d5600) 00010000:00010000:3.0:1789395138.066094:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395138.066096:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ba00, rc 0) 00000100:00100000:3.0:1789395138.066169:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18292:x1876316231766016:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 6871us (7047us total) trans 4294968517 rc 0/0 00000100:00100000:3.0:1789395138.066175:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23577 00000100:00100000:1.0:1789395138.071713:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.071763:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231766144 00000100:00100000:0.0:1789395138.071771:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231766144 00000100:00100000:0.0:1789395138.071818:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5227 00000100:00100000:0.0:1789395138.071829:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2395:x1876316231766144:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395138.071893:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.071927:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061cb expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395138.071961:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x6aa800c1, atime: 0x0, ctime: 0x6aa800c1, blocks: 0x8 00010000:00010000:0.0:1789395138.071982:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=589s v=(0 0) 00010000:00010000:0.0:1789395138.071987:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395138.071997:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 24 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.072014:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 24 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.072027:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab600, rc 0) 00000100:00100000:0.0:1789395138.072113:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2395:x1876316231766144:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 286us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.072118:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5227 00000100:00100000:0.0:1789395138.079578:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395138.079851:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231766272 00000100:00100000:2.0:1789395138.079859:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231766272 00002000:00100000:2.0:1789395138.079962:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff89a3c988ce00 x1876316231766272/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:604/0 lens 488/0 e 0 to 0 dl 1789395149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395138.079974:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ce00 with x1876316231766272 ext(0->4095) 00002000:00010000:2.0:1789395138.079981:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988ce00 00000100:00100000:2.0:1789395138.080013:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 14 00000100:00100000:2.0:1789395138.080022:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2396:x1876316231766272:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:2.0:1789395138.080178:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2396:x1876316231766272:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 156us (608us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789395138.080186:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 14 00002000:00100000:2.0:1789395138.080193:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff89a3c988ce00 x1876316231766272/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:604/0 lens 488/4536 e 0 to 0 dl 1789395149 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395138.080200:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ce00 with x1876316231766272 ext(0->4095) 00002000:00010000:2.0:1789395138.080203:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988ce00 00000100:00100000:3.0:1789395138.087196:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.087439:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231766528 00000100:00100000:0.0:1789395138.087449:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231766528 00000100:00100000:0.0:1789395138.087499:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5095 00000100:00100000:0.0:1789395138.087508:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:18292:x1876316231766528:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:0.0:1789395138.087791:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18292:x1876316231766528:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 283us (602us total) trans 4294968518 rc 0/0 00000100:00100000:0.0:1789395138.087800:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5095 00000100:00100000:1.0:1789395138.103930:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.104037:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231766784 00000100:00100000:3.0:1789395138.104046:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231766784 00000100:00100000:3.0:1789395138.104135:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23578 00000100:00100000:3.0:1789395138.104146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18294:x1876316231766784:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:3.0:1789395138.104165:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395138.104185:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b7cf lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061d2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104254:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104268:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104282:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104304:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104426:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104464:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104471:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104478:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104485:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104490:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.104495:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104503:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104514:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395138.104517:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.104522:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104529:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b7d6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104543:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104550:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104556:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104561:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.104564:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104570:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104577:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3c90d5800) 00010000:00010000:3.0:1789395138.104580:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.104583:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104588:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b7dd lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104720:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b7cf lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061d2 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104731:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395138.104734:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789395138.104738:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316b7cf lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061d2 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.104748:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23aa00, rc 0) 00000100:00100000:3.0:1789395138.104812:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18294:x1876316231766784:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 667us (898us total) trans 0 rc 301/301 00000100:00100000:3.0:1789395138.104819:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23578 00000100:00100000:2.0:1789395138.110034:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.110173:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231767040 00000100:00100000:0.0:1789395138.110183:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231767040 00000100:00100000:0.0:1789395138.110274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23579 00000100:00100000:0.0:1789395138.110286:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18294:x1876316231767040:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:0.0:1789395138.110378:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.110437:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b7e4 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061d9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110508:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110522:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110532:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110541:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110550:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b575 expref: 9 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110558:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.110590:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316b575 expref: 9 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.110605:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239712128:0@lo:104: 00000100:00100000:0.0:1789395138.110652:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.110689:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.110812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712128 00000100:00100000:3.0:1789395138.110816:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712128 00000100:00100000:3.0:1789395138.110843:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1789395138.110861:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6511:x1876316239712128:12345-0@lo:104: 00010000:00010000:3.0:1789395138.110875:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.111061:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6511:1876316239712128:0@lo:104: 00010000:00010000:0.0:1789395138.111078:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.111110:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395138.111118:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6511:x1876316239712128:12345-0@lo:104: Request processed in 258us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.111124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00010000:00010000:3.0:1789395138.111147:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395138.111153:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.111161:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395138.111166:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395138.111175:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.111200:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.111206:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789395138.111259:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239712256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.111292:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789395138.111424:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.111434:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff89a3ca3df200/0xff35729af316b575 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316b57c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.111452:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.111454:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.111455:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395138.111511:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712256 00000100:00100000:0.0:1789395138.111516:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712256 00010000:00010000:0.0:1789395138.111535:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316b575 expref: 10 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.111566:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1789395138.111573:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239712256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.111584:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1789395138.113779:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968518 is committed 00010000:00010000:0.0:1789395138.114173:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316b57c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316b575 expref: 10 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.114191:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xb62e0cbf (ffff89a3ca363d00) 00010000:00010000:0.0:1789395138.114196:0:20671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.114205:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.114212:0:20671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.114244:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.114323:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239712256:12345-0@lo:103:ldlm_bl.0 Request processed in 2750us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.114332:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00010000:00010000:2.0:1789395138.114484:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.114493:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.114547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239712256:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395138.114764:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316b7f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.114776:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316b7f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.114785:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316b7f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395138.114796:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x198:0x0]: returning size 2 00010000:00010000:2.0:1789395138.115313:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115323:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115329:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115335:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115341:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395138.115345:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115353:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115365:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395138.115368:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.115373:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115498:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2abc00/0xff35729af316b7eb lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115510:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115516:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115521:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115526:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395138.115529:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115534:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115542:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xb62e0cbf (ffff89a3ca363d00) 00010000:00010000:2.0:1789395138.115545:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.115547:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115552:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa200/0xff35729af316b7f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115669:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b7e4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061d9 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115685:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316b7f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061d9 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.115693:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:2.0:1789395138.115695:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395138.115697:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cde00, rc 0) 00000100:00100000:2.0:1789395138.115747:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18294:x1876316231767040:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 5463us (5722us total) trans 4294968519 rc 0/0 00000100:00100000:2.0:1789395138.115755:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23579 00000100:00100000:0.0:1789395138.123240:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395138.123557:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231767168 00000100:00100000:2.0:1789395138.123567:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231767168 00000100:00100000:2.0:1789395138.123626:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5228 00000100:00100000:2.0:1789395138.123636:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2396:x1876316231767168:12345-192.168.203.54@tcp:101:cmp.0 00010000:00010000:2.0:1789395138.123654:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395138.123673:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061e0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395138.123698:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 2, mtime: 0x6aa800c1, atime: 0x0, ctime: 0x6aa800c1, blocks: 0x8 00010000:00010000:2.0:1789395138.123718:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=589s v=(0 0) 00010000:00010000:2.0:1789395138.123722:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395138.123731:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 23 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.123745:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 23 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.123759:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd000, rc 0) 00000100:00100000:2.0:1789395138.123819:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2396:x1876316231767168:12345-192.168.203.54@tcp:101:cmp.0 Request processed in 184us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.123825:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5228 00000100:00100000:1.0:1789395138.129520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.129710:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231767296 00000100:00100000:0.0:1789395138.129720:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231767296 00002000:00100000:0.0:1789395138.129773:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->4095) req@ffff89a4d99d5180 x1876316231767296/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:604/0 lens 488/0 e 0 to 0 dl 1789395149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395138.129785:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4d99d5180 with x1876316231767296 ext(0->4095) 00002000:00010000:0.0:1789395138.129791:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4d99d5180 00000100:00100000:0.0:1789395138.129864:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 15 00000100:00100000:0.0:1789395138.129875:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2398:x1876316231767296:12345-192.168.203.54@tcp:3:cmp.0 00000100:00100000:0.0:1789395138.130076:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2398:x1876316231767296:12345-192.168.203.54@tcp:3:cmp.0 Request processed in 202us (565us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789395138.130084:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 15 00002000:00100000:0.0:1789395138.130092:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->4095) req@ffff89a4d99d5180 x1876316231767296/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:604/0 lens 488/4536 e 0 to 0 dl 1789395149 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395138.130101:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4d99d5180 with x1876316231767296 ext(0->4095) 00002000:00010000:0.0:1789395138.130105:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4d99d5180 00000100:00100000:0.0:1789395138.139171:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395138.139540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231767552 00000100:00100000:1.0:1789395138.139550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231767552 00000100:00100000:1.0:1789395138.139640:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5096 00000100:00100000:1.0:1789395138.139651:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18294:x1876316231767552:12345-192.168.203.54@tcp:35:cmp.0 00000100:00100000:1.0:1789395138.139939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18294:x1876316231767552:12345-192.168.203.54@tcp:35:cmp.0 Request processed in 289us (776us total) trans 4294968520 rc 0/0 00000100:00100000:1.0:1789395138.139947:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5096 00000100:00100000:3.0:1789395138.149538:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395138.149957:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231767680 00000100:00100000:1.0:1789395138.149968:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231767680 00000100:00100000:1.0:1789395138.150036:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3474 00000100:00100000:1.0:1789395138.150048:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231767680:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:1.0:1789395138.150087:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.150106:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b80e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061e7 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.150162:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.150175:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.150186:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.150199:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.150205:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.150211:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151039:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151054:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151060:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151066:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395138.151071:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151080:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151092:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395138.151096:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.151100:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151107:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316b815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151122:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151129:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151135:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151140:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395138.151143:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151149:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151155:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x861f4748 (ffff89a3ca363100) 00010000:00010000:1.0:1789395138.151157:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.151161:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151167:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b81c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151198:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b80e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e7 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151208:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395138.151211:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395138.151215:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b80e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e7 expref: 31 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.151223:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1a00, rc -2) 00000100:00100000:1.0:1789395138.151652:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231767680:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 1604us (2118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395138.151660:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3474 00000100:00100000:2.0:1789395138.156352:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.156479:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231767808 00000100:00100000:3.0:1789395138.156489:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231767808 00000100:00100000:3.0:1789395138.156581:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23580 00000100:00100000:3.0:1789395138.156592:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18295:x1876316231767808:12345-192.168.203.54@tcp:41:rm.0 00000004:00000024:3.0:1789395138.156642:0:7813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847018496 avail 7383801856 00000100:00100000:3.0:1789395138.156711:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:18295:x1876316231767808:12345-192.168.203.54@tcp:41:rm.0 Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.156718:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23580 00000100:00100000:2.0:1789395138.169301:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.170293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231768064 00000100:00100000:3.0:1789395138.170304:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231768064 00000100:00100000:3.0:1789395138.170482:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23581 00000100:00100000:3.0:1789395138.170493:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18295:x1876316231768064:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.170549:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.170575:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b600/0xff35729af316b766 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106193 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.170598:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff89a3c90d5c00) 00010000:00010000:3.0:1789395138.170609:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395138.170657:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.170665:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.170675:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.170696:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239712384:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395138.170749:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.170820:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.170999:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712384 00000100:00100000:1.0:1789395138.171006:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712384 00000100:00100000:1.0:1789395138.171053:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3475 00000100:00100000:1.0:1789395138.171061:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6512:x1876316239712384:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1789395138.171087:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.171104:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b823 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.171129:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.171145:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 4/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 25 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.171169:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.171194:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 29 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.171206:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239712512:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395138.171270:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.174275:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239712512:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395138.174309:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 25 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.174323:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:1.0:1789395138.174326:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.174330:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 25 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.174340:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1a00, rc 0) 00000100:00100000:1.0:1789395138.175538:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6512:x1876316239712384:12345-0@lo:101:mdt00_001.0 Request processed in 4472us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.175549:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3475 00000100:00100000:3.0:1789395138.176109:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239712384:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395138.176132:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.176145:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.187452:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.188210:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231768192 00000100:00100000:3.0:1789395138.188221:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231768192 00010000:00010000:3.0:1789395138.188272:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 30 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.188316:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1588 00000100:00100000:3.0:1789395138.188327:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:2395:x1876316231768192:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.188343:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.188349:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 30 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.188363:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 30 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.188418:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316b5e5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106115 expref: 30 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.188434:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:3.0:1789395138.188442:0:8441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 24 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.188453:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 24 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.188463:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 24 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.188495:0:8441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 24 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.188514:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239712640:0@lo:105: 00000100:00100000:3.0:1789395138.188563:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.188609:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.188648:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712640 00000100:00100000:1.0:1789395138.188653:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712640 00000100:00100000:1.0:1789395138.188689:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1789395138.188696:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239712640:12345-0@lo:105: 00010000:00010000:1.0:1789395138.188708:0:6493:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.188719:0:6493:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.188728:0:6493:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.188735:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.188743:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.188751:0:6493:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.188778:0:6493:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca23aa00) 00000100:00100000:1.0:1789395138.188819:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8441:x1876316239712640:12345-0@lo:105: Request processed in 123us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.188825:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1789395138.188858:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8441:1876316239712640:0@lo:105: 00010000:00010000:1.0:1789395138.188873:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395138.188906:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:2395:x1876316231768192:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 581us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.188924:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1588 00010000:00010000:3.0:1789395138.190488:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.190505:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.190529:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.190573:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.190582:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.190593:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.190611:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239712768:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1789395138.190655:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.190687:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.193627:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712768 00000100:00100000:2.0:1789395138.193640:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712768 00000100:00100000:2.0:1789395138.193711:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476 00000100:00100000:2.0:1789395138.193724:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:6512:x1876316239712768:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1789395138.193745:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395138.193766:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b831 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.193794:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.193803:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.193820:0:6516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1789395138.193850:0:6516:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1789395138.193896:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.193906:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4c8e8d900) 00010000:00010000:2.0:1789395138.193908:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.193920:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.193928:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc000, rc 0) 00000100:00100000:2.0:1789395138.194003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+26:6512:x1876316239712768:12345-0@lo:101:mdt00_001.0 Request processed in 282us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.194009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476 00000100:00100000:3.0:1789395138.194159:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239712768:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1789395138.194175:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.194185:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395138.195694:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983568 is committed 00000001:00080000:1.0:1789395138.195721:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983565 is committed 00010000:00010000:0.0:1789395138.196419:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196431:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196440:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196448:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.196452:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196460:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196477:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4c8e8d900) 00010000:00010000:0.0:1789395138.196479:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.196485:0:3623:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196496:0:3623:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.196504:0:3623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.196586:0:3623:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.196602:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3623:1876316239712896:0@lo:105: 00000100:00100000:1.0:1789395138.196649:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.196725:0:3623:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.197715:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239712896 00000100:00100000:3.0:1789395138.197724:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239712896 00000100:00100000:3.0:1789395138.197781:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1789395138.197789:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3623:x1876316239712896:12345-0@lo:105: 00010000:00010000:3.0:1789395138.197803:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.197814:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.197824:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.197832:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.197841:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.197849:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.197875:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca23b600) 00000100:00100000:3.0:1789395138.197947:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3623:x1876316239712896:12345-0@lo:105: Request processed in 155us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.197954:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00010000:00010000:2.0:1789395138.198036:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.198055:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395138.198138:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:0.0:1789395138.198154:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3623:1876316239712896:0@lo:105: 00010000:00010000:0.0:1789395138.198176:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198186:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b37d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198201:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198209:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198216:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.198228:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239713024:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789395138.198230:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.198237:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198245:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198259:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:0.0:1789395138.198262:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395138.198266:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198272:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b384 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.198276:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395138.198302:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.198306:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd000 going to sleep for 11 seconds 00010000:00010000:0.0:1789395138.198311:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198319:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198325:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014400 already unused, calling callback (ffffffffc195d4f0) 00000100:00100000:3.0:1789395138.198328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713024 00010000:00010000:0.0:1789395138.198329:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.198334:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713024 00010000:00010000:0.0:1789395138.198338:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198352:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a3c90d5a00) 00010000:00010000:0.0:1789395138.198355:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.198358:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.198363:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316b3e6 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.198369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3477 00010000:00010000:0.0:1789395138.198376:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.198405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239713024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789395138.198477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239713024:12345-0@lo:1000:mdt00_001.0 Request processed in 101us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.198492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3477 00000100:00100000:2.0:1789395138.198507:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983568 gen 2 00000004:00080000:2.0:1789395138.198513:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983554 committed transno 4294983568 00000004:00080000:2.0:1789395138.198528:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983566 committed transno 4294983568 00000020:00080000:2.0:1789395138.198533:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3ca6cd3c0 refcount 2 committed 0 result 0 batchid 398 00000020:00080000:2.0:1789395138.198537:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c7468d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca6cde40 00000020:00080000:2.0:1789395138.198540:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].392 00000020:00080000:2.0:1789395138.198542:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c7468c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca3eec00 00000020:00080000:2.0:1789395138.198545:0:6512:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].392 00000020:00080000:3.0:1789395138.198582:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 398 committed batchid 397 00000004:00080000:2.0:1789395138.198656:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983567 committed transno 4294983568 00000004:00080000:2.0:1789395138.198664:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983568 committed transno 4294983568 00000100:00100000:2.0:1789395138.198673:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239713024:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395138.198710:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239713152:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395138.198732:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.198752:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.198764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713152 00000100:00100000:2.0:1789395138.198768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713152 00000100:00100000:2.0:1789395138.198794:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3478 00000100:00100000:2.0:1789395138.198800:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239713152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395138.198859:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239713152:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.198865:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3478 00000100:00100000:2.0:1789395138.198889:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239713152:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395138.198934:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239713280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395138.198956:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.198969:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.198980:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713280 00000100:00100000:2.0:1789395138.198983:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713280 00000100:00100000:2.0:1789395138.199002:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479 00000100:00100000:2.0:1789395138.199007:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239713280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789395138.199060:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6512:x1876316239713280:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (102us total) trans 0 rc -2/-2 00010000:00010000:0.0:1789395138.199124:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199133:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199138:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199141:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199147:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199158:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:0.0:1789395138.199161:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395138.199164:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199170:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316b3ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789395138.199217:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 397 00000100:00100000:2.0:1789395138.199285:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479 00010000:00010000:0.0:1789395138.199306:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199314:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.199319:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6512:1876316239713280:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789395138.199324:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199331:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199334:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395138.199337:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:0.0:1789395138.199343:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.199347:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199359:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c8e8d800) 00010000:00010000:2.0:1789395138.199361:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199365:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.199371:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.199374:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199400:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b44f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199416:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199422:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199429:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199435:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199438:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199444:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199453:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:0.0:1789395138.199456:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395138.199459:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199468:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316b456 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199484:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199491:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199498:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199504:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199507:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199513:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.199520:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395138.199525:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3ca363e00) 00000004:00080000:2.0:1789395138.199528:0:6512:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:0.0:1789395138.199529:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.199535:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199536:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199554:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316b4b8 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.199557:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199571:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.199578:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199582:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199591:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199598:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199602:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199608:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199615:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:0.0:1789395138.199618:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395138.199620:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199626:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316b4bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199641:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199648:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199654:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199659:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199662:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199667:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199674:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a3ca35fe00) 00010000:00010000:0.0:1789395138.199677:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.199679:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199685:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316b521 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199698:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199704:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199710:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199714:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199717:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199723:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199730:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395138.199732:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395138.199735:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199740:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316b528 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199752:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199759:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199765:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199769:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199772:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199777:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199787:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3c90d5800) 00010000:00010000:0.0:1789395138.199790:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.199793:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199799:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316b58a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199810:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199815:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199819:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395138.199824:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199828:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199832:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.199838:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199841:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23aa00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395138.199849:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199851:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395138.199867:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199870:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395138.199877:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1789395138.199882:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.199889:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316b591 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199899:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199908:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395138.199946:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199953:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23aa00/0xff35729af316b823 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b82a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199968:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395138.199972:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.199979:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b600 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395138.199982:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 5/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395138.199989:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 5/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.200006:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.200012:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395138.200029:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.200037:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.200039:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.200041:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395138.200048:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395138.200058:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239713408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.200097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.200230:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395138.200239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239713536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395138.200264:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.200320:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713408 00000100:00100000:1.0:1789395138.200325:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713408 00000100:00100000:1.0:1789395138.200359:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713536 00000100:00100000:1.0:1789395138.200361:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713536 00000100:00100000:1.0:1789395138.200377:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1789395138.200402:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3638:x1876316239713408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395138.200413:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395138.200429:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316b82a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b823 expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.200439:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:1.0:1789395138.200446:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395138.200473:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3638:x1876316239713408:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.200480:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1789395138.200492:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1789395138.200498:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239713536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395138.200505:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395138.200514:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316b838 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b831 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.200524:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x391d5834 (ffff89a4c8e8d900) 00010000:00010000:1.0:1789395138.200530:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395138.200551:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239713536:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.200558:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1789395138.200712:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239713408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395138.200776:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239713536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395138.200831:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789395138.200836:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b600/0xff35729af316b831 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.200940:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395138.200947:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18295:x1876316231768064:12345-192.168.203.54@tcp:36:rm.0 Request processed in 30454us (31652us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395138.200955:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23581 00000100:00100000:2.0:1789395138.210092:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.213763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231768448 00000100:00100000:0.0:1789395138.213777:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231768448 00000100:00100000:1.0:1789395138.213959:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23582 00000100:00100000:1.0:1789395138.213971:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18295:x1876316231768448:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:1.0:1789395138.214025:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395138.214051:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015400/0xff35729af316b5d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210610e expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.214073:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:1.0:1789395138.214085:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395138.214109:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.214122:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.214132:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.214966:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.214976:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.214983:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.215046:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.215055:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.215061:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395138.215934:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789395138.215946:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 589269560369ns, next at 590269557778ns, rc = 0 00010000:00010000:1.0:1789395138.215990:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216001:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216009:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216017:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216024:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216030:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216093:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395138.216113:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216119:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216126:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216132:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.216201:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395138.216207:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.216214:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395138.216217:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.216645:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.216659:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:0.0:1789395138.216662:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395138.216666:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.216673:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316b854 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216919:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216933:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216943:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:1.0:1789395138.216946:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395138.216948:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.216954:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316b84d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.216986:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.216989:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.216991:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.217028:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217036:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217042:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217048:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217054:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395138.217057:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217063:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217072:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a4c7eb6e00) 00010000:00010000:1.0:1789395138.217075:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.217077:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217083:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316b83f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395138.217095:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000324aafb5 reply state 00000000fb479363 transno 4294968521 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217106:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.217112:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x391d5834 (ffff89a4c7eb6400) 00010000:00010000:1.0:1789395138.217114:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395138.217117:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395138.217738:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18295:x1876316231768448:12345-192.168.203.54@tcp:36:rm.0 Request processed in 3764us (7651us total) trans 4294968521 rc 0/0 00000100:00100000:1.0:1789395138.217746:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23582 00000100:00100000:1.0:1789395138.225644:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395138.225666:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239713664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395138.225729:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.225825:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713664 00000100:00100000:2.0:1789395138.225833:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713664 00000100:00100000:2.0:1789395138.225878:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480 00000100:00100000:2.0:1789395138.225887:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239713664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789395138.225930:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444036608 avail 1297797120 00000100:00100000:2.0:1789395138.225981:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239713664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.225988:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480 00000100:00100000:3.0:1789395138.226068:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239713664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395138.226591:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.226650:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231768704 00000100:00100000:3.0:1789395138.226654:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231768704 00000100:00100000:3.0:1789395138.226690:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23583 00000100:00100000:3.0:1789395138.226701:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18295:x1876316231768704:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.226743:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.226765:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3ccc00/0xff35729af316b727 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210617e expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.226784:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:3.0:1789395138.226793:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395138.226827:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.226841:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.226851:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.226865:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239713792:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1789395138.226891:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.226923:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.227031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713792 00000100:00100000:0.0:1789395138.227035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713792 00000100:00100000:0.0:1789395138.227067:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:0.0:1789395138.227073:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:7813:x1876316239713792:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789395138.227082:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.227097:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b862 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b85b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.227119:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b862 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b85b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.227132:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b862 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b85b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.227139:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395138.227143:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.227145:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aaa00, rc 0) 00000100:00100000:0.0:1789395138.227175:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:7813:x1876316239713792:12345-0@lo:101:mdt00_003.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.227181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:2.0:1789395138.227249:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239713792:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1789395138.227263:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.227274:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395138.227289:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1789395138.227308:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.227315:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.227322:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.227332:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239713920:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1789395138.227354:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.227406:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.227513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239713920 00000100:00100000:3.0:1789395138.227517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239713920 00000100:00100000:3.0:1789395138.227540:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1789395138.227546:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7813:x1876316239713920:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789395138.227554:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395138.227566:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b870 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.227581:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b870 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b869 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.227591:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b870 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b869 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.227598:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a3c90d5100) 00010000:00010000:3.0:1789395138.227601:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.227603:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ae00, rc 0) 00000100:00100000:3.0:1789395138.227632:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239713920:12345-0@lo:101:mdt00_003.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.227641:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1789395138.227666:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239713920:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789395138.227675:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.227684:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.227695:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1789395138.227721:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239714048:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.227743:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.227755:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.227765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714048 00000100:00100000:3.0:1789395138.227768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714048 00000100:00100000:3.0:1789395138.227782:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1789395138.227787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239714048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.227835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239714048:12345-0@lo:1000:mdt00_003.0 Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.227841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1789395138.227861:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239714048:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.227893:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239714176:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.227924:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.227937:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.227946:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714176 00000100:00100000:3.0:1789395138.227949:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714176 00000100:00100000:3.0:1789395138.227962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484 00000100:00100000:3.0:1789395138.227968:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239714176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.228025:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239714176:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (112us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395138.228031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484 00000100:00100000:3.0:1789395138.228050:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239714176:0@lo:1000:mdt00_003.0 00000004:00080000:3.0:1789395138.228064:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.228068:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228077:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228085:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228100:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395138.228104:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.228110:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395138.228115:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228123:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395138.228128:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395138.228136:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228160:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228167:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395138.228183:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228190:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b85b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b862 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228204:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.228206:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.228207:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395138.228214:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395138.228221:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239714304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395138.228244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.228271:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714304 00000100:00100000:3.0:1789395138.228274:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714304 00000100:00100000:3.0:1789395138.228297:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1789395138.228302:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239714304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.228311:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.228323:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b862 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b85b expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.228333:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:3.0:1789395138.228339:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395138.228363:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239714304:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.228369:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1789395138.229314:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239714304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.229336:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.229346:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.229353:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.229371:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789395138.229598:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18295:x1876316231768704:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2895us (3006us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395138.229606:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23583 00010000:00010000:0.0:1789395138.229665:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395138.229671:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.229679:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395138.229684:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395138.229693:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.229722:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.229734:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395138.229755:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.229763:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cd800/0xff35729af316b869 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b870 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.229778:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.229780:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.229781:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395138.229787:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789395138.229796:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239714432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.229831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.229859:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714432 00000100:00100000:0.0:1789395138.229863:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714432 00000100:00100000:0.0:1789395138.229898:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1789395138.229905:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239714432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.229926:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395138.229940:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316b870 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b869 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.229953:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x84832a57 (ffff89a3c90d5100) 00010000:00010000:0.0:1789395138.229959:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.229989:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239714432:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.229998:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1789395138.230031:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239714432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.238251:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.239000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231768960 00000100:00100000:0.0:1789395138.239010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231768960 00000100:00100000:0.0:1789395138.239068:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23584 00000100:00100000:0.0:1789395138.239078:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:18295:x1876316231768960:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395138.239153:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239169:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239180:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239191:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239199:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239205:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239255:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239263:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239270:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395138.239508:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789395138.239518:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 589293132305ns, next at 590293129943ns, rc = 0 00010000:00010000:0.0:1789395138.239559:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239568:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239576:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239584:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239590:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239596:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239611:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395138.239625:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239630:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239637:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239643:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.239647:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239659:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239670:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395138.239673:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395138.239677:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239683:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab400/0xff35729af316b885 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239701:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239707:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239713:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239719:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239723:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.239726:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239732:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239738:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395138.239741:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.239743:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239750:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aaa00/0xff35729af316b877 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395138.239763:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca051a57 reply state 00000000634def91 transno 4294968522 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239773:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.239779:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x84832a57 (ffff89a3c8b1dc00) 00010000:00010000:0.0:1789395138.239782:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395138.239784:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395138.239853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18295:x1876316231768960:12345-192.168.203.54@tcp:36:rm.0 Request processed in 775us (1611us total) trans 4294968522 rc 0/0 00000100:00100000:0.0:1789395138.239861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23584 00010000:00010000:1.0:1789395138.239878:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395138.239904:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.239923:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395138.239928:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.239936:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.239948:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:1.0:1789395138.239951:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395138.239954:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 1/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.239964:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aac00/0xff35729af316b88c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.239983:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.239986:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.239988:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395138.248341:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395138.249434:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231769216 00000100:00100000:1.0:1789395138.249446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231769216 00000100:00100000:1.0:1789395138.249507:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23585 00000100:00100000:1.0:1789395138.249518:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18295:x1876316231769216:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:1.0:1789395138.249574:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395138.249599:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aae00/0xff35729af316b6e8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106169 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.249619:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff89a3c8b1d600) 00010000:00010000:1.0:1789395138.249630:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395138.249676:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.249685:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.249695:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.249719:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714560:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1789395138.249769:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.249809:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.249825:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714560 00000100:00100000:3.0:1789395138.249831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714560 00000100:00100000:3.0:1789395138.249951:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3485 00000100:00100000:3.0:1789395138.249960:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239714560:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395138.249970:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395138.249987:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b89a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.250010:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b89a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b893 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.250024:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b89a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b893 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.250032:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395138.250035:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.250038:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a800, rc 0) 00000100:00100000:3.0:1789395138.250082:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:6511:x1876316239714560:12345-0@lo:101:mdt00_000.0 Request processed in 124us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.250089:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3485 00000100:00100000:1.0:1789395138.250150:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714560:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395138.250179:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.250190:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395138.250208:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:1.0:1789395138.250227:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.250234:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.250241:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.250252:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714688:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1789395138.250273:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.250837:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.250879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714688 00000100:00100000:0.0:1789395138.250884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714688 00000100:00100000:0.0:1789395138.250928:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3486 00000100:00100000:0.0:1789395138.250937:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6511:x1876316239714688:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395138.250945:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.250959:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b8a8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b8a1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.250977:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b8a1 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.250993:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b8a1 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.251001:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395138.251003:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.251006:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aaa00, rc 0) 00000100:00100000:0.0:1789395138.251037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239714688:12345-0@lo:101:mdt00_000.0 Request processed in 102us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.251043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486 00000100:00100000:1.0:1789395138.251142:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714688:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395138.251156:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.251182:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395138.251196:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:1.0:1789395138.251225:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714816:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395138.251251:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.251269:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.251369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714816 00000100:00100000:0.0:1789395138.251373:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714816 00000100:00100000:0.0:1789395138.251419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3487 00000100:00100000:0.0:1789395138.251425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239714816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395138.251479:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239714816:12345-0@lo:1000:mdt00_000.0 Request processed in 53us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.251485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3487 00000100:00100000:1.0:1789395138.251772:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714816:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395138.251806:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714944:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395138.251829:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.251849:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.251922:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239714944 00000100:00100000:3.0:1789395138.251928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239714944 00000100:00100000:3.0:1789395138.251969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3488 00000100:00100000:3.0:1789395138.251977:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239714944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395138.252065:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239714944:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (234us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395138.252074:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3488 00000100:00100000:1.0:1789395138.252088:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239714944:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1789395138.252107:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:1.0:1789395138.252113:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.252121:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.252129:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.252151:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395138.252155:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:1.0:1789395138.252159:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.252231:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.252239:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.252255:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789395138.252313:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18295:x1876316231769216:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2796us (3979us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395138.252320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23585 00010000:00010000:0.0:1789395138.252366:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395138.252372:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252411:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395138.252417:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395138.252426:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252455:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252462:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395138.252483:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252491:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1a00/0xff35729af316b893 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b89a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252508:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395138.252512:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252518:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395138.252522:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.252524:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789395138.252533:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252549:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252555:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395138.252560:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252572:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca0e1800/0xff35729af316b8a1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8a8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.252583:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.252585:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.252587:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395138.252597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239715200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.252623:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.252680:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715200 00000100:00100000:3.0:1789395138.252685:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715200 00000100:00100000:3.0:1789395138.252718:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1789395138.252724:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239715200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.252735:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.252751:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316b8a8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b8a1 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.252765:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xbc0ca3a9 (ffff89a3c8b1d500) 00010000:00010000:3.0:1789395138.252774:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395138.252797:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239715072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395138.252804:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239715200:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.252814:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1789395138.252829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.252893:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239715200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395138.257999:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715072 00000100:00100000:3.0:1789395138.258014:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715072 00000100:00100000:3.0:1789395138.258104:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1789395138.258114:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239715072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.258130:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.258153:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316b89a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b893 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.258171:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395138.258181:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395138.264470:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239715072:12345-0@lo:103:ldlm_bl.0 Request processed in 6348us (11632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.264486:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1789395138.264691:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239715072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.264695:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.265041:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231769472 00000100:00100000:3.0:1789395138.265049:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231769472 00000100:00100000:3.0:1789395138.265143:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23586 00000100:00100000:3.0:1789395138.265153:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:18295:x1876316231769472:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.265226:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265431:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265443:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265457:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265464:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265471:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265530:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265539:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265546:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395138.265759:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:3.0:1789395138.265800:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265810:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265817:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265824:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265831:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265837:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265861:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395138.265876:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265894:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265901:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265907:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.265920:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265928:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.265940:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff89a3c90d5700) 00010000:00010000:3.0:1789395138.265944:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395138.265947:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395138.265955:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.265963:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395138.265966:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.265974:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.265984:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff89a3c90d5700) 00010000:00010000:1.0:1789395138.265988:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395138.265991:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.265997:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b800/0xff35729af316b8c4 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.266013:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.266015:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.266017:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.266018:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266028:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b8bd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266049:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266056:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266061:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266068:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266073:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.266076:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266082:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266088:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5300) 00010000:00010000:3.0:1789395138.266091:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.266093:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266099:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b8af lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395138.266109:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251e6b67 reply state 00000000d0ddcbb2 transno 4294968523 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266221:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.266227:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xbc0ca3a9 (ffff89a3c90d5d00) 00010000:00010000:3.0:1789395138.266230:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395138.266289:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395138.266359:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18295:x1876316231769472:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1207us (1668us total) trans 4294968523 rc 0/0 00000100:00100000:3.0:1789395138.266367:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23586 00000100:00100000:2.0:1789395138.274706:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.274761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231769728 00000100:00100000:3.0:1789395138.274771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231769728 00000100:00100000:3.0:1789395138.274830:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23587 00000100:00100000:3.0:1789395138.274840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18295:x1876316231769728:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.274901:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.274935:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cde00/0xff35729af316b7f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061d9 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.274955:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:3.0:1789395138.274965:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395138.275008:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.275017:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.275026:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.275045:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715328:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1789395138.275100:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.275152:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.275200:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715328 00000100:00100000:2.0:1789395138.275205:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715328 00000100:00100000:2.0:1789395138.275246:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3489 00000100:00100000:2.0:1789395138.275253:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:6513:x1876316239715328:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395138.275264:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395138.275279:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316b8d2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b8cb expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.275307:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316b8d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b8cb expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.275320:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316b8d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b8cb expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.275328:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395138.275331:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.275334:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cdc00, rc 0) 00000100:00100000:2.0:1789395138.275375:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239715328:12345-0@lo:101:mdt00_002.0 Request processed in 122us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.275403:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3489 00000100:00100000:3.0:1789395138.275451:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715328:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1789395138.275467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.275478:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.275501:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.275520:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.275526:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.275534:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.275545:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715456:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1789395138.275565:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.275588:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.275666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715456 00000100:00100000:0.0:1789395138.275671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715456 00000100:00100000:0.0:1789395138.275761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490 00000100:00100000:0.0:1789395138.275770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239715456:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395138.275778:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.275791:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b8e0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b8d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.275809:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b8e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b8d9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.275819:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b8e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b8d9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.275826:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3c8b1d900) 00010000:00010000:0.0:1789395138.275828:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.275831:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab400, rc 0) 00000100:00100000:0.0:1789395138.275879:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239715456:12345-0@lo:101:mdt00_002.0 Request processed in 111us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.275884:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490 00000100:00100000:1.0:1789395138.275966:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715456:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395138.275979:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.275989:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395138.276002:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:1.0:1789395138.276046:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715584:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395138.276079:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.276103:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.276202:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715584 00000100:00100000:2.0:1789395138.276207:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715584 00000100:00100000:2.0:1789395138.276245:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3491 00000100:00100000:2.0:1789395138.276252:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239715584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395138.276314:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239715584:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.276321:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3491 00000100:00100000:1.0:1789395138.276417:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715584:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395138.276457:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715712:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789395138.276480:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.276510:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.276563:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715712 00000100:00100000:0.0:1789395138.276568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715712 00000100:00100000:0.0:1789395138.276598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492 00000100:00100000:0.0:1789395138.276605:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239715712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395138.276682:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239715712:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (199us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395138.276689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492 00000100:00100000:1.0:1789395138.276757:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239715712:0@lo:1000:mdt00_002.0 00000004:00080000:1.0:1789395138.276772:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:1.0:1789395138.276778:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.276791:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.276797:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.276819:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395138.276825:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:1.0:1789395138.276828:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.276834:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.276840:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.276858:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789395138.276882:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789395138.276890:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.276899:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:3.0:1789395138.276905:0:9511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395138.276927:0:9511:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.276929:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18295:x1876316231769728:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2088us (2230us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395138.276948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23587 00010000:00010000:3.0:1789395138.276964:0:9511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.276971:0:9511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789395138.277006:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.277015:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b8cb lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.277015:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395138.277023:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.277033:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395138.277038:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.277039:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.277043:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395138.277047:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789395138.277051:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.277057:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789395138.277075:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.277078:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239715840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.277090:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395138.277099:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.277110:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23b200/0xff35729af316b8d9 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b8e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.277117:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395138.277131:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.277134:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395138.277135:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395138.277155:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239715968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395138.277173:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.277252:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715840 00000100:00100000:0.0:1789395138.277257:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715840 00000100:00100000:0.0:1789395138.277294:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239715968 00000100:00100000:0.0:1789395138.277297:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239715968 00000100:00100000:0.0:1789395138.277327:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1789395138.277333:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+23:3639:x1876316239715840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.277343:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395138.277356:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316b8d2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b8cb expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.277368:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35fc00) 00010000:00010000:0.0:1789395138.277377:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.277430:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239715840:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.277437:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1789395138.277452:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1789395138.277460:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239715968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.277468:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395138.277479:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b8e0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b8d9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.277494:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xb62e0cbf (ffff89a3c8b1d900) 00010000:00010000:0.0:1789395138.277500:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.277523:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239715968:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.277529:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1789395138.277557:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239715968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.277565:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239715840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.285192:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395138.285298:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231769984 00000100:00100000:2.0:1789395138.285309:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231769984 00000100:00100000:2.0:1789395138.285366:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23588 00000100:00100000:2.0:1789395138.285375:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:18295:x1876316231769984:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395138.285481:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285502:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285514:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285526:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285534:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285541:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285599:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285607:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285615:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395138.285852:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00010000:00010000:2.0:1789395138.285898:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285907:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285927:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285933:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285939:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285944:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285959:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395138.285976:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285982:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285988:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.285994:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395138.285998:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286006:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286016:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395138.286019:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395138.286023:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.286344:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395138.286350:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.286357:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395138.286360:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.286367:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.286376:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:1.0:1789395138.286378:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395138.286381:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 1/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.286410:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cce00/0xff35729af316b8fc lrc: 0/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.286423:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.286424:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.286426:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.286558:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc800/0xff35729af316b8f5 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286580:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286586:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286592:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286597:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286602:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395138.286605:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286611:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286620:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:2.0:1789395138.286622:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.286625:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286630:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cd600/0xff35729af316b8e7 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395138.286642:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9f41b91 reply state 000000002c4783df transno 4294968524 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286653:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.286660:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xb62e0cbf (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395138.286662:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395138.286665:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395138.286772:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18295:x1876316231769984:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1395us (1587us total) trans 4294968524 rc 0/0 00000100:00100000:2.0:1789395138.286780:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23588 00010000:00010000:0.0:1789395138.301475:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395138.302881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.302969:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231770240 00000100:00100000:3.0:1789395138.302978:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231770240 00000100:00100000:3.0:1789395138.303043:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23589 00000100:00100000:3.0:1789395138.303054:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18295:x1876316231770240:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.303112:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.303137:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cc600/0xff35729af316b6a9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106154 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.303170:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:3.0:1789395138.303180:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395138.303228:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.303237:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.303250:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.303270:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716096:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1789395138.303313:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.303370:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.303451:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716096 00000100:00100000:1.0:1789395138.303455:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716096 00000100:00100000:1.0:1789395138.303480:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493 00000100:00100000:1.0:1789395138.303486:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:7813:x1876316239716096:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1789395138.303495:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.303509:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b90a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b903 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.303531:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b90a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b903 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.303544:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b90a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b903 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.303558:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395138.303561:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.303563:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1600, rc 0) 00000100:00100000:1.0:1789395138.303607:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:7813:x1876316239716096:12345-0@lo:101:mdt00_003.0 Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.303614:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493 00000100:00100000:3.0:1789395138.304072:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716096:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789395138.304088:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.304098:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.304115:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.304138:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.304157:0:7813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.304163:0:7813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.304175:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716224:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1789395138.304200:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.304231:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.304275:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716224 00000100:00100000:0.0:1789395138.304281:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716224 00000100:00100000:0.0:1789395138.304319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494 00000100:00100000:0.0:1789395138.304325:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7813:x1876316239716224:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1789395138.304333:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395138.304347:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b918 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b911 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.304363:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b918 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b911 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.304374:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b918 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b911 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.304380:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a3c8b1d900) 00010000:00010000:0.0:1789395138.304413:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.304415:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab400, rc 0) 00000100:00100000:0.0:1789395138.304448:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239716224:12345-0@lo:101:mdt00_003.0 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.304454:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494 00000100:00100000:3.0:1789395138.304657:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716224:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1789395138.304670:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.304679:0:7813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.304691:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1789395138.304720:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716352:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.304746:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.304772:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.304809:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716352 00000100:00100000:1.0:1789395138.304814:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716352 00000100:00100000:1.0:1789395138.304836:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495 00000100:00100000:1.0:1789395138.304842:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239716352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395138.304908:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239716352:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.304923:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495 00000100:00100000:3.0:1789395138.305013:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716352:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.305052:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716480:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789395138.305075:0:7813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.305097:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.305133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716480 00000100:00100000:1.0:1789395138.305137:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716480 00000100:00100000:1.0:1789395138.305173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496 00000100:00100000:1.0:1789395138.305178:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239716480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789395138.305271:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7813:x1876316239716480:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (195us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789395138.305278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496 00000100:00100000:3.0:1789395138.305431:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7813:1876316239716480:0@lo:1000:mdt00_003.0 00000004:00080000:3.0:1789395138.305447:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.305453:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.305461:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.305467:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.305486:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395138.305490:0:7813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.305495:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.305502:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.305508:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.305519:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1789395138.305578:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18295:x1876316231770240:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2525us (2704us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395138.305584:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23589 00010000:00010000:2.0:1789395138.305741:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395138.305748:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305756:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395138.305762:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395138.305769:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305794:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305800:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395138.305819:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305831:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a800/0xff35729af316b903 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b90a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305846:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395138.305849:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305854:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395138.305858:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395138.305864:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305878:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305884:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395138.305890:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305896:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a400/0xff35729af316b911 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b918 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.305906:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.305908:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.305921:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395138.305931:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239716608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.305964:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.305987:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395138.305991:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239716736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.306009:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789395138.306117:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395138.306128:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716608 00000100:00100000:1.0:1789395138.306132:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716608 00000100:00100000:1.0:1789395138.306178:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716736 00000100:00100000:1.0:1789395138.306181:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716736 00000100:00100000:1.0:1789395138.306330:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1789395138.306338:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+23:3636:x1876316239716608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395138.306350:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395138.306364:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b90a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b903 expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.306376:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395138.306397:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395138.306431:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3636:x1876316239716608:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.306437:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1789395138.306473:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1789395138.306479:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239716736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789395138.306486:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395138.306497:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316b918 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b911 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.306506:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0xdcc87686 (ffff89a3c8b1d900) 00010000:00010000:1.0:1789395138.306513:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395138.306534:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239716736:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.306540:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1789395138.317024:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.317096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231770496 00000100:00100000:3.0:1789395138.317107:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231770496 00000100:00100000:3.0:1789395138.317221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23590 00000100:00100000:3.0:1789395138.317231:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:18295:x1876316231770496:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.317306:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317323:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317335:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317349:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317356:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317367:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317458:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317474:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395138.317700:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00010000:00010000:3.0:1789395138.317747:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317756:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317764:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317771:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317777:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317784:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317804:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395138.317821:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317827:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317833:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317839:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.317843:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317851:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317862:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff89a3c90d5000) 00010000:00010000:3.0:1789395138.317865:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395138.317868:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317875:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b400/0xff35729af316b92d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317895:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317901:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317907:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317925:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317931:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.317933:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317939:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317946:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5b00) 00010000:00010000:3.0:1789395138.317948:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.317950:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317956:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b000/0xff35729af316b91f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395138.317970:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000adc8cce reply state 00000000f099b06d transno 4294968525 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317981:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.317987:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xdcc87686 (ffff89a3c90d5400) 00010000:00010000:3.0:1789395138.317989:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395138.317992:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395138.318055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18295:x1876316231770496:12345-192.168.203.54@tcp:36:rm.0 Request processed in 824us (1039us total) trans 4294968525 rc 0/0 00000100:00100000:3.0:1789395138.318062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23590 00010000:00010000:2.0:1789395138.318127:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395138.318133:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.318139:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23be00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395138.318152:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.318159:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.318167:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff89a3c90d5000) 00010000:00010000:2.0:1789395138.318170:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395138.318172:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.318178:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23be00/0xff35729af316b934 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.318192:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.318194:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.318195:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395138.321509:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239716736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.321524:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239716608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.324130:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395138.324197:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231770752 00000100:00100000:2.0:1789395138.324208:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231770752 00000100:00100000:2.0:1789395138.324262:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23591 00000100:00100000:2.0:1789395138.324271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:18295:x1876316231770752:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395138.324328:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395138.324354:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ba00/0xff35729af316b7ba lrc: 0/0,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061c4 expref: 21 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.324377:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff89a3c90d5600) 00010000:00010000:2.0:1789395138.324420:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395138.324468:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.324477:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.324486:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395138.324505:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239716864:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1789395138.324551:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.324595:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.324648:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716864 00000100:00100000:1.0:1789395138.324653:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716864 00000100:00100000:1.0:1789395138.324691:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497 00000100:00100000:1.0:1789395138.324697:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239716864:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395138.324706:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.324720:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b942 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b93b expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.324743:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b942 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b93b expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.324755:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b942 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b93b expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.324761:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395138.324764:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.324766:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1c00, rc 0) 00000100:00100000:1.0:1789395138.324808:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6511:x1876316239716864:12345-0@lo:101:mdt00_000.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.324815:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497 00000100:00100000:3.0:1789395138.324960:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239716864:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395138.324974:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.324985:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.325001:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.325023:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.325029:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.325036:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.325047:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239716992:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789395138.325071:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.325099:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.325155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239716992 00000100:00100000:1.0:1789395138.325159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239716992 00000100:00100000:1.0:1789395138.325189:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498 00000100:00100000:1.0:1789395138.325196:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6511:x1876316239716992:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395138.325203:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.325216:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b950 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b949 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.325231:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b950 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b949 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.325246:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b950 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b949 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.325253:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c7eb6100) 00010000:00010000:1.0:1789395138.325255:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.325258:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0600, rc 0) 00000100:00100000:1.0:1789395138.325295:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239716992:12345-0@lo:101:mdt00_000.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.325301:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498 00000100:00100000:3.0:1789395138.325464:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239716992:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395138.325474:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.325482:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395138.325494:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1789395138.325523:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239717120:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395138.325548:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.325567:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.325636:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239717120 00000100:00100000:1.0:1789395138.325640:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239717120 00000100:00100000:1.0:1789395138.325670:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499 00000100:00100000:1.0:1789395138.325677:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239717120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395138.325746:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239717120:12345-0@lo:1000:mdt00_000.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.325752:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499 00000100:00100000:3.0:1789395138.325829:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239717120:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395138.325867:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239717248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395138.325891:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395138.325921:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395138.325963:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239717248 00000100:00100000:0.0:1789395138.325968:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239717248 00000100:00100000:0.0:1789395138.326001:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3500 00000100:00100000:0.0:1789395138.326008:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239717248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395138.326099:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239717248:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (207us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789395138.326106:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3500 00000100:00100000:3.0:1789395138.326184:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239717248:0@lo:1000:mdt00_000.0 00000004:00080000:3.0:1789395138.326200:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.326206:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.326214:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.326221:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.326244:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1789395138.326249:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1789395138.326252:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.326258:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.326265:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.326280:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1789395138.326343:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18295:x1876316231770752:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2071us (2220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395138.326350:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23591 00010000:00010000:2.0:1789395138.326412:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395138.326419:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326426:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395138.326432:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395138.326440:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326470:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326477:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395138.326500:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326508:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3cc800/0xff35729af316b93b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b942 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326524:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395138.326528:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326534:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395138.326538:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395138.326545:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326560:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326566:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395138.326571:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326582:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca23a000/0xff35729af316b949 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b950 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326595:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.326597:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395138.326598:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395138.326610:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239717504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.326639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.326660:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395138.326665:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239717376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.326688:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.326716:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239717504 00000100:00100000:2.0:1789395138.326720:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239717504 00000100:00100000:2.0:1789395138.326746:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239717376 00000100:00100000:2.0:1789395138.326749:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239717376 00000100:00100000:2.0:1789395138.326767:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1789395138.326774:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3639:x1876316239717504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395138.326783:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395138.326796:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316b950 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b949 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326808:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x18618557 (ffff89a4c7eb6100) 00010000:00010000:2.0:1789395138.326814:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395138.326844:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239717504:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.326850:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1789395138.326862:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1789395138.326868:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239717376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395138.326876:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395138.326886:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316b942 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b93b expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.326895:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:2.0:1789395138.326902:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395138.326937:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239717376:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.326943:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1789395138.326973:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239717376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395138.326981:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239717504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.327188:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395138.332869:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.333028:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231771008 00000100:00100000:3.0:1789395138.333038:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231771008 00000100:00100000:3.0:1789395138.333087:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23592 00000100:00100000:3.0:1789395138.333097:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:18295:x1876316231771008:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1789395138.333191:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333208:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333220:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333233:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333240:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333246:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333307:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333314:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333321:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395138.333584:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:3.0:1789395138.333629:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333640:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333648:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333655:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333660:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333666:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333679:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395138.333695:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333702:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333708:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333715:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.333719:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333727:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333738:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff89a3c90d5900) 00010000:00010000:3.0:1789395138.333741:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395138.333746:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333751:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a800/0xff35729af316b965 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333772:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333778:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333784:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333789:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333794:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395138.333797:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333803:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333810:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c90d5100) 00010000:00010000:3.0:1789395138.333813:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395138.333816:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333821:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a200/0xff35729af316b957 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395138.333836:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005719c7af reply state 00000000896a77be transno 4294968526 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333845:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.333851:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x18618557 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395138.333853:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395138.333855:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395138.333933:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18295:x1876316231771008:12345-192.168.203.54@tcp:36:rm.0 Request processed in 836us (1071us total) trans 4294968526 rc 0/0 00000100:00100000:3.0:1789395138.333940:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23592 00010000:00010000:1.0:1789395138.334011:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395138.334018:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.334025:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395138.334027:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.334034:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.334047:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff89a3c90d5900) 00010000:00010000:1.0:1789395138.334049:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395138.334052:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 1/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.334057:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23b200/0xff35729af316b96c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.334073:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.334075:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.334077:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395138.339727:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.339810:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231771136 00000100:00100000:3.0:1789395138.339819:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231771136 00000100:00100000:3.0:1789395138.339969:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1389 00000100:00100000:3.0:1789395138.339980:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231771136:12345-192.168.203.54@tcp:103:rm.0 00010000:00010000:3.0:1789395138.339996:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.340018:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316b2d5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060ac expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.340036:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a4c8e8dd00) 00010000:00010000:3.0:1789395138.340044:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395138.340140:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231771136:12345-192.168.203.54@tcp:103:rm.0 Request processed in 160us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.340147:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1389 00000100:00100000:2.0:1789395138.341145:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395138.341209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231771392 00000100:00100000:1.0:1789395138.341215:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231771392 00000100:00100000:1.0:1789395138.341254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5097 00000100:00100000:1.0:1789395138.341261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18295:x1876316231771392:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:1.0:1789395138.341476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18295:x1876316231771392:12345-192.168.203.54@tcp:35:rm.0 Request processed in 214us (335us total) trans 4294968527 rc 0/0 00000100:00100000:1.0:1789395138.341483:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5097 00000100:00100000:2.0:1789395138.347045:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395138.347196:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231771648 00000100:00100000:3.0:1789395138.347207:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231771648 00000100:00100000:0.0:1789395138.347472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23593 00000100:00100000:0.0:1789395138.347484:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:18295:x1876316231771648:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395138.347544:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395138.347568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca015800/0xff35729af316b5f3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210611c expref: 23 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.347591:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316b5c9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106107 expref: 22 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.347601:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:0.0:1789395138.347611:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395138.347651:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.347659:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.347673:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.347691:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239717632:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395138.347736:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.347868:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239717632 00000100:00100000:1.0:1789395138.347872:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239717632 00000100:00100000:1.0:1789395138.347924:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501 00000100:00100000:1.0:1789395138.347931:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6513:x1876316239717632:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395138.347941:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.347954:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b973 expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.347983:0:11908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.347993:0:11908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.348013:0:11908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.348025:0:11908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 9 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395138.348036:0:11908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239717760:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395138.348137:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.348207:0:11908:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c9b9c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.350110:0:11908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11908:1876316239717760:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395138.350144:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.350155:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395138.350158:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395138.350162:0:11908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 21 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.350171:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1600, rc 0) 00000100:00100000:1.0:1789395138.350256:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239717632:12345-0@lo:101:mdt00_002.0 Request processed in 2324us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.350264:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501 00000100:00100000:2.0:1789395138.351101:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395138.351112:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239717632:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395138.351136:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.351145:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.351163:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231771776 00000100:00100000:3.0:1789395138.351171:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231771776 00010000:00010000:3.0:1789395138.351199:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 10 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.351232:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1589 00000100:00100000:3.0:1789395138.351240:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231771776:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395138.351253:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395138.351259:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 10 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.351270:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 10 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.351302:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316b2b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021060a5 expref: 10 pid: 6511 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.351315:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395138.351320:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.351331:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.351345:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.351490:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 20 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395138.351505:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6497:1876316239717888:0@lo:105: 00000100:00100000:0.0:1789395138.351679:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.352053:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca34f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.352056:0:10386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239717888 00000100:00100000:1.0:1789395138.352070:0:10386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239717888 00000100:00100000:1.0:1789395138.352107:0:10386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1789395138.352124:0:10386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6497:x1876316239717888:12345-0@lo:105: 00010000:00010000:1.0:1789395138.352135:0:10386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.352145:0:10386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.352153:0:10386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.352245:0:10386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.352251:0:10386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.352256:0:10386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.352276:0:10386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca2aa200) 00000100:00100000:1.0:1789395138.352320:0:10386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6497:x1876316239717888:12345-0@lo:105: Request processed in 205us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395138.352327:0:10386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1789395138.352484:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6497:1876316239717888:0@lo:105: 00010000:00010000:2.0:1789395138.352500:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395138.352548:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231771776:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1308us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.352555:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1589 00010000:00010000:0.0:1789395138.352693:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.352703:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395138.352725:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789395138.352762:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.352771:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.352786:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.352802:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718016:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395138.352834:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.352869:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.353170:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718016 00000100:00100000:2.0:1789395138.353175:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718016 00000100:00100000:2.0:1789395138.353210:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502 00000100:00100000:2.0:1789395138.353217:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:6513:x1876316239718016:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395138.353230:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395138.353245:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b988 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b981 expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.353265:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b988 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b981 expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.353277:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b988 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b981 expref: 22 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.353285:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a3ca35f200) 00010000:00010000:2.0:1789395138.353288:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395138.353291:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cce00, rc 0) 00000100:00100000:2.0:1789395138.353330:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239718016:12345-0@lo:101:mdt00_002.0 Request processed in 113us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.353336:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502 00000100:00100000:0.0:1789395138.353567:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718016:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395138.353580:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.353594:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395138.353607:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1789395138.353636:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718144:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395138.353660:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.353800:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.353831:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718144 00000100:00100000:3.0:1789395138.353836:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718144 00000100:00100000:3.0:1789395138.353899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:3.0:1789395138.353906:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239718144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395138.353976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239718144:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.353984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00100000:0.0:1789395138.354000:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718144:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395138.354031:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718272:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789395138.354048:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.354063:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395138.354082:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718272 00000100:00100000:2.0:1789395138.354087:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718272 00000100:00100000:2.0:1789395138.354112:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:2.0:1789395138.354118:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239718272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395138.354201:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239718272:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (151us total) trans 0 rc 1/1 00000100:00100000:2.0:1789395138.354209:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:0.0:1789395138.354409:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718272:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789395138.354448:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.354458:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.354468:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.354480:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718400:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395138.354503:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.354525:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.354852:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718400 00000100:00100000:1.0:1789395138.354857:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718400 00000100:00100000:1.0:1789395138.354898:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505 00000100:00100000:1.0:1789395138.354905:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6513:x1876316239718400:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1789395138.354924:0:11908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395138.354938:0:11908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b996 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b98f expref: -99 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.354963:0:11908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b996 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b98f expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.355634:0:11908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b996 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b98f expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.355644:0:11908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395138.355648:0:11908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395138.355652:0:11908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:1.0:1789395138.355709:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6513:x1876316239718400:12345-0@lo:101:mdt00_002.0 Request processed in 804us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.355816:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718400:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395138.355832:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355843:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355879:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355889:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355897:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355925:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355933:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355940:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355964:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355971:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.355977:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.355992:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718528:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1789395138.356017:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.356040:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.356096:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505 00000100:00100000:2.0:1789395138.356113:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718528 00000100:00100000:2.0:1789395138.356118:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718528 00000100:00100000:2.0:1789395138.356149:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506 00000100:00100000:2.0:1789395138.356156:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6513:x1876316239718528:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1789395138.356168:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395138.356180:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316b9b2 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316b9ab expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.356196:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316b9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316b9ab expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.356206:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316b9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316b9ab expref: 24 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395138.356213:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395138.356216:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395138.356218:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc400, rc 0) 00000100:00100000:2.0:1789395138.356251:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6513:x1876316239718528:12345-0@lo:101:mdt00_002.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395138.356256:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506 00000100:00100000:0.0:1789395138.356542:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718528:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1789395138.356555:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.356563:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.357563:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718656:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1789395138.357608:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.357634:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789395138.357746:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718656 00000100:00100000:3.0:1789395138.357752:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718656 00000100:00100000:3.0:1789395138.357795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507 00000100:00100000:3.0:1789395138.357803:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6513:x1876316239718656:12345-0@lo:403:mdt00_002.0 00000100:00100000:3.0:1789395138.359309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:6513:x1876316239718656:12345-0@lo:403:mdt00_002.0 Request processed in 1503us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395138.359319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507 00000100:00100000:0.0:1789395138.359431:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239718656:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1789395138.360237:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].393, 960 off587368 00000040:00080000:0.0:1789395138.360424:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].393, 1040 off641696 00000004:00080000:0.0:1789395138.360431:0:6513:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a3c7a3a300 with version 750 00000004:00080000:2.0:1789395138.361320:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 750 rpc_version 750 00000020:00100000:2.0:1789395138.361357:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395138.361366:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c8853800 x1876316239718912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2624/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395138.361455:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239718912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395138.361659:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395138.361690:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cde40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395138.361737:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239718912 00000100:00100000:1.0:1789395138.361745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239718912 00000100:00100000:1.0:1789395138.361795:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508 00000100:00100000:1.0:1789395138.361804:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cf9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239718912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1789395138.363708:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cf9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:7455:x1876316239718912:12345-0@lo:1000:osp_up0-1.0 Request processed in 1901us (2045us total) trans 4294983569 rc 0/0 00000100:00100000:1.0:1789395138.363721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508 00000100:00100000:2.0:1789395138.364759:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8853800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239718912:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1789395138.364824:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:0.0:1789395138.364847:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.364858:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.364866:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.364872:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.364876:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.364893:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.364908:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:0.0:1789395138.364920:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395138.364925:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.364931:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab000/0xff35729af316b9a4 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365377:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365412:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365420:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365452:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789395138.365461:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:0.0:1789395138.365468:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365474:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365480:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365485:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395138.365489:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365499:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365508:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a3c8b1d700) 00010000:00010000:0.0:1789395138.365510:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395138.365513:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365518:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2ab800/0xff35729af316b99d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365531:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365538:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365546:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365575:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1789395138.365585:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789395138.365589:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365603:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365610:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365628:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1789395138.365631:0:6513:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1789395138.365636:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.365644:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365647:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789395138.365657:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365667:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa000 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395138.365672:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395138.365681:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365716:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395138.365722:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:18295:x1876316231771648:12345-192.168.203.54@tcp:36:rm.0 Request processed in 18236us (18681us total) trans 4294968528 rc 0/0 00010000:00010000:1.0:1789395138.365729:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789395138.365736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23593 00010000:00010000:1.0:1789395138.365754:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 1/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365763:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa000/0xff35729af316b9ab lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b9b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365780:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789395138.365784:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365791:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aba00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395138.365795:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395138.365802:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365819:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365825:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395138.365832:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 1/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365839:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aba00/0xff35729af316b98f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365851:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395138.365854:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365860:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:1.0:1789395138.365864:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395138.365871:0:6498:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365886:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365904:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789395138.365932:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395138.365944:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2aa200/0xff35729af316b973 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b97a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395138.365947:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.365965:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.365967:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395138.365969:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395138.365983:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239719040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.366172:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239719296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.366174:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.366216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395138.366222:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789395138.366276:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395138.366634:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239719168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789395138.366662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395138.370434:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719040 00000100:00100000:0.0:1789395138.370448:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719040 00000100:00100000:0.0:1789395138.370503:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719296 00000100:00100000:1.0:1789395138.370507:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719168 00000100:00100000:0.0:1789395138.370507:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719296 00000100:00100000:1.0:1789395138.370514:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719168 00000100:00100000:0.0:1789395138.370537:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1789395138.370548:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+27:3636:x1876316239719040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.370563:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395138.370584:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316b9b2 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b9ab expref: 27 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.370614:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff89a3ca35f000) 00010000:00010000:0.0:1789395138.370623:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.370674:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+26:3636:x1876316239719040:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.372888:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1789395138.372939:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1789395138.372955:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+25:3638:x1876316239719296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.372973:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395138.372998:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316b97a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b973 expref: 25 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.373017:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395138.373021:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.373081:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+24:3638:x1876316239719296:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (6865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.373088:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1789395138.373154:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239719296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.373191:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239719040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789395138.373216:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1789395138.373222:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+23:3636:x1876316239719168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395138.373230:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395138.373242:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316b996 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b98f expref: 23 pid: 11908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395138.373253:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff89a4c7eb6700) 00010000:00010000:0.0:1789395138.373263:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395138.373290:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+22:3636:x1876316239719168:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (6627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395138.373297:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1789395138.373321:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239719168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395139.258800:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239719424:0@lo:400:kworker.0 00000100:00100000:3.0:1789395139.258916:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395139.259140:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239719808:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.259181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395139.259239:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239719552:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.259264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395139.259282:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395139.259287:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239719680:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.259312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395139.259349:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719680 00000100:00100000:1.0:1789395139.259357:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719680 00000100:00100000:1.0:1789395139.259432:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3509 00000100:00100000:1.0:1789395139.259443:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:3636:x1876316239719680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.259506:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:3636:x1876316239719680:12345-0@lo:400:kworker.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.259515:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3509 00000100:00100000:1.0:1789395139.259561:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239719680:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.262466:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719808 00000100:00100000:1.0:1789395139.262488:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719808 00000100:00100000:1.0:1789395139.262567:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719552 00000100:00100000:1.0:1789395139.262571:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719552 00000100:00100000:1.0:1789395139.262599:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1789395139.262610:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239719808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.262729:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239719808:12345-0@lo:400:kworker.0 Request processed in 120us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.262736:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1789395139.262754:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1789395139.262760:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239719552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395139.263177:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239720064:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.263194:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239719552:12345-0@lo:400:kworker.0 Request processed in 435us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.263201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1789395139.263219:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395139.263258:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719424 00000100:00100000:1.0:1789395139.263262:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719424 00000100:00100000:0.0:1789395139.263268:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239719552:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.263287:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789395139.263293:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239719424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.263327:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239719424:12345-0@lo:400:kworker.0 Request processed in 35us (4423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.263334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789395139.263368:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720064 00000100:00100000:1.0:1789395139.263372:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720064 00000100:00100000:3.0:1789395139.263418:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239719936:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.263429:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1789395139.263437:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395139.263464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395139.263498:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239719424:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.263615:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239719936 00000100:00100000:2.0:1789395139.263620:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239719936 00000100:00100000:2.0:1789395139.263661:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510 00000100:00100000:2.0:1789395139.263669:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.263783:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239720064:12345-0@lo:400:kworker.0 Request processed in 346us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.263790:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1789395139.263823:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239719808:0@lo:400:kworker.0 00000100:00080000:1.0:1789395139.263841:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395139.263872:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239720192:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.263898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395139.263943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720192 00000100:00100000:1.0:1789395139.263947:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720192 00000100:00080000:1.0:1789395139.263960:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395139.263981:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1789395139.263987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.264019:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239720192:12345-0@lo:400:kworker.0 Request processed in 33us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.264025:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1789395139.264048:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239720192:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.264265:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239719936:12345-0@lo:400:kworker.0 Request processed in 596us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.264272:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510 00000100:00100000:3.0:1789395139.264415:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968504 gen 2 00000004:00080000:3.0:1789395139.264423:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968499 committed transno 4294968504 00000020:00080000:3.0:1789395139.264431:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca33a600 refcount 2 committed 0 result 0 batchid 408 00000020:00080000:3.0:1789395139.264435:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca33a9c0 00000020:00080000:3.0:1789395139.264439:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca33ae40 00000020:00080000:3.0:1789395139.264442:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].403 00000020:00080000:3.0:1789395139.264444:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b22000 00000020:00080000:3.0:1789395139.264447:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].405 00000004:00080000:3.0:1789395139.264470:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968500 committed transno 4294968504 00000020:00080000:3.0:1789395139.264475:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3c80b3000 refcount 2 committed 0 result 0 batchid 409 00000020:00080000:3.0:1789395139.264478:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c80b3d80 00000020:00080000:3.0:1789395139.264482:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c80b3300 00000020:00080000:3.0:1789395139.264484:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].404 00000020:00080000:3.0:1789395139.264487:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9322000 00000020:00080000:3.0:1789395139.264489:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].406 00000004:00080000:3.0:1789395139.264502:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968501 committed transno 4294968504 00000020:00080000:3.0:1789395139.264506:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca33a3c0 refcount 2 committed 0 result 0 batchid 410 00000020:00080000:3.0:1789395139.264509:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4fedcd3c0 00000020:00080000:3.0:1789395139.264512:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c80b3900 00000020:00080000:3.0:1789395139.264515:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].405 00000020:00080000:3.0:1789395139.264517:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3c6a24700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9323c00 00000020:00080000:3.0:1789395139.264520:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].407 00000004:00080000:3.0:1789395139.264533:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968502 committed transno 4294968504 00000020:00080000:3.0:1789395139.264537:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a4fedcdf00 refcount 2 committed 0 result 0 batchid 411 00000020:00080000:3.0:1789395139.264540:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4e7c9ea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9b9c480 00000020:00080000:3.0:1789395139.264543:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4d07a3500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4fedcd840 00000020:00080000:3.0:1789395139.264546:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].406 00000020:00080000:3.0:1789395139.264548:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4ff871e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c9323a00 00000020:00080000:3.0:1789395139.264550:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].408 00000004:00080000:3.0:1789395139.264564:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968503 committed transno 4294968504 00000020:00080000:3.0:1789395139.264568:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca34b600 refcount 2 committed 0 result 0 batchid 412 00000020:00080000:3.0:1789395139.264570:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40db00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4ff9d2d80 00000020:00080000:3.0:1789395139.264573:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40d200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca34be40 00000020:00080000:3.0:1789395139.264576:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].407 00000020:00080000:3.0:1789395139.264578:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40dd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3ca3ef400 00000020:00080000:3.0:1789395139.264580:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].409 00000004:00080000:3.0:1789395139.264600:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968504 committed transno 4294968504 00000020:00080000:3.0:1789395139.264603:0:3639:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89a3ca34b6c0 refcount 2 committed 0 result 0 batchid 413 00000020:00080000:3.0:1789395139.264605:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40dc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7a3af00 00000020:00080000:3.0:1789395139.264608:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40de00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4ff9d2780 00000020:00080000:3.0:1789395139.264610:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].408 00000020:00080000:3.0:1789395139.264612:0:3639:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c6b73e00 00000020:00080000:3.0:1789395139.264615:0:3639:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].410 00000100:00100000:3.0:1789395139.264626:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239719936:0@lo:400:kworker.0 00000020:00080000:3.0:1789395139.264644:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 413 committed batchid 407 00000020:00080000:3.0:1789395139.264717:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 407 00000100:00100000:1.0:1789395139.271243:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239720064:0@lo:400:kworker.0 00000100:00100000:3.0:1789395139.275685:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239720448:0@lo:400:kworker.0 00000100:00100000:0.0:1789395139.275688:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239720576:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.275773:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239720320:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.281718:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395139.281794:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239720960:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.281829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395139.281850:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395139.281855:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239720832:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.281873:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395139.281956:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720448 00000100:00100000:3.0:1789395139.281966:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720448 00000100:00100000:3.0:1789395139.282032:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720960 00000100:00100000:3.0:1789395139.282035:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720960 00000100:00100000:3.0:1789395139.282055:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720832 00000100:00100000:3.0:1789395139.282058:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720832 00000100:00100000:3.0:1789395139.282083:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00080000:2.0:1789395139.282168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395139.282173:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395139.282222:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239720448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395139.282291:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239720448:12345-0@lo:400:kworker.0 Request processed in 72us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.284153:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789395139.284185:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239720960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.284285:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3639:x1876316239720960:12345-0@lo:400:kworker.0 Request processed in 118us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.284293:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789395139.284333:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789395139.284340:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3639:x1876316239720832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.284370:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3639:x1876316239720832:12345-0@lo:400:kworker.0 Request processed in 31us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.284376:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789395139.284538:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789395139.284658:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239720832:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.284674:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239720960:0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.284691:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239720448:0@lo:400:kworker.0 00000100:00100000:0.0:1789395139.286873:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395139.286955:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395139.286970:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239720704:0@lo:400:kworker.0 00000100:00100000:0.0:1789395139.287012:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395139.287082:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720576 00000100:00100000:0.0:1789395139.287091:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720576 00000100:00100000:2.0:1789395139.287691:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720704 00000100:00100000:2.0:1789395139.287698:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720704 00000100:00100000:2.0:1789395139.287743:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1789395139.287754:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239720576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.287839:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239720576:12345-0@lo:400:kworker.0 Request processed in 86us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.287847:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1789395139.287867:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1789395139.287873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239720704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395139.287914:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239720704:12345-0@lo:400:kworker.0 Request processed in 30us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.287919:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:2.0:1789395139.287940:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395139.287944:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395139.288534:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239720704:0@lo:400:kworker.0 00000100:00100000:0.0:1789395139.288549:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239720576:0@lo:400:kworker.0 00000100:00100000:1.0:1789395139.289012:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395139.289290:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239720320 00000100:00100000:2.0:1789395139.289299:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239720320 00000100:00100000:2.0:1789395139.289547:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1789395139.289558:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239720320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789395139.289589:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395139.289637:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239720320:12345-0@lo:400:kworker.0 Request processed in 81us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.289645:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789395139.289719:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239720320:0@lo:400:kworker.0 00010000:00010000:0.0:1789395139.319134:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789395139.768211:0:9998:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 590821824159ns, next at 591821821412ns, rc = 0 00000100:00100000:3.0:1789395139.768372:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239721344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395139.768564:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395139.771180:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239721088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395139.771250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395139.771301:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239721600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395139.771326:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395139.771351:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395139.771358:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239721216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395139.771416:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395139.771459:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721344 00000100:00100000:0.0:1789395139.771467:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721344 00000100:00100000:0.0:1789395139.771500:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721088 00000100:00100000:0.0:1789395139.771502:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721088 00000100:00100000:0.0:1789395139.771513:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721600 00000100:00100000:0.0:1789395139.771515:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721600 00000100:00100000:0.0:1789395139.771527:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789395139.771536:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239721344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395139.771568:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59272640 pending 172032 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789395139.771865:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789395139.771875:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239721088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395139.771892:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92884416 pending 172032 free 3923468288 avail 3691945984 00000100:00100000:0.0:1789395139.771943:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1876316239721344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 406us (3377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395139.771950:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789395139.771969:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789395139.771976:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239721600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789395139.771986:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59272640 pending 172032 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789395139.772020:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239721600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395139.772026:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789395139.772071:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239721600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395139.772183:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239721088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 310us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.772191:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789395139.772225:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239721088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395139.772303:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721216 00000100:00100000:1.0:1789395139.772308:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721216 00000100:00100000:1.0:1789395139.772347:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511 00000100:00100000:1.0:1789395139.772354:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239721216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789395139.772378:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445085184 avail 1298845696 00000100:00100000:1.0:1789395139.772432:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239721216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395139.772439:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511 00000100:00100000:1.0:1789395139.772460:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239721472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395139.772473:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239721216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395139.772491:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395139.772522:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721472 00000100:00100000:2.0:1789395139.772526:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721472 00000100:00100000:2.0:1789395139.772548:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789395139.772553:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876316239721472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395139.772563:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92884416 pending 172032 free 3923468288 avail 3691945984 00000100:00100000:2.0:1789395139.772593:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876316239721472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395139.772598:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789395139.772629:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239721472:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789395139.772657:0:8900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 590826271576ns, next at 591826269402ns, rc = 0 00000100:00100000:3.0:1789395139.773033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239721344:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1789395139.775970:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969894 is committed 00000001:00080000:0.0:1789395139.775984:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969893 is committed 00000001:00080000:0.0:1789395139.776000:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969888 is committed 00000001:00080000:1.0:1789395139.777590:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969893 is committed 00000001:00080000:1.0:1789395139.777600:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969892 is committed 00000001:00080000:1.0:1789395139.777614:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969889 is committed 00010000:00010000:3.0:1789395140.337664:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395141.365838:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395142.197655:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395142.197722:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395142.197744:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395142.197782:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231771904 00000100:00100000:0.0:1789395142.197792:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231771904 00000100:00100000:0.0:1789395142.197909:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 439 00000100:00100000:0.0:1789395142.197922:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231771904:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395142.198002:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231771904:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395142.198010:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 439 00000100:00100000:3.0:1789395142.198846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772032 00000100:00100000:3.0:1789395142.198854:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772032 00000100:00100000:1.0:1789395142.198924:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772160 00000100:00100000:1.0:1789395142.198928:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772160 00000100:00100000:2.0:1789395142.199004:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395142.199040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 604 00000100:00100000:2.0:1789395142.199046:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395142.199054:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231772032:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395142.199244:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231772032:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 193us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395142.199253:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 604 00000100:00100000:3.0:1789395142.199299:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772416 00000100:00100000:3.0:1789395142.199304:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772416 00000100:00100000:3.0:1789395142.199335:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772288 00000100:00100000:3.0:1789395142.199339:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772288 00000100:00100000:2.0:1789395142.199355:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 405 00000100:00100000:2.0:1789395142.199365:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2397:x1876316231772416:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395142.199417:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2397:x1876316231772416:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395142.199425:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 405 00000100:00100000:1.0:1789395142.199516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 605 00000100:00100000:1.0:1789395142.199525:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2397:x1876316231772160:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395142.199562:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2397:x1876316231772160:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 39us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395142.199569:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 605 00000100:00100000:3.0:1789395142.199705:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 406 00000100:00100000:3.0:1789395142.199713:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2398:x1876316231772288:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395142.199743:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2398:x1876316231772288:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395142.199750:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 406 00000100:00080000:0.0:1789395142.200299:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789395142.200305:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395142.200308:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789395142.200311:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789395142.390091:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395143.345701:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239721728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789395143.345771:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395143.345984:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721728 00000100:00100000:3.0:1789395143.345993:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721728 00000100:00100000:3.0:1789395143.346041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512 00000100:00100000:3.0:1789395143.346051:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239721728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789395143.346096:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444044800 avail 1297805312 00000100:00100000:3.0:1789395143.346142:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239721728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395143.346150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512 00000100:00100000:0.0:1789395143.346450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239721728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789395143.411949:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789395143.861233:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 413 batchid updated 00000001:00080000:3.0:1789395143.861270:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983569 is committed 00000020:00080000:2.0:1789395143.861681:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 413 00000004:00080000:2.0:1789395143.861744:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a34780 with version 774 00000020:00080000:2.0:1789395143.862018:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 408 cancel update log [0x240000401:0x3:0x0].403: rc = 0 00000020:00080000:2.0:1789395143.862098:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 408 cancel update log [0x200000400:0x3:0x0].405: rc = 0 00000004:00080000:2.0:1789395143.862120:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a34480 with version 775 00000004:00080000:0.0:1789395143.862658:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 774 rpc_version 774 00000020:00100000:1.0:1789395143.862843:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395143.862854:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4fef2bb80 x1876316239721984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395143.862886:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239721984:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.862952:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.863178:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395143.863231:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239721984 00000100:00100000:0.0:1789395143.863238:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239721984 00000100:00100000:0.0:1789395143.863336:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513 00000100:00100000:0.0:1789395143.863346:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7874:x1876316239721984:12345-0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1789395143.863755:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 409 cancel update log [0x240000401:0x3:0x0].404: rc = 0 00000020:00080000:2.0:1789395143.863812:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 409 cancel update log [0x200000400:0x3:0x0].406: rc = 0 00000004:00080000:2.0:1789395143.863849:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a34240 with version 776 00000020:00080000:2.0:1789395143.863853:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 410 cancel update log [0x240000401:0x3:0x0].405: rc = 0 00000020:00080000:2.0:1789395143.863885:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 410 cancel update log [0x200000400:0x3:0x0].407: rc = 0 00000004:00080000:2.0:1789395143.863907:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a34c00 with version 777 00000020:00080000:2.0:1789395143.863910:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 411 cancel update log [0x240000401:0x3:0x0].406: rc = 0 00000020:00080000:2.0:1789395143.863929:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 411 cancel update log [0x200000400:0x3:0x0].408: rc = 0 00000004:00080000:2.0:1789395143.863955:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a34180 with version 778 00000020:00080000:2.0:1789395143.863958:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 412 cancel update log [0x240000401:0x3:0x0].407: rc = 0 00000020:00080000:2.0:1789395143.863985:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 412 cancel update log [0x200000400:0x3:0x0].409: rc = 0 00000004:00080000:2.0:1789395143.864002:0:6543:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff89a3c7a34000 with version 779 00000020:00080000:2.0:1789395143.864005:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 413 cancel update log [0x240000401:0x3:0x0].408: rc = 0 00000020:00080000:2.0:1789395143.864027:0:6543:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 413 cancel update log [0x200000400:0x3:0x0].410: rc = 0 00000020:00080000:2.0:1789395143.864033:0:6543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 413 00000004:00080000:3.0:1789395143.875113:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00000004:00080000:3.0:1789395143.875143:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00010000:00010000:3.0:1789395143.875322:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395143.875349:0:7442:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.875430:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.875440:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395143.876917:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.876935:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.876944:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.876955:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395143.876960:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.876967:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.876985:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x391d5834 (ffff89a4c7eb6400) 00010000:00010000:2.0:1789395143.876990:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395143.876994:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877002:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316b846 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.877334:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239721984:12345-0@lo:1000:osp_up1-0.0 Request processed in 13986us (14377us total) trans 4294968529 rc 0/0 00000100:00100000:1.0:1789395143.877343:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513 00010000:00010000:2.0:1789395143.877513:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877522:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877528:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877534:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395143.877537:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877554:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877568:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x84832a57 (ffff89a3c8b1dc00) 00010000:00010000:2.0:1789395143.877571:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395143.877575:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877581:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca2aa400/0xff35729af316b87e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877595:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877600:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877606:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877611:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395143.877613:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877618:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877625:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xbc0ca3a9 (ffff89a3c90d5d00) 00010000:00010000:2.0:1789395143.877628:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395143.877631:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877637:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23ac00/0xff35729af316b8b6 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877651:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877656:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877661:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877665:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395143.877668:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877673:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877680:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xb62e0cbf (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395143.877683:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395143.877686:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877691:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3cda00/0xff35729af316b8ee lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877704:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877710:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877716:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877722:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395143.877724:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877731:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877738:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0xdcc87686 (ffff89a3c90d5400) 00010000:00010000:2.0:1789395143.877741:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395143.877743:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877748:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23bc00/0xff35729af316b926 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877762:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877768:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877774:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877779:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395143.877781:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877788:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877799:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x18618557 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395143.877802:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395143.877805:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.877810:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca23a400/0xff35729af316b95e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.878236:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239721984:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1789395143.878252:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 775 rpc_version 775 00000020:00100000:0.0:1789395143.878270:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395143.878343:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c988d500 x1876316239722496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395143.878363:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239722496:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395143.878427:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395143.878472:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.878538:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239722496 00000100:00100000:1.0:1789395143.878603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239722496 00000100:00100000:1.0:1789395143.878654:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514 00000100:00100000:1.0:1789395143.878663:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7874:x1876316239722496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.878804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239722496:12345-0@lo:1000:osp_up1-0.0 Request processed in 141us (376us total) trans 4294968530 rc 0/0 00000100:00100000:1.0:1789395143.878812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514 00000100:00100000:1.0:1789395143.878845:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239722496:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1789395143.878852:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 776 rpc_version 776 00000020:00100000:1.0:1789395143.878864:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395143.878880:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4fef29500 x1876316239722752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395143.878893:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239722752:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.878918:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.878934:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181840 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.878947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239722752 00000100:00100000:1.0:1789395143.878951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239722752 00000100:00100000:1.0:1789395143.878975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3515 00000100:00100000:1.0:1789395143.878982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7874:x1876316239722752:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.879241:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239722752:12345-0@lo:1000:osp_up1-0.0 Request processed in 259us (321us total) trans 4294968531 rc 0/0 00000100:00100000:1.0:1789395143.879247:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3515 00000100:00100000:0.0:1789395143.879380:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239722752:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1789395143.879426:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 777 rpc_version 777 00000020:00100000:0.0:1789395143.879441:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395143.879446:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9a6f480 x1876316239723008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395143.879459:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239723008:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395143.879484:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395143.879508:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395143.879520:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239723008 00000100:00100000:0.0:1789395143.879524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239723008 00000100:00100000:0.0:1789395143.879669:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3516 00000100:00100000:0.0:1789395143.879677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:7874:x1876316239723008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395143.879761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239723008:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (276us total) trans 4294968532 rc 0/0 00000100:00100000:0.0:1789395143.879768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3516 00000100:00100000:1.0:1789395143.879835:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239723008:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1789395143.879842:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 778 rpc_version 778 00000020:00100000:1.0:1789395143.879853:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395143.879858:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4fef29c00 x1876316239723264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395143.879880:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239723264:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.879909:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.879930:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395143.879973:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239723264 00000100:00100000:0.0:1789395143.879977:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239723264 00000100:00100000:0.0:1789395143.880008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517 00000100:00100000:0.0:1789395143.880022:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7874:x1876316239723264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395143.880210:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239723264:12345-0@lo:1000:osp_up1-0.0 Request processed in 196us (300us total) trans 4294968533 rc 0/0 00000100:00100000:0.0:1789395143.880218:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517 00000100:00100000:1.0:1789395143.880290:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239722240:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1789395143.880310:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca2abc00/0xff35729af316b981 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316b988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.880334:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1789395143.880378:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968528 is committed 00000004:00080000:3.0:1789395143.880433:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000100:00100000:0.0:1789395143.880447:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239722240 00000004:00080000:3.0:1789395143.880448:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000100:00100000:0.0:1789395143.880457:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239722240 00000020:00080000:3.0:1789395143.880458:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 398 batchid updated 00000100:00100000:0.0:1789395143.880514:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229 00000100:00100000:3.0:1789395143.880516:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239722112:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1789395143.880527:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239722240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1789395143.880564:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2506 count 1 00010000:00010000:0.0:1789395143.880590:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.880600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395143.880627:0:14650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.880638:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=8s v=(0 0) 00010000:00010000:0.0:1789395143.880643:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.880647:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789395143.880662:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 398 00010000:00010000:0.0:1789395143.880677:0:14650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.880693:0:14650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.880713:0:14650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14650:1876316239723392:192.168.203.54@tcp:104: 00000004:00080000:3.0:1789395143.880743:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a4c4f5bb40 with version 751 00000020:00080000:3.0:1789395143.880760:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 398 cancel update log [0x200000401:0x3:0x0].392: rc = 0 00000100:00100000:0.0:1789395143.880783:0:14650:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356a80 going to sleep for 11 seconds 00000100:00080000:0.0:1789395143.880801:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789395143.880820:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239722112 00000100:00100000:0.0:1789395143.880824:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239722112 00000020:00080000:3.0:1789395143.880850:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 398 cancel update log [0x240000400:0x3:0x0].392: rc = 0 00000020:00080000:3.0:1789395143.880866:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 398 00000100:00100000:0.0:1789395143.880881:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1789395143.880895:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239722112:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1789395143.880908:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.880928:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316b988 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316b981 expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.880945:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff89a3ca35f200) 00010000:00010000:0.0:1789395143.880956:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.880997:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239722112:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 108us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.881003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1789395143.881053:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239722112:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:2.0:1789395143.882236:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 751 rpc_version 751 00000020:00100000:2.0:1789395143.882251:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395143.882258:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4c2a34a80 x1876316239724800/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395143.882273:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239724800:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395143.884732:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395143.884770:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4ff935300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395143.884800:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239723520:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1789395143.884831:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395143.884850:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239724032:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1789395143.884883:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395143.884898:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239724544:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1789395143.884917:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395143.884939:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789395143.884945:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239723648:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1789395143.884965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395143.884988:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239724160:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1789395143.885055:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239723904:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1789395143.885088:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.885114:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239724416:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1789395143.885133:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239723776:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1789395143.885141:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395143.885173:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.885199:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239723520 00000100:00100000:0.0:1789395143.885204:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239724288:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1789395143.885208:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239723520 00000100:00100000:0.0:1789395143.885231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.885261:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239724032 00000100:00100000:1.0:1789395143.885266:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239724032 00000100:00100000:1.0:1789395143.885294:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239724544 00000100:00100000:1.0:1789395143.885297:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239724544 00000100:00100000:1.0:1789395143.885307:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239723648 00000100:00100000:1.0:1789395143.885310:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239723648 00000100:00100000:1.0:1789395143.885318:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239723904 00000100:00100000:1.0:1789395143.885321:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239723904 00000100:00100000:1.0:1789395143.885327:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239724416 00000100:00100000:1.0:1789395143.885329:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239724416 00000100:00100000:1.0:1789395143.885336:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239723776 00000100:00100000:1.0:1789395143.885339:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239723776 00000100:00100000:1.0:1789395143.885347:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239724288 00000100:00100000:1.0:1789395143.885350:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239724288 00000100:00100000:1.0:1789395143.885362:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5230 00000100:00100000:1.0:1789395143.885370:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3636:x1876316239723520:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1789395143.885406:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239724800 00000100:00100000:0.0:1789395143.885413:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239724800 00002000:00080000:1.0:1789395143.885432:0:10007:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2504 count 1 00000100:00100000:0.0:1789395143.885446:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518 00000100:00100000:0.0:1789395143.885456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:7455:x1876316239724800:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395143.885457:0:10007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.885483:0:10007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 10 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.885492:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=8s v=(0 0) 00010000:00010000:1.0:1789395143.885497:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395143.885502:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.885546:0:10007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 10 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.885570:0:10007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 10 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.885582:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10007:1876316239724928:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395143.885688:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239724800:12345-0@lo:1000:osp_up0-1.0 Request processed in 232us (961us total) trans 4294983570 rc 0/0 00000100:00100000:0.0:1789395143.885695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518 00000100:00100000:0.0:1789395143.885724:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5231 00000100:00100000:0.0:1789395143.885731:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3636:x1876316239724032:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1789395143.885746:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2504 count 1 00010000:00010000:0.0:1789395143.885762:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885775:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 11 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885783:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=8s v=(0 0) 00010000:00010000:0.0:1789395143.885786:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.885789:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885808:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 11 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885818:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 11 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.885829:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1876316239725056:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395143.885883:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232 00000100:00100000:0.0:1789395143.885891:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3636:x1876316239724544:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1789395143.885903:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2508 count 1 00010000:00010000:0.0:1789395143.885914:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885925:0:14639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 11 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885932:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789395143.885935:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.885939:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885957:0:14639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 11 pid: 14655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.885966:0:14639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 11 pid: 14655 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.885976:0:14639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14639:1876316239725184:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395143.886063:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395143.886204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395143.887179:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233 00000100:00100000:1.0:1789395143.887215:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:1.0:1789395143.887229:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3639:x1876316239723904:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1789395143.887481:0:7455:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983569 gen 2 00002000:00080000:1.0:1789395143.887483:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2507 count 1 00000004:00080000:2.0:1789395143.887489:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983569 committed transno 4294983569 00000020:00080000:2.0:1789395143.887497:0:7455:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a3c7a3a9c0 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:2.0:1789395143.887502:0:7455:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a4c373f700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c7a3a300 00000020:00080000:2.0:1789395143.887506:0:7455:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].393 00010000:00010000:1.0:1789395143.887507:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789395143.887511:0:7455:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3ca40d100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a3c924ee00 00000020:00080000:2.0:1789395143.887519:0:7455:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].393 00010000:00010000:1.0:1789395143.887536:0:14651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 10 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.887558:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789395143.887563:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395143.887567:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.887604:0:14651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 10 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.887616:0:14651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 10 pid: 14650 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395143.887626:0:7455:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4c2a34a80 x1876316239724800/t4294983570(4294983570) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395159 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789395143.887630:0:14651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14651:1876316239725312:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395143.887654:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239724800:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1789395143.887748:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 399 committed batchid 398 00000020:00080000:2.0:1789395143.887802:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 398 00000100:00100000:0.0:1789395143.887947:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3636:x1876316239723648:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1789395143.887963:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2508 count 1 00010000:00010000:0.0:1789395143.887976:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.887989:0:14652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 10 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.887996:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789395143.887999:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.888003:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.888033:0:14652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 10 pid: 14651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.888043:0:14652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 10 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.888053:0:14652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14652:1876316239725440:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395143.888059:0:14651:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.888081:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239724160 00000100:00100000:1.0:1789395143.888087:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239724160 00000100:00100000:1.0:1789395143.888121:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:1.0:1789395143.888128:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3639:x1876316239724416:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1789395143.888144:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2507 count 1 00010000:00010000:1.0:1789395143.888159:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.888170:0:14652:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc480 going to sleep for 11 seconds 00010000:00010000:1.0:1789395143.888172:0:14638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 11 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.888186:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789395143.888189:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395143.888194:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.888194:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:0.0:1789395143.888207:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3638:x1876316239723776:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1789395143.888220:0:14638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 11 pid: 14639 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789395143.888226:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2509 count 1 00010000:00010000:1.0:1789395143.888234:0:14638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 11 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.888241:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.888255:0:14478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 10 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.888260:0:14638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14638:1876316239725568:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395143.888294:0:14638:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.888312:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:1.0:1789395143.888319:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+9:3638:x1876316239724288:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1789395143.888333:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2509 count 1 00010000:00010000:0.0:1789395143.888334:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789395143.888340:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.888344:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.888349:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.888362:0:14655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 11 pid: 14652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.888370:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789395143.888372:0:14478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 10 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.888374:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395143.888404:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.888422:0:14478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 10 pid: 8425 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.888428:0:14655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 11 pid: 14652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.888441:0:14478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14478:1876316239725696:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395143.888446:0:14655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 11 pid: 14652 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.888461:0:14655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14655:1876316239725824:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395143.888482:0:14478:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca1cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.888497:0:14655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181a80 going to sleep for 11 seconds 00000100:00080000:0.0:1789395143.888505:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395143.888543:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239723264:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1789395143.888565:0:7874:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4e7f706c0 version 779 rpc_version 779 00000020:00100000:1.0:1789395143.888583:0:7874:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789395143.888590:0:7874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d99d7800 x1876316239726080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789395143.888606:0:7874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239726080:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.888644:0:7874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395143.888667:0:7874:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.888684:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726080 00000100:00100000:0.0:1789395143.888684:0:14650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14650:1876316239723392:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395143.888703:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726080 00010000:00010000:0.0:1789395143.888704:0:14650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.888734:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395143.888744:0:14639:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca356540 going to sleep for 11 seconds 00000100:00100000:1.0:1789395143.889057:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1789395143.889065:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:7874:x1876316239726080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1789395143.889191:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:7874:x1876316239726080:12345-0@lo:1000:osp_up1-0.0 Request processed in 126us (545us total) trans 4294968534 rc 0/0 00000100:00100000:1.0:1789395143.889198:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:0.0:1789395143.889235:0:7874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7874:1876316239726080:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1789395143.894753:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1876316239725056:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395143.894783:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.904996:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10007:1876316239724928:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395143.905031:0:10007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.906696:0:14652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14652:1876316239725440:192.168.203.54@tcp:104: 00010000:00010000:3.0:1789395143.906740:0:14652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.907245:0:14639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14639:1876316239725184:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395143.907271:0:14639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.907518:0:14651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14651:1876316239725312:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395143.907536:0:14651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.907576:0:14638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14638:1876316239725568:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395143.907589:0:14638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.908812:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395143.908834:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395143.908862:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395143.908903:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772544 00000100:00100000:0.0:1789395143.908911:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772544 00010000:00010000:0.0:1789395143.908950:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 12 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.908985:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772800 00000100:00100000:0.0:1789395143.908989:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772800 00000100:00100000:3.0:1789395143.908998:0:14655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14655:1876316239725824:192.168.203.54@tcp:104: 00010000:00010000:0.0:1789395143.909009:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 13 pid: 14655 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.909036:0:14655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.909043:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773056 00000100:00100000:0.0:1789395143.909049:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773056 00010000:00010000:0.0:1789395143.909079:0:8441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 11 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.909092:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1590 00000100:00100000:3.0:1789395143.909109:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231772544:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395143.909131:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395143.909141:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 13 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.909164:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 13 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.909165:0:14478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14478:1876316239725696:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395143.909195:0:14478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.909227:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316adf0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f6a expref: 13 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.909257:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.909262:0:20671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.909268:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.909279:0:20671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.909316:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395143.909564:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231772544:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 458us (757us total) trans 0 rc 0/0 00010000:00010000:1.0:1789395143.909624:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.909636:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.909647:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.909659:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.909680:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789395143.909858:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239724032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24125us (24972us total) trans 4294969895 rc 0/0 00000100:00100000:1.0:1789395143.909883:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5231 00000100:00100000:1.0:1789395143.909908:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:1.0:1789395143.909917:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3636:x1876316239724160:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1789395143.909942:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2505 count 1 00010000:00010000:1.0:1789395143.909962:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.909979:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.909988:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=8s v=(0 0) 00010000:00010000:1.0:1789395143.909993:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395143.909998:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910042:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910056:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.910070:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1876316239726208:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395143.910429:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca181180 going to sleep for 11 seconds 00010000:00010000:1.0:1789395143.910442:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395143.910448:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910456:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aae00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395143.910460:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910469:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910485:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910492:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ea18f41/0xff35729af316b9c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.910508:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395143.910510:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395143.910512:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395143.910538:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969888 gen 2 00000004:00080000:1.0:1789395143.910544:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20d180, transno 4294969888 00000100:00100000:1.0:1789395143.910558:0:3636:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4c2a35180 x1876316239724032/t4294969895(4294969895) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789395159 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789395143.910570:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a35180/2, rc 0, transno 4294969895 00000100:00100000:1.0:1789395143.910575:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239724032:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1789395143.912755:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1591 00000100:00100000:0.0:1789395143.912769:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231772800:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395143.912788:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.912797:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 12 pid: 14655 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.912810:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 12 pid: 14655 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.912831:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8ed44e7/0xff35729af316b7c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061cb expref: 12 pid: 14655 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.912845:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.912849:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.912854:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.912863:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.912898:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.912949:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231772800:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 184us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.912958:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1591 00000100:00100000:0.0:1789395143.912979:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1592 00000100:00100000:0.0:1789395143.912987:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231773056:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395143.912996:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.913002:0:8441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 11 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917721:0:8441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 11 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917747:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316b774 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210619a expref: 11 pid: 14651 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917764:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.917769:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.917775:0:8441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917784:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917828:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.917896:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231773056:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 4908us (9030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.917907:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1592 00010000:00010000:0.0:1789395143.917968:0:14639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917979:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917989:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.917998:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918015:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395143.918552:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239724544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 32660us (33631us total) trans 4294969896 rc 0/0 00000100:00100000:0.0:1789395143.918560:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232 00010000:00010000:0.0:1789395143.918585:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395143.918592:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918600:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.918605:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918615:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918628:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918637:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083fc49aa/0xff35729af316b9ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918655:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.918657:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.918659:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789395143.918697:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a37100/2, rc 0, transno 4294969896 00000100:00100000:0.0:1789395143.918703:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239724544:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1789395143.918726:0:14652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918735:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918743:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918751:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918767:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395143.918878:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239723648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 30926us (33900us total) trans 4294969894 rc 0/0 00000100:00100000:0.0:1789395143.918886:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233 00010000:00010000:0.0:1789395143.918904:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395143.918909:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918916:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.918919:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918932:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918943:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918951:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f0d3be/0xff35729af316b9dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.918965:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.918966:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.918969:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395143.918989:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969889 gen 2 00000004:00080000:0.0:1789395143.918994:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20fb80, transno 4294969889 00000100:00100000:0.0:1789395143.919008:0:3636:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4c2a35f80 x1876316239723648/t4294969894(4294969894) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789395159 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789395143.919017:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a35f80/2, rc 0, transno 4294969894 00000100:00100000:0.0:1789395143.919020:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239723648:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1789395143.921429:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1590 00000100:00100000:0.0:1789395143.926018:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395143.926169:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773312 00000100:00100000:3.0:1789395143.926306:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773312 00010000:00010000:3.0:1789395143.926367:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.926459:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1593 00000100:00100000:3.0:1789395143.926472:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231773312:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395143.926492:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395143.926502:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.926519:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.926548:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a09bee13/0xff35729af316af01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fda expref: 10 pid: 14638 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.926573:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.926579:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.926587:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.926599:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.926647:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.926682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395143.926715:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231773312:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 244us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395143.926725:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1593 00000100:00100000:3.0:1789395143.926753:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772672 00000100:00100000:3.0:1789395143.926759:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772672 00000100:00100000:0.0:1789395143.926766:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:3.0:1789395143.926781:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 9 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.926817:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395143.926842:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395143.926860:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:2.0:1789395143.928655:0:14650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.928677:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.928690:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.928698:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.928728:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789395143.928898:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231772928 00000100:00100000:3.0:1789395143.929020:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231772928 00010000:00010000:3.0:1789395143.929070:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 10 pid: 14650 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.929097:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773184 00000100:00100000:3.0:1789395143.929101:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773184 00010000:00010000:3.0:1789395143.929118:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 10 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.929131:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773440 00000100:00100000:3.0:1789395143.929134:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773440 00010000:00010000:3.0:1789395143.929146:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 11 pid: 8425 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.929157:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773568 00000100:00100000:3.0:1789395143.929159:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773568 00010000:00010000:3.0:1789395143.929170:0:16674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 11 pid: 14652 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.929493:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00010000:00010000:0.0:1789395143.929512:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395143.929519:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929527:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aac00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.929532:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929542:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929562:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929569:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb23a47c/0xff35729af316b9b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929591:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.929593:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.929594:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395143.929610:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773696 00000100:00100000:0.0:1789395143.929618:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773696 00010000:00010000:0.0:1789395143.929649:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395143.929676:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1594 00000100:00100000:0.0:1789395143.929686:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231772672:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395143.929703:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.929709:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 11 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929720:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 11 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929735:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316ad9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105f1d expref: 11 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929748:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.929752:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.929757:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929767:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929796:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.929840:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231772672:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 154us (3161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.929847:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1594 00000100:00100000:0.0:1789395143.929907:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1595 00000100:00100000:0.0:1789395143.929915:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231772928:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395143.929922:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.929928:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 9 pid: 14650 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929938:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 9 pid: 14650 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929950:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045052705/0xff35729af316b6b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa445840210615b expref: 9 pid: 14650 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929960:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.929964:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.929967:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929975:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.929993:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.930012:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231772928:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 98us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.930018:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1595 00000100:00100000:0.0:1789395143.930032:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1596 00000100:00100000:0.0:1789395143.930038:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231773184:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395143.930045:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.930050:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 12 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395143.930532:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1876316239726208:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395143.930561:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.930573:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1597 00000100:00100000:3.0:1789395143.930589:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231773440:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395143.930606:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395143.930617:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 7 pid: 8425 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930633:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 7 pid: 8425 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930657:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdd00e4f/0xff35729af316b807 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021061e0 expref: 7 pid: 8425 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930673:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.930678:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.930684:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930694:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930730:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395143.930781:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231773440:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 198us (3937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395143.930789:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1597 00000100:00100000:3.0:1789395143.930809:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1598 00000100:00100000:3.0:1789395143.930817:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231773696:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395143.930827:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395143.930833:0:16674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930849:0:16674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930863:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316aec2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402105fc5 expref: 12 pid: 10007 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930888:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.930892:0:16674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395143.930896:0:16674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395143.930904:0:16674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931092:0:14478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931103:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931114:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931122:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931141:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789395143.931306:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3638:x1876316239723776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 43100us (46131us total) trans 4294969896 rc 0/0 00000100:00100000:1.0:1789395143.931314:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00010000:00010000:1.0:1789395143.931339:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395143.931344:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931370:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395143.931374:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931411:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931429:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931437:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018c0e939/0xff35729af316b9ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.931456:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395143.931458:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395143.931459:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395143.931789:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3639:x1876316239722240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 51264us (51461us total) trans 4294969895 rc 0/0 00000100:00100000:2.0:1789395143.931797:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229 00000004:00080000:1.0:1789395143.931997:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a35880/2, rc 0, transno 4294969895 00000100:00100000:1.0:1789395143.932004:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239722240:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1789395143.932154:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 11 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932174:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316b6f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106170 expref: 11 pid: 14639 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932188:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.932192:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.932197:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932206:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932236:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.932277:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231773184:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 2237us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.932298:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1596 00000100:00100000:0.0:1789395143.932327:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1599 00010000:00010000:3.0:1789395143.932428:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395143.932438:0:14638:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.932449:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.932460:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.932470:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395143.932481:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231773696:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 1659us (2988us total) trans 0 rc 0/0 00010000:00010000:1.0:1789395143.932491:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789395143.932492:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1598 00000100:00100000:1.0:1789395143.932633:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3639:x1876316239724416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 44503us (47492us total) trans 4294969897 rc 0/0 00000100:00100000:1.0:1789395143.932642:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000004:00080000:1.0:1789395143.932678:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a34000/2, rc 0, transno 4294969897 00000100:00100000:1.0:1789395143.932683:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239724416:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1789395143.932893:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231773568:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395143.932912:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395143.932919:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 8 pid: 14652 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932937:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 8 pid: 14652 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932952:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316b735 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106185 expref: 8 pid: 14652 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932964:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.932968:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395143.932973:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.932981:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933013:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395143.933041:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231773568:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 707us (6182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395143.933049:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1599 00010000:00010000:0.0:1789395143.933092:0:10007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933102:0:10007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933110:0:10007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933118:0:10007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933134:0:10007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789395143.933240:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239723520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 47871us (48408us total) trans 4294969897 rc 0/0 00000100:00100000:0.0:1789395143.933248:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5230 00010000:00010000:0.0:1789395143.933877:0:14651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933889:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933898:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933906:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.933923:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1789395143.934025:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3639:x1876316239723904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 46801us (48935us total) trans 4294969898 rc 0/0 00000100:00100000:0.0:1789395143.934032:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00000004:00080000:0.0:1789395143.934145:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a34e00/2, rc 0, transno 4294969896 00000100:00100000:0.0:1789395143.934153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239723776:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1789395143.934174:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789395143.934180:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934188:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.934193:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934202:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934219:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934227:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d566a84e/0xff35729af316b9e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934249:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395143.934252:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934258:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.934261:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934268:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934278:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934285:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316b9c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934298:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395143.934301:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934307:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.934309:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934316:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934326:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934333:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316b9d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.934549:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.934551:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.934553:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789395143.934575:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a37b80/2, rc 0, transno 4294969898 00000100:00100000:0.0:1789395143.934581:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239723904:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1789395143.934607:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.934613:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789395143.934632:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a36680/2, rc 0, transno 4294969897 00000100:00100000:0.0:1789395143.934637:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239723520:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1789395143.938322:0:14655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.938361:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.938374:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.938404:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395143.938434:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789395143.938625:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239724288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 50303us (53390us total) trans 4294969898 rc 0/0 00000100:00100000:1.0:1789395143.938635:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000004:00080000:1.0:1789395143.938688:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a37480/2, rc 0, transno 4294969898 00000100:00100000:1.0:1789395143.938694:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239724288:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1789395143.939203:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395143.939211:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.939221:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.939226:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.939235:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.939254:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.939262:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316b9f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.939285:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.939287:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.939289:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395143.939895:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.939907:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.939915:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.939922:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395143.939979:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395143.940138:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239724160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 30220us (53930us total) trans 4294969899 rc 0/0 00000100:00100000:2.0:1789395143.940147:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000004:00080000:2.0:1789395143.940208:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a36d80/2, rc 0, transno 4294969899 00000100:00100000:2.0:1789395143.940213:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239724160:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1789395143.943704:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395143.943718:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.943732:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395143.943738:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.943750:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.943771:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.943778:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316b9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395143.943800:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.943802:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395143.943804:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395144.376128:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239726720:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376194:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376246:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239727232:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376296:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239727744:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376340:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789395144.376345:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239726336:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376477:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239726848:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376504:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376528:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239727360:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376549:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376565:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239727872:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.376585:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.376615:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239726464:0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.376900:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726848 00000100:00100000:2.0:1789395144.376907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726848 00000100:00100000:2.0:1789395144.376954:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520 00000100:00100000:2.0:1789395144.376963:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3636:x1876316239726848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.377025:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3636:x1876316239726848:12345-0@lo:400:kworker.0 Request processed in 63us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395144.377036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520 00000100:00100000:2.0:1789395144.377082:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239726848:0@lo:400:kworker.0 00000100:00100000:3.0:1789395144.377171:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726336 00000100:00100000:3.0:1789395144.377177:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726336 00000100:00100000:3.0:1789395144.377217:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1789395144.377225:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.377239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.377261:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239726976:0@lo:400:kworker.0 00000100:00100000:3.0:1789395144.377274:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239726336:12345-0@lo:400:kworker.0 Request processed in 51us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.377280:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1789395144.377285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.377301:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239727488:0@lo:400:kworker.0 00000100:00100000:3.0:1789395144.377306:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726720 00000100:00100000:3.0:1789395144.377310:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726720 00000100:00100000:1.0:1789395144.377320:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395144.377339:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789395144.377346:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239726592:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.377367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395144.377473:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727232 00000100:00100000:1.0:1789395144.377475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239727104:0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.377477:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727232 00000100:00100000:1.0:1789395144.377497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395144.377504:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727744 00000100:00100000:0.0:1789395144.377512:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727744 00000100:00100000:0.0:1789395144.377530:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727360 00000100:00100000:0.0:1789395144.377532:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727360 00000100:00100000:0.0:1789395144.377555:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727872 00000100:00100000:0.0:1789395144.377557:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727872 00000100:00100000:0.0:1789395144.377578:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789395144.377585:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239727232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.377622:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239727232:12345-0@lo:400:kworker.0 Request processed in 37us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.377629:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789395144.377642:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789395144.377648:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239727744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.377676:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1876316239727744:12345-0@lo:400:kworker.0 Request processed in 28us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.377682:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789395144.377693:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789395144.377698:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239727360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.377724:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239727360:12345-0@lo:400:kworker.0 Request processed in 26us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.377729:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789395144.377740:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1789395144.377745:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239727872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.377769:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239727872:12345-0@lo:400:kworker.0 Request processed in 24us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.377774:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789395144.381557:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239727616:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.381619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395144.381720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726592 00000100:00100000:2.0:1789395144.381728:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726592 00000100:00100000:2.0:1789395144.381799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1789395144.381808:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239726592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.381878:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239726592:12345-0@lo:400:kworker.0 Request processed in 59us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395144.381886:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521 00000100:00100000:3.0:1789395144.382588:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726464 00000100:00100000:3.0:1789395144.382594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726464 00000100:00100000:3.0:1789395144.382629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239726976 00000100:00100000:3.0:1789395144.382632:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239726976 00000100:00100000:3.0:1789395144.382650:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727488 00000100:00100000:3.0:1789395144.382653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727488 00000100:00100000:3.0:1789395144.382666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727104 00000100:00100000:3.0:1789395144.382668:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727104 00000100:00100000:3.0:1789395144.382683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1789395144.382691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239726720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395144.382738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239726720:12345-0@lo:400:kworker.0 Request processed in 49us (6544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.382745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1789395144.382758:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1789395144.382764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.382769:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1789395144.382777:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395144.382792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239726464:12345-0@lo:400:kworker.0 Request processed in 29us (5553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.382797:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1789395144.382804:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239726976:12345-0@lo:400:kworker.0 Request processed in 29us (5518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.382808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1789395144.382811:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1789395144.382813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239727488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.382822:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1789395144.382827:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239727104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395144.382839:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239727488:12345-0@lo:400:kworker.0 Request processed in 27us (5518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.382845:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1789395144.382848:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239727104:12345-0@lo:400:kworker.0 Request processed in 22us (5352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395144.382853:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1789395144.382906:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239726336:0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.382930:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969894 gen 2 00000004:00080000:2.0:1789395144.382936:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969883 committed transno 4294969894 00000004:00080000:2.0:1789395144.382954:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969885 committed transno 4294969894 00000004:00080000:2.0:1789395144.382963:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969887 committed transno 4294969894 00000004:00080000:2.0:1789395144.382976:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969890 committed transno 4294969894 00000004:00080000:2.0:1789395144.382985:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969892 committed transno 4294969894 00000004:00080000:2.0:1789395144.382992:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969894 committed transno 4294969894 00000100:00100000:2.0:1789395144.383000:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239727360:0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.383013:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969893 gen 2 00000004:00080000:2.0:1789395144.383017:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969882 committed transno 4294969893 00000004:00080000:2.0:1789395144.383028:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969884 committed transno 4294969893 00000004:00080000:2.0:1789395144.383038:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969886 committed transno 4294969893 00000004:00080000:2.0:1789395144.383047:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969888 committed transno 4294969893 00000004:00080000:2.0:1789395144.383057:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969891 committed transno 4294969893 00000004:00080000:2.0:1789395144.383083:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969893 committed transno 4294969893 00000100:00100000:2.0:1789395144.383101:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239727872:0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.383117:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239726720:0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.383128:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239727232:0@lo:400:kworker.0 00000100:00100000:2.0:1789395144.383138:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239727744:0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.386842:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239727616 00000100:00100000:0.0:1789395144.386857:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239727616 00000100:00100000:1.0:1789395144.386918:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239726464:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.386935:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239726976:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.386946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239727488:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.387076:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239726592:0@lo:400:kworker.0 00000100:00100000:1.0:1789395144.387091:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239727104:0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.387799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1789395144.387812:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239727616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395144.387913:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239727616:12345-0@lo:400:kworker.0 Request processed in 105us (6293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.387924:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1789395144.388002:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239727616:0@lo:400:kworker.0 00000100:00080000:1.0:1789395144.388535:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789395144.388542:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789395144.388547:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395144.388550:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789395144.438282:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789395144.475705:0:21148:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60i skipping SLOW test 60i 00000100:00100000:2.0:1789395144.881671:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239728000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395144.881743:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395144.881816:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728000 00000100:00100000:2.0:1789395144.881823:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728000 00000100:00100000:2.0:1789395144.881877:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789395144.881886:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239728000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395144.881915:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92712384 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395144.882077:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239728000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 191us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395144.882089:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789395144.882268:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239728384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395144.882298:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395144.882318:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395144.882324:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239728256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395144.882345:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395144.882372:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728384 00000100:00100000:3.0:1789395144.882376:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728384 00000100:00100000:3.0:1789395144.882413:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728256 00000100:00100000:3.0:1789395144.882417:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728256 00000100:00100000:3.0:1789395144.882429:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789395144.882435:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3637:x1876316239728384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789395144.882454:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59100608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789395144.882490:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3637:x1876316239728384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.882497:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789395144.882510:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789395144.882516:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239728256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789395144.882525:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92712384 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395144.882550:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239728256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395144.882555:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789395144.882590:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239728256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395144.882601:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239728384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395144.884107:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239728128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395144.884170:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395144.884234:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728128 00000100:00100000:0.0:1789395144.884240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728128 00000100:00100000:0.0:1789395144.884282:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522 00000100:00100000:0.0:1789395144.884291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3639:x1876316239728128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395144.884323:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:0.0:1789395144.884365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3639:x1876316239728128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.884373:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522 00000100:00100000:0.0:1789395144.884437:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239728128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395144.888350:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239728000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395144.888413:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239728512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395144.888488:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395144.888643:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728512 00000100:00100000:0.0:1789395144.888650:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728512 00000100:00100000:0.0:1789395144.888705:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789395144.888716:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239728512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789395144.888736:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59100608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789395144.888793:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239728512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395144.888801:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789395144.889055:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239728512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789395145.457653:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789395146.079952:0:21196:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60j: llog_reader reports corruptions ====== 10:12:25 (1789395145) 00010000:00010000:0.0:1789395146.482597:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789395147.144977:0:21244:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:1.0:1789395147.324123:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395147.324158:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395147.324178:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395147.324320:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395147.324348:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395147.324358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773824 00000100:00100000:0.0:1789395147.324368:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773824 00000100:00100000:1.0:1789395147.324404:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231773952 00000100:00100000:1.0:1789395147.324409:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231773952 00000100:00100000:0.0:1789395147.324444:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 441 00000100:00100000:0.0:1789395147.324457:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231773824:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395147.324458:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774080 00000100:00100000:1.0:1789395147.324462:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774080 00000100:00100000:1.0:1789395147.324492:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 612 00000100:00100000:1.0:1789395147.324500:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231773952:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395147.324536:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231773824:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 82us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395147.324544:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 441 00000100:00100000:1.0:1789395147.324725:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231773952:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 225us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395147.324732:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 612 00000100:00100000:1.0:1789395147.324748:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 613 00000100:00100000:1.0:1789395147.324754:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231774080:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395147.324782:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231774080:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395147.324787:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 613 00000100:00100000:1.0:1789395147.324809:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774208 00000100:00100000:1.0:1789395147.324813:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774208 00000100:00100000:1.0:1789395147.324850:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774336 00000100:00100000:1.0:1789395147.324853:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774336 00000100:00100000:1.0:1789395147.324877:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 411 00000100:00100000:1.0:1789395147.324884:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231774208:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395147.324911:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2395:x1876316231774208:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395147.324917:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 411 00000100:00100000:1.0:1789395147.324937:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 412 00000100:00100000:1.0:1789395147.324943:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231774336:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395147.324962:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231774336:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 20us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395147.324968:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 412 00000100:00080000:1.0:1789395147.324984:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395147.324988:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789395147.324991:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789395147.324993:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789395147.507106:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395148.465577:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239728640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789395148.465655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395148.465813:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728640 00000100:00100000:3.0:1789395148.465821:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728640 00000100:00100000:3.0:1789395148.465882:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523 00000100:00100000:3.0:1789395148.465892:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239728640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789395148.465925:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444044800 avail 1297805312 00000100:00100000:3.0:1789395148.465973:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239728640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395148.465980:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523 00000100:00100000:3.0:1789395148.466032:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239728640:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789395148.530161:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395148.755714:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395148.755774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774464 00000100:00100000:3.0:1789395148.755784:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774464 00000100:00100000:3.0:1789395148.755849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23594 00000100:00100000:3.0:1789395148.755858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:19076:x1876316231774464:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395148.755879:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395148.755900:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316b9ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395148.755956:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316ba06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395148.755968:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316ba06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395148.755979:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316ba06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395148.756024:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395148.756027:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395148.756046:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316ba06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395148.756069:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316b9ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061ee expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395148.756091:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316ba06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061ee expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395148.756100:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395148.756103:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395148.756107:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b000, rc 0) 00000100:00100000:3.0:1789395148.756157:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:19076:x1876316231774464:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 300us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395148.756165:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23594 00000100:00100000:3.0:1789395148.763797:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395148.763994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774592 00000100:00100000:1.0:1789395148.764005:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774592 00000100:00100000:1.0:1789395148.764056:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23595 00000100:00100000:1.0:1789395148.764066:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:19076:x1876316231774592:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395148.764087:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395148.764108:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ba0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061f5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764174:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764188:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764200:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764213:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764220:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764227:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764285:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764296:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764302:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764309:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764315:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395148.764320:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764326:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764352:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395148.764356:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395148.764360:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764367:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316ba14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764379:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764412:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764418:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764423:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395148.764426:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764431:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764438:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff89a3ca363700) 00010000:00010000:1.0:1789395148.764440:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395148.764443:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764449:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316ba1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764481:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ba0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061f5 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764491:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395148.764494:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395148.764498:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316ba0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061f5 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.764507:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:1.0:1789395148.764566:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:19076:x1876316231774592:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 501us (778us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395148.764574:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23595 00000100:00100000:3.0:1789395148.773068:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395148.773217:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774848 00000100:00100000:1.0:1789395148.773228:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774848 00000100:00100000:1.0:1789395148.773294:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23596 00000100:00100000:1.0:1789395148.773313:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:19076:x1876316231774848:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395148.773370:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395148.773417:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316ba06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061ee expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.773436:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395148.773441:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395148.773515:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.773528:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.773537:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.773552:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.773559:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.773566:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774165:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774175:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774183:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395148.774198:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f6b20ff reply state 00000000afbbeca3 transno 4294983571 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774210:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774216:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:1.0:1789395148.774218:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395148.774221:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789395148.774226:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152a:0x0]: returning size 4096 00010000:00010000:1.0:1789395148.774233:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774240:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774246:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774252:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774258:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395148.774262:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774269:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.774282:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395148.774285:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395148.774289:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.775206:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316ba22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395148.775227:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f6b20ff reply state 00000000afbbeca3 transno 4294983571 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.775240:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395148.775248:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff89a3ca363c00) 00010000:00010000:1.0:1789395148.775251:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395148.775254:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789395148.775364:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:19076:x1876316231774848:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 2058us (2304us total) trans 4294983571 rc 0/0 00000100:00100000:1.0:1789395148.775374:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23596 00000100:00100000:0.0:1789395149.495243:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239728768:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.495344:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395149.496348:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395149.496364:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239728896:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.496433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.496683:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239729408:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.496740:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239729920:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496762:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.496783:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789395149.496788:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239729280:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.496841:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239729792:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395149.496893:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239729024:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239730304:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496941:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395149.496941:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395149.496971:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239729536:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.496991:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728896 00000100:00100000:0.0:1789395149.496998:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.497001:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728896 00000100:00100000:0.0:1789395149.497020:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239730048:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497045:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395149.497073:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789395149.497079:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239729152:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497101:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395149.497112:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239729664:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.497141:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729408 00000100:00100000:2.0:1789395149.497146:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729408 00000100:00100000:0.0:1789395149.497152:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239730176:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.497182:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729920 00000100:00100000:0.0:1789395149.497184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395149.497188:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729920 00000100:00100000:2.0:1789395149.497211:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729536 00000100:00100000:2.0:1789395149.497214:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729536 00000100:00100000:2.0:1789395149.497226:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730048 00000100:00100000:2.0:1789395149.497229:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730048 00000100:00100000:2.0:1789395149.497241:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729152 00000100:00100000:2.0:1789395149.497243:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729152 00000100:00100000:2.0:1789395149.497259:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1789395149.497268:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239728896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729280 00000100:00100000:0.0:1789395149.497300:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729280 00000100:00100000:0.0:1789395149.497339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729024 00000100:00100000:0.0:1789395149.497342:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729024 00000100:00100000:2.0:1789395149.497351:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239728896:12345-0@lo:400:kworker.0 Request processed in 81us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395149.497358:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1789395149.497367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3524 00000100:00100000:0.0:1789395149.497376:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3637:x1876316239729280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.497412:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1789395149.497423:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239729408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3637:x1876316239729280:12345-0@lo:400:kworker.0 Request processed in 71us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.497454:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3524 00000100:00100000:0.0:1789395149.497470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525 00000100:00100000:0.0:1789395149.497477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239729024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497583:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:3638:x1876316239729024:12345-0@lo:400:kworker.0 Request processed in 104us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.497591:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525 00000100:00100000:0.0:1789395149.497691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1789395149.497700:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239729920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497735:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239729920:12345-0@lo:400:kworker.0 Request processed in 37us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.497742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1789395149.497756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1789395149.497763:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239729536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497792:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239729536:12345-0@lo:400:kworker.0 Request processed in 29us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.497798:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1789395149.497810:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1789395149.497819:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239730048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497860:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239730048:12345-0@lo:400:kworker.0 Request processed in 44us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.497867:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1789395149.497880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1789395149.497886:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239729152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.497914:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239729152:12345-0@lo:400:kworker.0 Request processed in 29us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.497921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1789395149.497961:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239729408:12345-0@lo:400:kworker.0 Request processed in 538us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395149.497970:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1789395149.497998:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239728896:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498014:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729792 00000100:00100000:2.0:1789395149.498019:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729792 00000100:00100000:0.0:1789395149.498038:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239729152:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.498054:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239729024:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498056:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730304 00000100:00100000:2.0:1789395149.498061:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730304 00000100:00100000:0.0:1789395149.498067:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239729536:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.498082:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239730048:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498090:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239729664 00000100:00100000:2.0:1789395149.498095:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239729664 00000100:00100000:2.0:1789395149.498117:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730176 00000100:00100000:2.0:1789395149.498120:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730176 00000100:00100000:0.0:1789395149.498131:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789395149.498142:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239729792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498158:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789395149.498168:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.498180:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239729792:12345-0@lo:400:kworker.0 Request processed in 39us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.498188:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789395149.498204:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789395149.498213:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239730304:12345-0@lo:400:kworker.0 Request processed in 46us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395149.498220:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789395149.498233:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789395149.498239:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239730176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498274:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239730176:12345-0@lo:400:kworker.0 Request processed in 36us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395149.498280:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:2.0:1789395149.498311:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395149.498316:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789395149.498318:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395149.498321:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395149.498347:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239729664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498352:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239729280:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498367:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239729792:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498381:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239730304:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.498426:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239729408:0@lo:400:kworker.0 00000100:00100000:0.0:1789395149.498586:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3638:x1876316239729664:12345-0@lo:400:kworker.0 Request processed in 375us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395149.498725:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789395149.500263:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239729920:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.500408:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239729664:0@lo:400:kworker.0 00000100:00100000:2.0:1789395149.500425:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239730176:0@lo:400:kworker.0 00000100:00100000:1.0:1789395149.501333:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239728768 00000100:00100000:1.0:1789395149.501347:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239728768 00000100:00100000:1.0:1789395149.501503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789395149.501516:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239728768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395149.501627:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239728768:12345-0@lo:400:kworker.0 Request processed in 113us (6283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395149.501635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1789395149.501991:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239728768:0@lo:400:kworker.0 00010000:00010000:0.0:1789395149.553726:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789395150.003640:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969898 is committed 00000100:00100000:0.0:1789395150.004217:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239730432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395150.004326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395150.004628:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730432 00000100:00100000:0.0:1789395150.004638:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730432 00000100:00100000:0.0:1789395150.004705:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789395150.004716:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3637:x1876316239730432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395150.004755:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92712384 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395150.004809:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3637:x1876316239730432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395150.004817:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789395150.005236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239730560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395150.005277:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395150.005402:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239730432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395150.005942:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730560 00000100:00100000:0.0:1789395150.005950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730560 00000100:00100000:0.0:1789395150.005989:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526 00000100:00100000:0.0:1789395150.005998:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3638:x1876316239730560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395150.006036:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:0.0:1789395150.006090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:3638:x1876316239730560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395150.006097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526 00000100:00100000:0.0:1789395150.006173:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239730560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395150.007230:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239730688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395150.007314:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395150.007425:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730688 00000100:00100000:2.0:1789395150.007502:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730688 00000100:00100000:2.0:1789395150.007552:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789395150.007561:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239730688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395150.007593:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59100608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789395150.007659:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239730688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395150.007672:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789395150.007690:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239730688:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789395150.007779:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983571 is committed 00000001:00080000:2.0:1789395150.007790:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983570 is committed 00000001:00080000:0.0:1789395150.008568:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968534 is committed 00000020:00080000:0.0:1789395150.008578:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 399 batchid updated 00000020:00080000:0.0:1789395150.008610:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 399 00000004:00080000:0.0:1789395150.008686:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a4d92d3780 with version 752 00000020:00080000:0.0:1789395150.008697:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 399 cancel update log [0x200000401:0x3:0x0].393: rc = 0 00000020:00080000:0.0:1789395150.008807:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 399 cancel update log [0x240000400:0x3:0x0].393: rc = 0 00000020:00080000:0.0:1789395150.008816:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 399 00000004:00080000:0.0:1789395150.008848:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 752 rpc_version 752 00000020:00100000:0.0:1789395150.008884:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395150.008897:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a4d8357b80 x1876316239730944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395150.008924:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8357b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239730944:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395150.008959:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.008975:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.008984:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395150.008994:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789395150.009005:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395150.009011:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009019:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395150.009034:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca31b600 going to sleep for 11 seconds 00010000:00010000:1.0:1789395150.009039:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff89a3ca363c00) 00010000:00010000:1.0:1789395150.009045:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395150.009050:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009057:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba29 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395150.009061:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239730944 00000100:00100000:0.0:1789395150.009070:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239730944 00010000:00010000:1.0:1789395150.009093:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009101:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009107:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009114:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395150.009118:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009124:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395150.009127:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3527 00000100:00100000:0.0:1789395150.009140:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:7455:x1876316239730944:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395150.009142:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:1.0:1789395150.009150:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395150.009153:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395150.009160:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395150.009305:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239730944:12345-0@lo:1000:osp_up0-1.0 Request processed in 165us (316us total) trans 4294983572 rc 0/0 00000100:00100000:0.0:1789395150.009315:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3527 00000100:00100000:1.0:1789395150.009338:0:7455:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983570 gen 2 00000004:00080000:1.0:1789395150.009345:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983570 committed transno 4294983570 00000100:00100000:1.0:1789395150.009379:0:7455:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4d8357b80 x1876316239730944/t4294983572(4294983572) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1789395166 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789395150.009429:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8357b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239730944:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395150.010213:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239731072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395150.010266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1789395150.010562:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969899 is committed 00000100:00100000:2.0:1789395150.013672:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731072 00000100:00100000:2.0:1789395150.013686:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731072 00000100:00100000:2.0:1789395150.013760:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789395150.013773:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239731072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395150.013810:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92712384 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395150.013920:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239731072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395150.013929:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789395150.014028:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239731072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395150.014055:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395150.014068:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239731200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789395150.014117:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395150.014167:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731200 00000100:00100000:2.0:1789395150.014172:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731200 00000100:00100000:2.0:1789395150.014207:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789395150.014220:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239731200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789395150.014236:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59100608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789395150.014274:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239731200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395150.014281:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789395150.014310:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969898 gen 2 00000004:00080000:2.0:1789395150.014317:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a35f80, transno 4294969894 00000004:00080000:2.0:1789395150.014327:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a35880, transno 4294969895 00000004:00080000:2.0:1789395150.014332:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a34e00, transno 4294969896 00000004:00080000:2.0:1789395150.014335:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a36680, transno 4294969897 00000004:00080000:2.0:1789395150.014338:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a37b80, transno 4294969898 00000100:00100000:2.0:1789395150.014347:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239731200:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1789395150.014603:0:9997:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 5 done 00000040:00080000:2.0:1789395150.526967:0:21438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:2.0:1789395150.583374:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789395151.466972:0:21487:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe44670830 00000004:00000080:0.0:1789395151.466989:0:21487:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff89a4ffb4dc00 uarg=0000000000000000 00000004:00000080:0.0:1789395151.467036:0:21487:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff89a4ffb4dc00 00000040:00080000:0.0:1789395151.467682:0:21487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789395151.467842:0:21487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789395151.467992:0:21487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 80 off8272 00000004:00000080:0.0:1789395151.468009:0:21487:0:(mdd_device.c:1855:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:0.0:1789395151.468012:0:21487:0:(mdd_device.c:471:mdd_changelog_on()) lustre-MDD0000: changelog on 00010000:00010000:0.0:1789395151.601635:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395152.434404:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395152.434442:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395152.434472:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395152.434494:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395152.434515:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395152.434542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231774976 00000100:00100000:2.0:1789395152.434553:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231774976 00000100:00100000:2.0:1789395152.434605:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 443 00000100:00100000:2.0:1789395152.434615:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231774976:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395152.434692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231774976:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395152.434699:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 443 00000100:00100000:2.0:1789395152.434736:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775104 00000100:00100000:2.0:1789395152.434738:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775104 00000100:00100000:2.0:1789395152.434774:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775232 00000100:00100000:2.0:1789395152.434777:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775232 00000100:00100000:2.0:1789395152.434795:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 620 00000100:00100000:2.0:1789395152.434801:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231775104:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395152.434843:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231775104:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395152.434854:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 620 00000100:00100000:2.0:1789395152.434864:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 621 00000100:00100000:2.0:1789395152.434870:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231775232:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395152.434888:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231775232:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 18us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395152.434893:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 621 00000100:00080000:2.0:1789395152.434907:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395152.434911:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395152.437196:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775360 00000100:00100000:1.0:1789395152.437218:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775360 00000100:00100000:0.0:1789395152.437797:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775488 00000100:00100000:0.0:1789395152.437815:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775488 00000100:00100000:0.0:1789395152.438255:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 417 00000100:00100000:1.0:1789395152.438272:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 418 00000100:00100000:0.0:1789395152.438275:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231775360:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395152.438288:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231775488:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:2.0:1789395152.438325:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395152.438332:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395152.438577:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231775488:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 293us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395152.438586:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 418 00000100:00100000:0.0:1789395152.440303:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231775360:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 2023us (5845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395152.440319:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 417 00010000:00010000:2.0:1789395152.626374:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789395153.355844:0:21583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:1.0:1789395153.592094:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395153.592124:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239731328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395153.592226:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395153.592463:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731328 00000100:00100000:0.0:1789395153.592473:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731328 00000100:00100000:0.0:1789395153.592558:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528 00000100:00100000:0.0:1789395153.592568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239731328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395153.592620:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444007936 avail 1297768448 00000100:00100000:0.0:1789395153.592677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:3639:x1876316239731328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395153.592685:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528 00000100:00100000:1.0:1789395153.594609:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239731328:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789395153.650332:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789395154.318423:0:21631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe5e136860 00000004:00000080:3.0:1789395154.318449:0:21631:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b1 len=576 karg=ffff89a3c7410800 uarg=0000000000000000 00000004:00000080:3.0:1789395154.318511:0:21631:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=424066b1 len=576 karg=ffff89a3c7410800 00000040:00080000:3.0:1789395154.319055:0:21631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789395154.319261:0:21631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789395154.319373:0:21631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:3.0:1789395154.319444:0:21631:0:(mdd_device.c:1855:mdd_changelog_user_register()) lustre-MDD0001: registered changelog user 'cl1', mask 0x0 00000004:02000000:3.0:1789395154.319448:0:21631:0:(mdd_device.c:471:mdd_changelog_on()) lustre-MDD0001: changelog on 00000100:00100000:2.0:1789395154.619877:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239731456:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.619986:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620069:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239731968:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620102:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620124:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239732480:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620150:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620168:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239732992:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620191:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620220:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789395154.620227:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239731840:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620265:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620286:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239732352:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620328:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239732864:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620411:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239731712:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620459:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239732224:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620501:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239732736:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620543:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789395154.620549:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239731584:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620589:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239732096:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620623:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239732608:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395154.620671:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731968 00000100:00100000:2.0:1789395154.620679:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731968 00000100:00100000:2.0:1789395154.620730:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731712 00000100:00100000:2.0:1789395154.620732:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731712 00000100:00100000:2.0:1789395154.620751:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3529 00000100:00100000:2.0:1789395154.620759:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239731968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620835:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239731968:12345-0@lo:400:kworker.0 Request processed in 76us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.620843:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3529 00000100:00100000:2.0:1789395154.620864:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3530 00000100:00100000:2.0:1789395154.620871:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.620904:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239731712:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.620911:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3530 00000100:00100000:2.0:1789395154.620931:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732480 00000100:00100000:2.0:1789395154.620935:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732480 00000100:00100000:2.0:1789395154.620969:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732992 00000100:00100000:2.0:1789395154.620972:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732992 00000100:00100000:2.0:1789395154.620989:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732352 00000100:00100000:2.0:1789395154.620992:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732352 00000100:00100000:2.0:1789395154.621008:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732864 00000100:00100000:2.0:1789395154.621011:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732864 00000100:00100000:2.0:1789395154.621026:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1789395154.621033:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239732480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621064:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239732480:12345-0@lo:400:kworker.0 Request processed in 32us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621070:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1789395154.621082:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789395154.621088:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239732992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621116:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239732992:12345-0@lo:400:kworker.0 Request processed in 29us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621122:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789395154.621267:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789395154.621274:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239732352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621299:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239732352:12345-0@lo:400:kworker.0 Request processed in 26us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621305:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789395154.621315:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789395154.621321:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239732864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621362:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239732864:12345-0@lo:400:kworker.0 Request processed in 27us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621368:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789395154.621425:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731840 00000100:00100000:2.0:1789395154.621430:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731840 00000100:00100000:2.0:1789395154.621453:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732224 00000100:00100000:2.0:1789395154.621456:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732224 00000100:00100000:2.0:1789395154.621468:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732736 00000100:00100000:2.0:1789395154.621470:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732736 00000100:00100000:2.0:1789395154.621480:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731584 00000100:00100000:2.0:1789395154.621482:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731584 00000100:00100000:2.0:1789395154.621491:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732096 00000100:00100000:2.0:1789395154.621494:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732096 00000100:00100000:2.0:1789395154.621506:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239732608 00000100:00100000:2.0:1789395154.621509:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239732608 00000100:00100000:2.0:1789395154.621523:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1789395154.621529:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239731840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621565:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239731840:12345-0@lo:400:kworker.0 Request processed in 32us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621571:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1789395154.621584:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1789395154.621590:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239732224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621618:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239732224:12345-0@lo:400:kworker.0 Request processed in 28us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621623:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1789395154.621633:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1789395154.621638:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239732736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621668:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239732736:12345-0@lo:400:kworker.0 Request processed in 29us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621673:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1789395154.621683:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1789395154.621689:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239731584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621713:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239731584:12345-0@lo:400:kworker.0 Request processed in 25us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621718:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1789395154.621730:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1789395154.621736:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239732096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621762:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239732096:12345-0@lo:400:kworker.0 Request processed in 27us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621768:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1789395154.621779:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1789395154.621785:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239732608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621821:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239732608:12345-0@lo:400:kworker.0 Request processed in 36us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395154.621827:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00080000:2.0:1789395154.621873:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395154.621878:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395154.621881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395154.621883:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395154.621937:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239731584:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621951:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239732096:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239732608:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621972:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239731712:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621982:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239732224:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.621991:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239732736:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.622035:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239731840:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.622044:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969899 gen 2 00000004:00080000:2.0:1789395154.622050:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a35180, transno 4294969895 00000004:00080000:2.0:1789395154.622062:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a37100, transno 4294969896 00000004:00080000:2.0:1789395154.622065:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a34000, transno 4294969897 00000004:00080000:2.0:1789395154.622068:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a37480, transno 4294969898 00000004:00080000:2.0:1789395154.622071:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a36d80, transno 4294969899 00000100:00100000:2.0:1789395154.622076:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239732352:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.622088:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239732864:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.622098:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968534 gen 2 00000004:00080000:2.0:1789395154.622104:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968529 committed transno 4294968534 00000004:00080000:2.0:1789395154.622119:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968530 committed transno 4294968534 00000004:00080000:2.0:1789395154.622129:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968531 committed transno 4294968534 00000004:00080000:2.0:1789395154.622137:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968532 committed transno 4294968534 00000004:00080000:2.0:1789395154.622147:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968533 committed transno 4294968534 00000004:00080000:2.0:1789395154.622155:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968534 committed transno 4294968534 00000100:00100000:2.0:1789395154.622168:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239731968:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.622187:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239732480:0@lo:400:kworker.0 00000100:00100000:2.0:1789395154.622198:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239732992:0@lo:400:kworker.0 00000100:00100000:1.0:1789395154.623275:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239731456 00000100:00100000:1.0:1789395154.623288:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239731456 00000100:00100000:1.0:1789395154.623929:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789395154.623942:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239731456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395154.624028:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239731456:12345-0@lo:400:kworker.0 Request processed in 90us (4043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395154.624035:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1789395154.624131:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239731456:0@lo:400:kworker.0 00000004:00080000:3.0:1789395154.624312:0:8899:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 5 done 00010000:00010000:2.0:1789395154.674176:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395155.121817:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239733248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395155.121914:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395155.122003:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395155.122280:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239733504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395155.122321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395155.122359:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395155.122365:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239733376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395155.122415:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733504 00000100:00100000:3.0:1789395155.122416:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395155.122425:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733504 00000100:00100000:3.0:1789395155.122441:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239733632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395155.122464:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395155.122505:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239733120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395155.122547:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733248 00000100:00100000:2.0:1789395155.122551:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733248 00000100:00100000:2.0:1789395155.122588:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531 00000100:00100000:2.0:1789395155.122597:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239733248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395155.122643:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395155.122698:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239733248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395155.122706:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531 00000100:00100000:3.0:1789395155.127134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395155.127250:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733376 00000100:00100000:1.0:1789395155.127263:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733376 00000100:00100000:1.0:1789395155.127319:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733632 00000100:00100000:1.0:1789395155.127323:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733632 00000100:00100000:1.0:1789395155.127342:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789395155.127353:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239733504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789395155.128276:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92712384 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395155.128409:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239733504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1056us (6083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395155.128419:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789395155.128453:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789395155.128465:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239733376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395155.128488:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59100608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395155.128518:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239733376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (6102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395155.128525:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789395155.128538:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789395155.128544:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239733632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395155.128554:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59100608 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395155.128584:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239733632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (6118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395155.128591:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789395155.128777:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239733376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395155.128807:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239733504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395155.128867:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239733632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395155.134482:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239733248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395155.134704:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733120 00000100:00100000:2.0:1789395155.134714:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733120 00000100:00100000:2.0:1789395155.134793:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789395155.134804:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239733120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395155.134834:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92712384 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395155.134912:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239733120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (7790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395155.134929:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789395155.135308:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239733120:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789395155.697589:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395155.802183:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395155.802349:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775616 00000100:00100000:3.0:1789395155.802361:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775616 00000100:00100000:3.0:1789395155.802480:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23597 00000100:00100000:3.0:1789395155.802492:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:19216:x1876316231775616:12345-192.168.203.54@tcp:46:lfs.0 00000004:00000080:3.0:1789395155.802553:0:10512:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff89a4d0048200 uarg=0000000000000000 00000004:00000080:3.0:1789395155.802608:0:10512:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff89a4d0048200 00000004:00000080:3.0:1789395155.802615:0:10512:0:(mdd_device.c:2174:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1789395155.802665:0:10512:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789395155.802669:0:10512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1789395155.802692:0:10512:0:(mdd_device.c:2146:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 0 00000040:00080000:3.0:1789395155.802757:0:10512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:3.0:1789395155.802764:0:10512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1789395155.802772:0:10512:0:(mdd_device.c:2223:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000100:00080000:2.0:1789395155.802989:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789395155.806304:0:10512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000001:00080000:3.0:1789395155.807035:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983572 is committed 00000100:00100000:2.0:1789395155.807229:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:19216:x1876316231775616:12345-192.168.203.54@tcp:46:lfs.0 Request processed in 4729us (5051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395155.807754:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23597 00000100:00100000:3.0:1789395155.842411:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395155.842620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775744 00000100:00100000:1.0:1789395155.842634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775744 00000100:00100000:1.0:1789395155.842758:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23598 00000100:00100000:1.0:1789395155.842770:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:19218:x1876316231775744:12345-192.168.203.54@tcp:46:lfs.0 00000004:00000080:1.0:1789395155.842840:0:6512:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff89a4d00483e0 uarg=0000000000000000 00000004:00000080:1.0:1789395155.842913:0:6512:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff89a4d00483e0 00000004:00000080:1.0:1789395155.842920:0:6512:0:(mdd_device.c:2174:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:1.0:1789395155.842974:0:6512:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789395155.842980:0:6512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1789395155.843004:0:6512:0:(mdd_device.c:2146:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:1.0:1789395155.843076:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789395155.843084:0:6512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1789395155.843089:0:6512:0:(mdd_device.c:2223:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:1.0:1789395155.843607:0:6512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789395155.843737:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:19218:x1876316231775744:12345-192.168.203.54@tcp:46:lfs.0 Request processed in 965us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395155.843748:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23598 00000100:00080000:2.0:1789395155.844301:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395155.866362:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395155.868504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231775872 00000100:00100000:0.0:1789395155.868524:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231775872 00000100:00100000:0.0:1789395155.868622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23599 00000100:00100000:0.0:1789395155.868635:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:19219:x1876316231775872:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395155.868664:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395155.868695:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316ba37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021061fc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.868797:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ba3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.868814:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ba3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.868828:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ba3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395155.868905:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:0.0:1789395155.868909:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395155.868934:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ba3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.868965:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316ba37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061fc expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.868983:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ba3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061fc expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.868993:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395155.868996:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789395155.869000:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aac00, rc 0) 00000100:00100000:0.0:1789395155.869274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:19219:x1876316231775872:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 641us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395155.869283:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23599 00000100:00100000:0.0:1789395155.877869:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395155.877967:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231776000 00000100:00100000:1.0:1789395155.877980:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231776000 00000100:00100000:1.0:1789395155.878056:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23600 00000100:00100000:1.0:1789395155.878078:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:19219:x1876316231776000:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395155.878107:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395155.878135:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106203 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878220:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878237:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878250:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878265:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878272:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878283:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878372:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ba5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878380:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878427:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395155.878475:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152a:0x0]: returning size 4096 00000004:00200000:1.0:1789395155.878479:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395155.878505:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878519:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878526:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878533:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878541:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878548:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395155.878553:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878563:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878579:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395155.878582:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395155.878588:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878594:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316ba4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878611:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878618:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878623:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878628:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395155.878632:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878637:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878644:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff89a4cbd92100) 00010000:00010000:1.0:1789395155.878647:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395155.878649:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878659:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316ba53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878694:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316ba45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106203 expref: 12 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878708:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1600/0xff35729af316ba5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106203 expref: 11 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395155.878716:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395155.878718:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789395155.878720:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1600, rc 0) 00000100:00100000:1.0:1789395155.878806:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:19219:x1876316231776000:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 739us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395155.878815:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23600 00000100:00100000:2.0:1789395155.883270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395155.885227:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231776256 00000100:00100000:3.0:1789395155.885259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231776256 00000100:00100000:3.0:1789395155.885341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23601 00000100:00100000:3.0:1789395155.885353:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:19219:x1876316231776256:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395155.885399:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395155.885428:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316ba61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210620a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.885569:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.885588:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.885600:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.885618:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.885625:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.885631:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395155.886172:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ce:0x0], index 1: 0 00000040:00080000:3.0:1789395155.886345:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789395155.886557:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00010000:00010000:3.0:1789395155.886839:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316ba76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.886855:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316ba76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.886866:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316ba76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395155.886945:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983573 00010000:00010000:3.0:1789395155.886988:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.886997:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887004:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887012:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887018:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395155.887024:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887033:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887048:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395155.887052:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395155.887058:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887066:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316ba68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395155.887081:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e747981 reply state 000000007d9c177f transno 4294983574 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887100:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887107:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b93e778 (ffff89a3c90d5a00) 00010000:00010000:3.0:1789395155.887109:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395155.887113:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395155.887155:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316ba61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210620a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887173:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316ba76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210620a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.887181:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff89a3c90d5800) 00010000:00010000:3.0:1789395155.887184:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395155.887186:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23ae00, rc 0) 00000100:00100000:3.0:1789395155.887292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:19219:x1876316231776256:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1940us (4036us total) trans 4294983574 rc 0/0 00000100:00100000:3.0:1789395155.887301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23601 00000020:00080000:3.0:1789395155.887308:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395155.901718:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395155.901966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231776512 00000100:00100000:1.0:1789395155.901980:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231776512 00000100:00100000:1.0:1789395155.902063:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5098 00000100:00100000:1.0:1789395155.902076:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:19219:x1876316231776512:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395155.902483:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983575 00000100:00100000:1.0:1789395155.902636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:19219:x1876316231776512:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 560us (930us total) trans 4294983576 rc 0/0 00000100:00100000:1.0:1789395155.902647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5098 00000020:00080000:1.0:1789395155.902653:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395155.915925:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395155.916020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231776768 00000100:00100000:0.0:1789395155.916033:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231776768 00000100:00100000:0.0:1789395155.916112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23602 00000100:00100000:0.0:1789395155.916123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:19219:x1876316231776768:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395155.916157:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395155.916185:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ba84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106211 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.916324:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.916344:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.916358:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.916376:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.916406:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.916416:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395155.916988:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ce:0x0], index 0: 0 00010000:00010000:0.0:1789395155.917192:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316ba99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917205:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316ba99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917213:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316ba99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395155.917281:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983577 00010000:00010000:0.0:1789395155.917322:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917330:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917337:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917344:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917351:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395155.917356:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917364:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917379:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395155.917382:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395155.917542:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917550:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316ba8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395155.917567:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c77ecd98 reply state 00000000221f2cd1 transno 4294983578 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917585:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917591:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x53a9537d (ffff89a4c875d100) 00010000:00010000:0.0:1789395155.917594:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395155.917596:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395155.917650:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316ba84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106211 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917666:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316ba99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106211 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395155.917673:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff89a4c875d000) 00010000:00010000:0.0:1789395155.917675:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395155.917677:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aba00, rc 0) 00000100:00100000:0.0:1789395155.917850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:19219:x1876316231776768:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1727us (1936us total) trans 4294983578 rc 0/0 00000100:00100000:0.0:1789395155.917859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23602 00000020:00080000:0.0:1789395155.917866:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395155.924666:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395155.924761:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231777024 00000100:00100000:0.0:1789395155.924774:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231777024 00000100:00100000:0.0:1789395155.924852:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5099 00000100:00100000:0.0:1789395155.924865:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:19219:x1876316231777024:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395155.925226:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983579 00000100:00100000:0.0:1789395155.925580:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:19219:x1876316231777024:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 715us (928us total) trans 4294983580 rc 0/0 00000100:00100000:0.0:1789395155.925594:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5099 00000020:00080000:0.0:1789395155.925600:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395155.933934:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395155.935478:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231777280 00000100:00100000:3.0:1789395155.935496:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231777280 00000100:00100000:3.0:1789395155.935571:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23603 00000100:00100000:3.0:1789395155.935582:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:19219:x1876316231777280:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395155.935621:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395155.935649:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316baa7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106218 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.935797:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.935816:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.935831:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.935847:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.935854:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395155.935861:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395155.936982:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cf:0x0], index 1: 0 00010000:00010000:2.0:1789395155.937188:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316babc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937204:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316babc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937215:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316babc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395155.937271:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983581 00010000:00010000:2.0:1789395155.937305:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937313:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937320:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937327:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937334:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395155.937339:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937347:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937360:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395155.937363:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395155.937368:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937374:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316baae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395155.937428:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fe29aff reply state 000000004a5762f2 transno 4294983582 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937441:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937448:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x756ed0d2 (ffff89a3c90d5c00) 00010000:00010000:2.0:1789395155.937450:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395155.937454:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395155.937490:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316baa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106218 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937506:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316babc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106218 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.937519:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:2.0:1789395155.937522:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395155.937524:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc400, rc 0) 00000100:00100000:2.0:1789395155.937646:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:19219:x1876316231777280:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2065us (3726us total) trans 4294983582 rc 0/0 00000100:00100000:2.0:1789395155.937654:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23603 00000020:00080000:2.0:1789395155.937660:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395155.955469:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395155.955616:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231777536 00000100:00100000:1.0:1789395155.955629:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231777536 00000100:00100000:1.0:1789395155.955710:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5100 00000100:00100000:1.0:1789395155.955721:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:19219:x1876316231777536:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395155.956085:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983583 00000100:00100000:1.0:1789395155.956201:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:19219:x1876316231777536:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 481us (746us total) trans 4294983584 rc 0/0 00000100:00100000:1.0:1789395155.956210:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5100 00000020:00080000:1.0:1789395155.956216:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395155.970012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395155.970856:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231777792 00000100:00100000:2.0:1789395155.970870:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231777792 00000100:00100000:2.0:1789395155.970947:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23604 00000100:00100000:2.0:1789395155.970959:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:19219:x1876316231777792:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395155.970991:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395155.971022:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316baca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210621f expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971176:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971195:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971211:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971227:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971238:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971255:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395155.971689:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cf:0x0], index 0: 0 00010000:00010000:2.0:1789395155.971906:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316badf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971917:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316badf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.971924:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316badf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395155.971985:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983585 00010000:00010000:2.0:1789395155.972025:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972034:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972040:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972048:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972054:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395155.972059:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972069:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972083:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395155.972087:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395155.972092:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972099:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bad1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395155.972112:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c365b7b reply state 00000000ba76ff6d transno 4294983586 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972123:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972129:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd3ce983f (ffff89a4f3d38800) 00010000:00010000:2.0:1789395155.972131:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395155.972134:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395155.972170:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316baca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210621f expref: 33 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972185:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316badf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210621f expref: 32 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395155.972193:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff89a4f3d38400) 00010000:00010000:2.0:1789395155.972195:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395155.972198:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd800, rc 0) 00000100:00100000:2.0:1789395155.972288:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:19219:x1876316231777792:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1331us (2289us total) trans 4294983586 rc 0/0 00000100:00100000:2.0:1789395155.972297:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23604 00000020:00080000:2.0:1789395155.972304:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395155.990112:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395155.990558:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231778048 00000100:00100000:3.0:1789395155.990572:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231778048 00000100:00100000:3.0:1789395155.990636:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5101 00000100:00100000:3.0:1789395155.990648:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+33:19219:x1876316231778048:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395155.991058:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983587 00000100:00100000:3.0:1789395155.991179:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+35:19219:x1876316231778048:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 531us (1081us total) trans 4294983588 rc 0/0 00000100:00100000:3.0:1789395155.991189:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5101 00000020:00080000:3.0:1789395155.991194:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395155.999226:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395155.999763:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231778304 00000100:00100000:1.0:1789395155.999917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231778304 00000100:00100000:1.0:1789395156.002736:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23605 00000100:00100000:1.0:1789395156.002760:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+35:19219:x1876316231778304:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.002919:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.003044:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316baed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106226 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.003376:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.003415:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.003429:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.003447:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.003455:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.003462:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.004548:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d0:0x0], index 1: 0 00010000:00010000:1.0:1789395156.005115:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316bb02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.005134:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316bb02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.005146:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316bb02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.006086:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983589 00010000:00010000:1.0:1789395156.006154:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006179:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006186:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006195:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006202:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.006494:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006508:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006528:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.006531:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.006538:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006546:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316baf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.006564:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee373540 reply state 00000000650d5fdb transno 4294983590 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006578:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006584:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdb9e9594 (ffff89a4cbd92100) 00010000:00010000:1.0:1789395156.006587:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.006590:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.006644:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316baed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106226 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006725:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316bb02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106226 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.006735:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff89a4cbd92300) 00010000:00010000:1.0:1789395156.006737:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.006740:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1000, rc 0) 00000100:00100000:1.0:1789395156.007068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:19219:x1876316231778304:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4315us (7853us total) trans 4294983590 rc 0/0 00000100:00100000:1.0:1789395156.007079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23605 00000020:00080000:1.0:1789395156.007087:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.013786:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.013873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231778560 00000100:00100000:2.0:1789395156.013887:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231778560 00000100:00100000:2.0:1789395156.013958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5102 00000100:00100000:2.0:1789395156.013970:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:19219:x1876316231778560:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.014484:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983591 00000100:00100000:2.0:1789395156.014609:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:19219:x1876316231778560:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 639us (847us total) trans 4294983592 rc 0/0 00000100:00100000:2.0:1789395156.015042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5102 00000020:00080000:2.0:1789395156.015050:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.018527:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.018623:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231778816 00000100:00100000:2.0:1789395156.018635:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231778816 00000100:00100000:2.0:1789395156.018704:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23606 00000100:00100000:2.0:1789395156.018718:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+41:19219:x1876316231778816:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.018749:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.018788:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210622d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.018933:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.018952:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.018966:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.018983:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.018990:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.018997:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.021606:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d0:0x0], index 0: 0 00010000:00010000:2.0:1789395156.021897:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316bb25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.021917:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316bb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.021930:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316bb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.022020:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983593 00010000:00010000:2.0:1789395156.022065:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022074:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022082:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022089:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022100:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.022106:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022114:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022130:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.022132:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.022137:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022143:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.022759:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8cac434 reply state 000000007b5e8f84 transno 4294983594 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022789:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022796:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe663f479 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395156.022799:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.022803:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.022855:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210622d expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022870:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316bb25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210622d expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.022879:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff89a4f3d38300) 00010000:00010000:2.0:1789395156.022881:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.022883:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd000, rc 0) 00000100:00100000:2.0:1789395156.022985:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:19219:x1876316231778816:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4270us (4470us total) trans 4294983594 rc 0/0 00000100:00100000:2.0:1789395156.022995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23606 00000020:00080000:2.0:1789395156.023003:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.026734:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.026865:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231779072 00000100:00100000:3.0:1789395156.026879:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231779072 00000100:00100000:3.0:1789395156.026982:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5103 00000100:00100000:3.0:1789395156.026995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+45:19219:x1876316231779072:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395156.027360:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983595 00000100:00100000:3.0:1789395156.027516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:19219:x1876316231779072:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 523us (796us total) trans 4294983596 rc 0/0 00000100:00100000:3.0:1789395156.027524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5103 00000020:00080000:3.0:1789395156.027530:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.035285:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.035470:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231779328 00000100:00100000:3.0:1789395156.035483:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231779328 00000100:00100000:3.0:1789395156.035550:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23607 00000100:00100000:3.0:1789395156.035562:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:19219:x1876316231779328:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.035594:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.035622:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316bb33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106234 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.035762:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.035792:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.035807:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.035829:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.035837:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.035843:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.036466:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d1:0x0], index 1: 0 00010000:00010000:2.0:1789395156.036814:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.036828:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.036838:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.037337:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983597 00010000:00010000:2.0:1789395156.037413:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037423:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037431:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037438:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037449:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.037454:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037463:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037478:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.037481:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.037487:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037494:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316bb3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.037512:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd6a510a reply state 00000000fc07ce86 transno 4294983598 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037523:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037530:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf8b3f1ce (ffff89a3c90d5b00) 00010000:00010000:2.0:1789395156.037532:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.037535:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.037579:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316bb33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106234 expref: 51 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037596:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106234 expref: 50 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.037611:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff89a4f3d38700) 00010000:00010000:2.0:1789395156.037613:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.037616:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cde00, rc 0) 00000100:00100000:2.0:1789395156.037709:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+51:19219:x1876316231779328:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2149us (2439us total) trans 4294983598 rc 0/0 00000100:00100000:2.0:1789395156.037724:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23607 00000020:00080000:2.0:1789395156.037740:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.041174:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.041231:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231779584 00000100:00100000:2.0:1789395156.041253:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231779584 00000100:00100000:2.0:1789395156.041322:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5104 00000100:00100000:2.0:1789395156.041334:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+51:19219:x1876316231779584:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.041715:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983599 00000100:00100000:2.0:1789395156.041848:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+53:19219:x1876316231779584:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 514us (685us total) trans 4294983600 rc 0/0 00000100:00100000:2.0:1789395156.041856:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5104 00000020:00080000:2.0:1789395156.041862:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.045339:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.045428:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231779840 00000100:00100000:1.0:1789395156.045441:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231779840 00000100:00100000:1.0:1789395156.045515:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23608 00000100:00100000:1.0:1789395156.045529:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+53:19219:x1876316231779840:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.045557:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.045584:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bb56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210623b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.045724:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.045742:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.045757:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.045774:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.045792:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.045798:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.046206:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d1:0x0], index 0: 0 00010000:00010000:1.0:1789395156.046456:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316bb6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046466:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316bb6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046475:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316bb6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.046538:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983601 00010000:00010000:1.0:1789395156.046579:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046587:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046594:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046602:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046608:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.046614:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046623:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046637:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.046640:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.046646:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046652:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bb5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.046672:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d57c12a0 reply state 000000008dacad04 transno 4294983602 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046684:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046690:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d12be7b (ffff89a4cbd92800) 00010000:00010000:1.0:1789395156.046692:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.046695:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.046728:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bb56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210623b expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046743:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316bb6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210623b expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.046751:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:1.0:1789395156.046754:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.046756:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0400, rc 0) 00000100:00100000:1.0:1789395156.046851:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+57:19219:x1876316231779840:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1325us (1526us total) trans 4294983602 rc 0/0 00000100:00100000:1.0:1789395156.046858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23608 00000020:00080000:1.0:1789395156.046865:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.052827:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.052901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231780096 00000100:00100000:3.0:1789395156.052915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231780096 00000100:00100000:3.0:1789395156.053053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5105 00000100:00100000:3.0:1789395156.053066:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+57:19219:x1876316231780096:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395156.053494:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983603 00000100:00100000:3.0:1789395156.053621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:19219:x1876316231780096:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 558us (809us total) trans 4294983604 rc 0/0 00000100:00100000:3.0:1789395156.053630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5105 00000020:00080000:3.0:1789395156.053636:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.057909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.058042:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231780352 00000100:00100000:2.0:1789395156.058057:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231780352 00000100:00100000:2.0:1789395156.058140:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23609 00000100:00100000:2.0:1789395156.058152:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:19219:x1876316231780352:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.058410:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.058440:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106242 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.058583:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.058601:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.058615:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.058631:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.058639:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.058645:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.059314:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d2:0x0], index 1: 0 00010000:00010000:0.0:1789395156.059830:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316bb8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.059859:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316bb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.059871:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316bb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.059946:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983605 00010000:00010000:0.0:1789395156.060132:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060141:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060147:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060155:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060162:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.060168:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060177:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060191:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.060194:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.060199:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060206:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bb80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.060236:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ede5d2a6 reply state 00000000e2df8695 transno 4294983606 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060257:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060264:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6e2bbd0 (ffff89a4f3d38e00) 00010000:00010000:0.0:1789395156.060267:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.060270:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.060314:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bb79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106242 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060331:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316bb8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106242 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.060340:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff89a4c875d600) 00010000:00010000:0.0:1789395156.060342:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.060345:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa000, rc 0) 00000100:00100000:3.0:1789395156.060506:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876316239733760:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789395156.060588:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395156.060731:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca480c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395156.061341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:19219:x1876316231780352:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3188us (3445us total) trans 4294983606 rc 0/0 00000100:00100000:0.0:1789395156.061352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23609 00000020:00080000:0.0:1789395156.061360:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.062495:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733760 00000100:00100000:1.0:1789395156.062511:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733760 00000100:00100000:1.0:1789395156.062599:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239 00000100:00100000:1.0:1789395156.062612:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:10002:x1876316239733760:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789395156.062667:0:14655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2530 00000100:00080000:3.0:1789395156.064639:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395156.066117:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:10002:x1876316239733760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3501us (5521us total) trans 4294969899 rc 0/0 00000100:00100000:1.0:1789395156.066134:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239 00000100:00100000:0.0:1789395156.066819:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.066853:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876316239733760:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789395156.066876:0:10002:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9d2:0x0]-[0x2c0000401:0xa01:0x0] 00000100:00100000:2.0:1789395156.066890:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231780608 00000100:00100000:2.0:1789395156.066900:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231780608 00000100:00100000:2.0:1789395156.066962:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5106 00000100:00100000:2.0:1789395156.066985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:19219:x1876316231780608:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.068227:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983607 00000100:00100000:2.0:1789395156.068405:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+65:19219:x1876316231780608:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1415us (1571us total) trans 4294983608 rc 0/0 00000100:00100000:2.0:1789395156.068417:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5106 00000020:00080000:2.0:1789395156.068425:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.074711:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.074799:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231780864 00000100:00100000:0.0:1789395156.074812:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231780864 00000100:00100000:0.0:1789395156.074887:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23610 00000100:00100000:0.0:1789395156.074901:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+65:19219:x1876316231780864:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.074932:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.074960:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bb9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106249 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075104:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075123:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075136:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075162:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075171:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075177:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.075662:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d2:0x0], index 0: 0 00010000:00010000:0.0:1789395156.075872:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316bbb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075884:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316bbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.075894:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316bbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395156.077679:0:8904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca143480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1876316239733888:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789395156.077793:0:8904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395156.077878:0:8904:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca33a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395156.077982:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239733888 00000100:00100000:2.0:1789395156.077994:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239733888 00000100:00080000:3.0:1789395156.078057:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395156.078082:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240 00000100:00100000:2.0:1789395156.078095:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:8904:x1876316239733888:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789395156.078161:0:14652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2530 00000100:00100000:2.0:1789395156.079651:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:8904:x1876316239733888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1553us (1852us total) trans 4294969900 rc 0/0 00000100:00100000:2.0:1789395156.079663:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240 00000001:00080000:0.0:1789395156.080021:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983609 00010000:00010000:0.0:1789395156.080106:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080119:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080126:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080135:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080142:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.080147:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080318:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080338:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.080342:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.080347:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080355:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bba3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.080372:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c21ced20 reply state 00000000b12752d4 transno 4294983610 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080440:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080450:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x40eea295 (ffff89a4c875de00) 00010000:00010000:0.0:1789395156.080452:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.080455:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.080507:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bb9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106249 expref: 69 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080524:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316bbb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106249 expref: 68 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.080532:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff89a4c875dc00) 00010000:00010000:0.0:1789395156.080535:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.080537:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab800, rc 0) 00000100:00100000:0.0:1789395156.080636:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+69:19219:x1876316231780864:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 5738us (5939us total) trans 4294983610 rc 0/0 00000100:00100000:0.0:1789395156.080644:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23610 00000020:00080000:0.0:1789395156.080648:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.085165:0:8904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca143480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1876316239733888:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789395156.085193:0:8904:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9d2:0x0]-[0x280000401:0xa01:0x0] 00000100:00100000:0.0:1789395156.088401:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.093875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231781120 00000100:00100000:3.0:1789395156.093898:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231781120 00000100:00100000:2.0:1789395156.094218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5107 00000100:00100000:2.0:1789395156.094232:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+69:19219:x1876316231781120:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.094630:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983611 00000100:00100000:2.0:1789395156.094767:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+71:19219:x1876316231781120:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 537us (6477us total) trans 4294983612 rc 0/0 00000100:00100000:2.0:1789395156.094786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5107 00000020:00080000:2.0:1789395156.094792:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.098506:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.098616:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231781376 00000100:00100000:0.0:1789395156.098629:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231781376 00000100:00100000:0.0:1789395156.098703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23611 00000100:00100000:0.0:1789395156.098715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+71:19219:x1876316231781376:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.098747:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.098795:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bbbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106250 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.098933:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.098952:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.098966:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.098983:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.098991:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.098998:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.099914:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d3:0x0], index 1: 0 00010000:00010000:0.0:1789395156.100145:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316bbd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.100159:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316bbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.100169:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316bbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.100243:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983613 00010000:00010000:0.0:1789395156.100284:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.100293:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.100299:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101787:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101797:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.101802:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101813:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101833:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.101836:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.101843:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101851:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.101878:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001200c486 reply state 00000000370035a4 transno 4294983614 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101893:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101902:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea16437d (ffff89a4c875d900) 00010000:00010000:0.0:1789395156.101904:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.101908:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.101972:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bbbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106250 expref: 75 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.101992:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316bbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106250 expref: 74 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.102001:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff89a4c875df00) 00010000:00010000:0.0:1789395156.102004:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.102006:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2abe00, rc 0) 00000100:00100000:0.0:1789395156.102104:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:19219:x1876316231781376:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3390us (3611us total) trans 4294983614 rc 0/0 00000100:00100000:0.0:1789395156.102115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23611 00000020:00080000:0.0:1789395156.102122:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.117378:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.117491:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231781632 00000100:00100000:3.0:1789395156.117506:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231781632 00000100:00100000:0.0:1789395156.117748:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5108 00000100:00100000:0.0:1789395156.117762:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:19219:x1876316231781632:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.118141:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983615 00000100:00100000:0.0:1789395156.118509:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+77:19219:x1876316231781632:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 747us (1142us total) trans 4294983616 rc 0/0 00000100:00100000:0.0:1789395156.118519:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5108 00000020:00080000:0.0:1789395156.118526:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.124799:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.125005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231781888 00000100:00100000:0.0:1789395156.125019:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231781888 00000100:00100000:0.0:1789395156.125105:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23612 00000100:00100000:0.0:1789395156.125119:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+77:19219:x1876316231781888:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.125150:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.125176:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bbe2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106257 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.125314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.125331:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.125343:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.125362:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.125369:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.125376:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.126151:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d3:0x0], index 0: 0 00010000:00010000:2.0:1789395156.126351:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316bbf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126364:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126374:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.126460:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983617 00010000:00010000:2.0:1789395156.126501:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126510:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126521:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126528:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126535:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.126540:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126549:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126562:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.126565:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.126570:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126577:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bbe9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.126593:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e175cd5b reply state 000000004406103b transno 4294983618 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126605:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126612:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9897527d (ffff89a4c875d400) 00010000:00010000:2.0:1789395156.126615:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.126618:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.126655:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bbe2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106257 expref: 81 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126672:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316bbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106257 expref: 80 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.126680:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:2.0:1789395156.126683:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.126686:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cca00, rc 0) 00000100:00100000:2.0:1789395156.126840:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+81:19219:x1876316231781888:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1723us (2063us total) trans 4294983618 rc 0/0 00000100:00100000:2.0:1789395156.126849:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23612 00000020:00080000:2.0:1789395156.126855:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.135577:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.135744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231782144 00000100:00100000:2.0:1789395156.135759:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231782144 00000100:00100000:2.0:1789395156.135905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5109 00000100:00100000:2.0:1789395156.135917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+81:19219:x1876316231782144:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.136301:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983619 00000100:00100000:2.0:1789395156.136460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+83:19219:x1876316231782144:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 544us (898us total) trans 4294983620 rc 0/0 00000100:00100000:2.0:1789395156.136469:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5109 00000020:00080000:2.0:1789395156.136475:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.144720:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.144809:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231782400 00000100:00100000:0.0:1789395156.144824:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231782400 00000100:00100000:0.0:1789395156.144901:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23613 00000100:00100000:0.0:1789395156.144913:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+83:19219:x1876316231782400:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.144946:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.144986:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bc05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210625e expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.145133:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.145328:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.145345:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.145363:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.145370:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.145376:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.146501:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d4:0x0], index 1: 0 00010000:00010000:1.0:1789395156.146745:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316bc1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146763:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146785:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.146861:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983621 00010000:00010000:1.0:1789395156.146904:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146912:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146918:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146925:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146932:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.146936:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.146944:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.147362:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.147366:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.147372:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.147380:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bc0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.147540:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a7a0cd8 reply state 0000000068424ce3 transno 4294983622 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.147553:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.147559:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe423257d (ffff89a4c875d300) 00010000:00010000:1.0:1789395156.147562:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.147565:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.147615:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bc05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210625e expref: 87 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.147631:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316bc1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210625e expref: 86 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.147646:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff89a3ca363c00) 00010000:00010000:1.0:1789395156.147648:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.147651:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:1.0:1789395156.147892:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+87:19219:x1876316231782400:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2979us (3184us total) trans 4294983622 rc 0/0 00000100:00100000:1.0:1789395156.147901:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23613 00000020:00080000:1.0:1789395156.147909:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.151852:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.152019:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231782656 00000100:00100000:0.0:1789395156.152032:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231782656 00000100:00100000:0.0:1789395156.152112:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5110 00000100:00100000:0.0:1789395156.152124:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+87:19219:x1876316231782656:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.153582:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983623 00000100:00100000:1.0:1789395156.153787:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+89:19219:x1876316231782656:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1650us (1934us total) trans 4294983624 rc 0/0 00000100:00100000:1.0:1789395156.153800:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5110 00000020:00080000:1.0:1789395156.153808:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.159665:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.159802:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231782912 00000100:00100000:1.0:1789395156.159816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231782912 00000100:00100000:1.0:1789395156.160008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23614 00000100:00100000:1.0:1789395156.160022:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+89:19219:x1876316231782912:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.160057:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.160086:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bc28 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106265 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.160239:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.160268:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.160287:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.160304:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.160311:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.160319:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.160809:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d4:0x0], index 0: 0 00010000:00010000:1.0:1789395156.161025:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316bc3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161036:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316bc3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161044:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316bc3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.161109:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983625 00010000:00010000:1.0:1789395156.161151:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161159:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161166:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161177:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161184:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.161189:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161198:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161212:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.161215:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.161221:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161228:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.161246:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000628f2784 reply state 0000000053c522a2 transno 4294983626 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161259:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161265:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x970cb47d (ffff89a3ca363200) 00010000:00010000:1.0:1789395156.161267:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.161270:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.161305:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bc28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106265 expref: 93 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161327:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316bc3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106265 expref: 92 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.161335:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff89a3ca363500) 00010000:00010000:1.0:1789395156.161337:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.161340:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:1.0:1789395156.161849:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+93:19219:x1876316231782912:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1826us (2195us total) trans 4294983626 rc 0/0 00000100:00100000:1.0:1789395156.161858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23614 00000020:00080000:1.0:1789395156.161866:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.166114:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.166337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231783168 00000100:00100000:1.0:1789395156.166351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231783168 00000100:00100000:1.0:1789395156.166566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5111 00000100:00100000:1.0:1789395156.166578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+93:19219:x1876316231783168:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.166937:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983627 00000100:00100000:1.0:1789395156.167179:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+95:19219:x1876316231783168:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 602us (1079us total) trans 4294983628 rc 0/0 00000100:00100000:1.0:1789395156.167188:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5111 00000020:00080000:1.0:1789395156.167195:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.171549:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.171632:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231783424 00000100:00100000:2.0:1789395156.171646:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231783424 00000100:00100000:2.0:1789395156.171723:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23615 00000100:00100000:2.0:1789395156.171735:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+95:19219:x1876316231783424:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.171770:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.171811:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bc4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210626c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.171961:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.171979:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.171993:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172010:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172018:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172024:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.172501:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d5:0x0], index 1: 0 00010000:00010000:2.0:1789395156.172705:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316bc60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172717:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316bc60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172725:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316bc60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.172807:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983629 00010000:00010000:2.0:1789395156.172849:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172857:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172865:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172873:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172880:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.172885:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172893:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172908:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.172911:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.172916:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172924:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bc52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.172940:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002fef24f reply state 00000000bdf7f676 transno 4294983630 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172956:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.172963:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5239df7d (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395156.172965:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.172968:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.173003:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bc4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210626c expref: 99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.173018:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316bc60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210626c expref: 98 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.173025:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:2.0:1789395156.173027:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.173029:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3ccc00, rc 0) 00000100:00100000:2.0:1789395156.173620:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+99:19219:x1876316231783424:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1883us (2081us total) trans 4294983630 rc 0/0 00000100:00100000:2.0:1789395156.173631:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23615 00000020:00080000:2.0:1789395156.173639:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.178501:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.178605:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231783680 00000100:00100000:3.0:1789395156.178618:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231783680 00000100:00100000:3.0:1789395156.178683:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5112 00000100:00100000:3.0:1789395156.178696:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+99:19219:x1876316231783680:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395156.179061:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983631 00000100:00100000:3.0:1789395156.179198:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+101:19219:x1876316231783680:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 504us (710us total) trans 4294983632 rc 0/0 00000100:00100000:3.0:1789395156.179207:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5112 00000020:00080000:3.0:1789395156.179213:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.183274:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.183372:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231783936 00000100:00100000:1.0:1789395156.183420:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231783936 00000100:00100000:1.0:1789395156.183502:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23616 00000100:00100000:1.0:1789395156.183514:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+101:19219:x1876316231783936:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.183551:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.183581:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bc6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106273 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.183721:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.183739:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.183753:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.183771:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.183789:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.183797:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.184225:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d5:0x0], index 0: 0 00010000:00010000:1.0:1789395156.184471:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316bc83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184482:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184490:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.184568:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983633 00010000:00010000:1.0:1789395156.184609:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184618:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184624:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184632:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184638:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.184644:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184652:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184667:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.184670:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.184675:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184682:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bc75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.184701:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b5d5b11 reply state 00000000949e596f transno 4294983634 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184718:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184725:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa5436e7d (ffff89a3ca363900) 00010000:00010000:1.0:1789395156.184728:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.184731:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.184769:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bc6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106273 expref: 105 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184798:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106273 expref: 104 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.184805:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff89a3ca363b00) 00010000:00010000:1.0:1789395156.184808:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.184810:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0200, rc 0) 00000100:00100000:1.0:1789395156.185886:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+105:19219:x1876316231783936:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2364us (2615us total) trans 4294983634 rc 0/0 00000100:00100000:1.0:1789395156.185898:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23616 00000020:00080000:1.0:1789395156.185907:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.191229:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.191536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231784192 00000100:00100000:2.0:1789395156.191550:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231784192 00000100:00100000:2.0:1789395156.191669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5113 00000100:00100000:2.0:1789395156.191683:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+105:19219:x1876316231784192:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.192053:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983635 00000100:00100000:2.0:1789395156.192191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+107:19219:x1876316231784192:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 510us (1043us total) trans 4294983636 rc 0/0 00000100:00100000:2.0:1789395156.192204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5113 00000020:00080000:2.0:1789395156.192209:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.196769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.196879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231784448 00000100:00100000:1.0:1789395156.196893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231784448 00000100:00100000:1.0:1789395156.196965:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23617 00000100:00100000:1.0:1789395156.196976:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+107:19219:x1876316231784448:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.197007:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.197037:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bc91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210627a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.197203:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.197222:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.197236:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.197265:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.197271:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.197279:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.197792:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d6:0x0], index 1: 0 00010000:00010000:1.0:1789395156.198007:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316bca6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198019:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316bca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198029:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316bca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.198096:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983637 00010000:00010000:1.0:1789395156.198135:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198146:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198153:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198161:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198169:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.198174:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198183:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198198:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.198201:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.198207:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198214:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bc98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.198234:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fe4d483 reply state 000000003bc57aa9 transno 4294983638 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198247:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198253:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xead1417d (ffff89a3ca363600) 00010000:00010000:1.0:1789395156.198256:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.198259:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.198295:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bc91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210627a expref: 111 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198311:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316bca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210627a expref: 110 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.198318:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:1.0:1789395156.198320:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.198323:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1c00, rc 0) 00000100:00100000:1.0:1789395156.198461:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+111:19219:x1876316231784448:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1487us (1707us total) trans 4294983638 rc 0/0 00000100:00100000:1.0:1789395156.198471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23617 00000020:00080000:1.0:1789395156.198478:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.204067:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.204188:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231784704 00000100:00100000:2.0:1789395156.204201:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231784704 00000100:00100000:2.0:1789395156.204282:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5114 00000100:00100000:2.0:1789395156.204294:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+111:19219:x1876316231784704:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.204686:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983639 00000100:00100000:2.0:1789395156.204812:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+113:19219:x1876316231784704:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 520us (759us total) trans 4294983640 rc 0/0 00000100:00100000:2.0:1789395156.204822:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5114 00000020:00080000:2.0:1789395156.204828:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.209217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.209432:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231784960 00000100:00100000:0.0:1789395156.209446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231784960 00000100:00100000:0.0:1789395156.209519:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23618 00000100:00100000:0.0:1789395156.209531:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+113:19219:x1876316231784960:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.209564:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.209592:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcb4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106281 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.209737:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.209756:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.209771:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.209798:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.209806:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.209813:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.210796:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d6:0x0], index 0: 0 00010000:00010000:0.0:1789395156.211174:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bcc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211192:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211202:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.211611:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983641 00010000:00010000:0.0:1789395156.211659:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211668:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211676:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211683:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211690:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aa400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.211695:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211705:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211721:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.211724:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.211730:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211737:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bcbb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.211754:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e82f3075 reply state 0000000048f2d6f2 transno 4294983642 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211765:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211772:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d30507d (ffff89a4c875d500) 00010000:00010000:0.0:1789395156.211783:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.211787:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.211834:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcb4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106281 expref: 117 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211938:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106281 expref: 116 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.211947:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff89a4c875d800) 00010000:00010000:0.0:1789395156.211950:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.211953:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa200, rc 0) 00000100:00100000:0.0:1789395156.212092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+117:19219:x1876316231784960:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2562us (2888us total) trans 4294983642 rc 0/0 00000100:00100000:0.0:1789395156.212103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23618 00000020:00080000:0.0:1789395156.212111:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.217555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.217656:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231785216 00000100:00100000:2.0:1789395156.217669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231785216 00000100:00100000:2.0:1789395156.217785:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5115 00000100:00100000:2.0:1789395156.217798:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+117:19219:x1876316231785216:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.218526:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983643 00000100:00100000:2.0:1789395156.218709:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+119:19219:x1876316231785216:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 910us (1166us total) trans 4294983644 rc 0/0 00000100:00100000:2.0:1789395156.218719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5115 00000020:00080000:2.0:1789395156.218725:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.223228:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.223427:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231785472 00000100:00100000:2.0:1789395156.223438:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231785472 00000100:00100000:1.0:1789395156.223767:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23619 00000100:00100000:1.0:1789395156.223791:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+119:19219:x1876316231785472:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.223817:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.223839:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bcd7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106288 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.224019:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.224086:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.224100:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.224118:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.224126:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.224133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.224740:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d7:0x0], index 1: 0 00010000:00010000:0.0:1789395156.224997:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225008:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225016:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.225361:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983645 00010000:00010000:0.0:1789395156.225429:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225438:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225444:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225450:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225456:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.225461:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225468:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225483:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.225486:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.225491:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225497:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bcde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.225515:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4b4ae82 reply state 00000000f4384ca1 transno 4294983646 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225525:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225531:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa468b7d (ffff89a3ca363400) 00010000:00010000:0.0:1789395156.225534:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.225536:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.225570:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bcd7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106288 expref: 123 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225585:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106288 expref: 122 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.225593:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395156.225596:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.225598:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2ab400, rc 0) 00000100:00100000:0.0:1789395156.225728:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+123:19219:x1876316231785472:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1950us (2510us total) trans 4294983646 rc 0/0 00000100:00100000:0.0:1789395156.225736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23619 00000020:00080000:0.0:1789395156.225741:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.233095:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.238219:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231785728 00000100:00100000:3.0:1789395156.238235:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231785728 00000100:00100000:2.0:1789395156.244023:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5116 00000100:00100000:2.0:1789395156.244039:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+123:19219:x1876316231785728:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.244736:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983647 00000100:00100000:2.0:1789395156.244993:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+125:19219:x1876316231785728:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 954us (11905us total) trans 4294983648 rc 0/0 00000100:00100000:2.0:1789395156.245011:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5116 00000020:00080000:2.0:1789395156.245017:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.261203:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.261423:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231785984 00000100:00100000:3.0:1789395156.261434:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231785984 00000100:00100000:3.0:1789395156.261510:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23620 00000100:00100000:3.0:1789395156.261520:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+125:19219:x1876316231785984:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.261543:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.261563:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bcfa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210628f expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.261671:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.261687:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.261698:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.261713:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.261720:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.261725:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.262206:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d7:0x0], index 0: 0 00010000:00010000:2.0:1789395156.268654:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bd0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268677:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bd0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268689:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bd0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.268855:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983649 00010000:00010000:2.0:1789395156.268899:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268908:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268915:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268922:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268929:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.268933:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268940:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268956:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.268959:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.268964:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268970:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316bd01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.268985:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048a8fee2 reply state 0000000000c82cd8 transno 4294983650 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.268996:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.269001:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdf501a7d (ffff89a3c90d5200) 00010000:00010000:2.0:1789395156.269004:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.269007:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.269047:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bcfa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210628f expref: 129 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.269064:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bd0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210628f expref: 128 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.269071:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395156.269074:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.269076:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd200, rc 0) 00000100:00100000:2.0:1789395156.269663:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+129:19219:x1876316231785984:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 8140us (8465us total) trans 4294983650 rc 0/0 00000100:00100000:2.0:1789395156.269674:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23620 00000020:00080000:2.0:1789395156.269681:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.277697:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.281812:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231786240 00000100:00100000:2.0:1789395156.281838:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231786240 00000100:00100000:2.0:1789395156.281944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5117 00000100:00100000:2.0:1789395156.281958:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+129:19219:x1876316231786240:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.283017:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983651 00000100:00100000:2.0:1789395156.285097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+131:19219:x1876316231786240:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 3125us (7397us total) trans 4294983652 rc 0/0 00000100:00100000:2.0:1789395156.285114:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5117 00000020:00080000:2.0:1789395156.285124:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.306628:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.309179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231786496 00000100:00100000:0.0:1789395156.309203:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231786496 00000100:00100000:1.0:1789395156.309408:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23621 00000100:00100000:1.0:1789395156.309422:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+131:19219:x1876316231786496:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.309461:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.309491:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bd1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106296 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.309638:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.309658:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.309671:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.309688:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.309695:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.309702:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.310138:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d8:0x0], index 1: 0 00010000:00010000:1.0:1789395156.310348:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316bd32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310359:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316bd32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310366:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316bd32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.310459:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983653 00010000:00010000:1.0:1789395156.310508:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310516:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310523:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310531:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310538:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.310542:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310551:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310566:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.310569:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.310575:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310581:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316bd24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.310598:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ed72b61 reply state 0000000088debbb8 transno 4294983654 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310610:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310616:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b6840d2 (ffff89a3ca363f00) 00010000:00010000:1.0:1789395156.310618:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.310621:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.310658:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316bd1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106296 expref: 135 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310675:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316bd32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106296 expref: 134 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.310683:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:1.0:1789395156.310685:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.310688:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344400, rc 0) 00000100:00100000:1.0:1789395156.310802:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:19219:x1876316231786496:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1382us (4187us total) trans 4294983654 rc 0/0 00000100:00100000:1.0:1789395156.310811:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23621 00000020:00080000:1.0:1789395156.310819:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.315323:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.315530:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231786752 00000100:00100000:2.0:1789395156.315544:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231786752 00000100:00100000:2.0:1789395156.315659:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5118 00000100:00100000:2.0:1789395156.315674:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:19219:x1876316231786752:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.316065:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983655 00000100:00100000:2.0:1789395156.316418:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+137:19219:x1876316231786752:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 744us (1107us total) trans 4294983656 rc 0/0 00000100:00100000:2.0:1789395156.316428:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5118 00000020:00080000:2.0:1789395156.316435:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.321562:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.323499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231787008 00000100:00100000:0.0:1789395156.323519:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231787008 00000100:00100000:1.0:1789395156.323897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23622 00000100:00100000:1.0:1789395156.323911:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+137:19219:x1876316231787008:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.323944:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.324173:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316bd40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210629d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.324321:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.324339:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.324352:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.324368:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.324376:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.324382:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.324953:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d8:0x0], index 0: 0 00010000:00010000:1.0:1789395156.325268:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316bd55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325281:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316bd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325291:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316bd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.325354:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983657 00010000:00010000:1.0:1789395156.325516:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325526:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325533:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325542:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325549:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.325554:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325563:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325577:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.325580:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.325586:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325592:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bd47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.325613:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000644cb9c6 reply state 0000000028111546 transno 4294983658 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325624:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325631:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0674fd2 (ffff89a3ca363a00) 00010000:00010000:1.0:1789395156.325634:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.325637:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.325674:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316bd40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210629d expref: 141 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325691:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316bd55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210629d expref: 140 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.325700:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:1.0:1789395156.325702:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.325705:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535400, rc 0) 00000100:00100000:1.0:1789395156.326260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+141:19219:x1876316231787008:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2348us (4709us total) trans 4294983658 rc 0/0 00000100:00100000:1.0:1789395156.326270:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23622 00000020:00080000:1.0:1789395156.326278:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.331258:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.331449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231787264 00000100:00100000:2.0:1789395156.331463:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231787264 00000100:00100000:2.0:1789395156.331538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5119 00000100:00100000:2.0:1789395156.331551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+141:19219:x1876316231787264:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.331939:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983659 00000100:00100000:2.0:1789395156.332188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+143:19219:x1876316231787264:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 637us (951us total) trans 4294983660 rc 0/0 00000100:00100000:2.0:1789395156.332198:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5119 00000020:00080000:2.0:1789395156.332205:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.341547:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.341642:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231787520 00000100:00100000:3.0:1789395156.341657:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231787520 00000100:00100000:3.0:1789395156.341733:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23623 00000100:00100000:3.0:1789395156.341744:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+143:19219:x1876316231787520:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.341784:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.341812:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bd63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062a4 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.341972:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.341991:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342004:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342021:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342034:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342041:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.342515:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d9:0x0], index 1: 0 00010000:00010000:3.0:1789395156.342718:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316bd78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342730:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316bd78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342739:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316bd78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.342816:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983661 00010000:00010000:3.0:1789395156.342856:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342865:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342872:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342879:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342885:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.342890:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342899:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342914:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.342917:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.342923:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342930:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bd6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.342947:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000055d99d7 reply state 00000000ed74bbee transno 4294983662 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342959:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.342965:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x65f522d2 (ffff89a3c90d5f00) 00010000:00010000:3.0:1789395156.342967:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.342970:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.343004:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bd63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062a4 expref: 147 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.343021:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316bd78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062a4 expref: 146 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.343028:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:3.0:1789395156.343030:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.343032:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b200, rc 0) 00000100:00100000:3.0:1789395156.343128:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+147:19219:x1876316231787520:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1386us (1596us total) trans 4294983662 rc 0/0 00000100:00100000:3.0:1789395156.343137:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23623 00000020:00080000:3.0:1789395156.343143:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.348618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.349631:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231787776 00000100:00100000:2.0:1789395156.349647:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231787776 00000100:00100000:2.0:1789395156.349723:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5120 00000100:00100000:2.0:1789395156.349744:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+147:19219:x1876316231787776:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.350119:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983663 00000100:00100000:2.0:1789395156.350260:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+149:19219:x1876316231787776:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 518us (1655us total) trans 4294983664 rc 0/0 00000100:00100000:2.0:1789395156.350268:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5120 00000020:00080000:2.0:1789395156.350275:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.359529:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.359583:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231788032 00000100:00100000:2.0:1789395156.359597:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231788032 00000100:00100000:2.0:1789395156.359678:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23624 00000100:00100000:2.0:1789395156.359690:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+149:19219:x1876316231788032:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.359721:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.359761:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bd86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062ab expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.359915:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.359933:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.359946:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.359974:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.359985:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.359992:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.360650:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d9:0x0], index 0: 0 00010000:00010000:2.0:1789395156.361233:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316bd9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.361250:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316bd9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.361261:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316bd9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.361332:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983665 00010000:00010000:2.0:1789395156.361371:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.361378:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362555:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362571:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362577:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.362583:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362595:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362614:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.362617:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.362624:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362631:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bd8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.362650:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aeeecef reply state 0000000023a365b3 transno 4294983666 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362664:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.362671:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x38feb1d2 (ffff89a3ca366200) 00010000:00010000:2.0:1789395156.362674:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.362678:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.363357:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bd86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ab expref: 153 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.363382:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316bd9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ab expref: 152 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.363827:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff89a3ca366000) 00010000:00010000:2.0:1789395156.363830:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.363833:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cc600, rc 0) 00000100:00100000:2.0:1789395156.364018:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+153:19219:x1876316231788032:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4328us (4503us total) trans 4294983666 rc 0/0 00000100:00100000:2.0:1789395156.364029:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23624 00000020:00080000:2.0:1789395156.364039:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.377568:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.377865:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231788288 00000100:00100000:2.0:1789395156.377879:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231788288 00000100:00100000:2.0:1789395156.377958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5121 00000100:00100000:2.0:1789395156.377970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+153:19219:x1876316231788288:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.378356:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983667 00000100:00100000:2.0:1789395156.378524:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+155:19219:x1876316231788288:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 555us (969us total) trans 4294983668 rc 0/0 00000100:00100000:2.0:1789395156.378533:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5121 00000020:00080000:2.0:1789395156.378538:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.384971:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.385095:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231788544 00000100:00100000:0.0:1789395156.385109:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231788544 00000100:00100000:0.0:1789395156.385188:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23625 00000100:00100000:0.0:1789395156.385202:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+155:19219:x1876316231788544:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.385239:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.385271:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bda9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.385446:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.385461:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.385470:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.385481:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.385486:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.385490:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.385981:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9da:0x0], index 1: 0 00010000:00010000:0.0:1789395156.386175:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316bdbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386184:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316bdbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386190:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316bdbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.386309:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983669 00010000:00010000:0.0:1789395156.386355:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386362:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386369:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386376:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386382:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.386420:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386429:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386445:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.386448:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.386454:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386462:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316bdb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.386478:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002beaea1 reply state 000000009588a528 transno 4294983670 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386490:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386496:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7c0bdcd2 (ffff89a4c875dd00) 00010000:00010000:0.0:1789395156.386498:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.386501:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.386540:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316bda9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062b2 expref: 159 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386568:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316bdbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062b2 expref: 158 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.386576:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:0.0:1789395156.386578:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.386580:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:0.0:1789395156.386667:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+159:19219:x1876316231788544:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1469us (1714us total) trans 4294983670 rc 0/0 00000100:00100000:0.0:1789395156.386676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23625 00000020:00080000:0.0:1789395156.386682:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.392811:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.392974:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231788800 00000100:00100000:0.0:1789395156.392988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231788800 00000100:00100000:0.0:1789395156.393168:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5122 00000100:00100000:0.0:1789395156.393182:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+159:19219:x1876316231788800:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.393563:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983671 00000100:00100000:0.0:1789395156.393701:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+161:19219:x1876316231788800:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 521us (905us total) trans 4294983672 rc 0/0 00000100:00100000:0.0:1789395156.393712:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5122 00000020:00080000:0.0:1789395156.393720:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.397830:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.397952:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231789056 00000100:00100000:2.0:1789395156.397966:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231789056 00000100:00100000:2.0:1789395156.398043:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23626 00000100:00100000:2.0:1789395156.398055:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+161:19219:x1876316231789056:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.398087:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.398114:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bdcc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.398378:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.398495:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.398508:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.398544:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.398552:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.398559:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.399000:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9da:0x0], index 0: 0 00010000:00010000:2.0:1789395156.399201:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316bde1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399212:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316bde1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399221:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316bde1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.399509:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983673 00010000:00010000:2.0:1789395156.399557:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399567:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399574:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399582:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399594:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.399600:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399609:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399623:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.399626:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.399632:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399639:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bdd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.399655:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7875826 reply state 000000005bf76ad4 transno 4294983674 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399667:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399674:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x27156bd2 (ffff89a3ca366900) 00010000:00010000:2.0:1789395156.399677:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.399679:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.399716:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bdcc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062b9 expref: 165 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399812:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316bde1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062b9 expref: 164 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.399827:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff89a3ca366400) 00010000:00010000:2.0:1789395156.399829:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.399832:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395156.399978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+165:19219:x1876316231789056:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1924us (2162us total) trans 4294983674 rc 0/0 00000100:00100000:2.0:1789395156.399987:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23626 00000020:00080000:2.0:1789395156.399994:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.408136:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.408359:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231789312 00000100:00100000:2.0:1789395156.408372:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231789312 00000100:00100000:2.0:1789395156.408570:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5123 00000100:00100000:2.0:1789395156.408582:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+165:19219:x1876316231789312:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.408950:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983675 00000100:00100000:2.0:1789395156.409084:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+167:19219:x1876316231789312:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 502us (962us total) trans 4294983676 rc 0/0 00000100:00100000:2.0:1789395156.409094:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5123 00000020:00080000:2.0:1789395156.409101:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.413087:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.413203:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231789568 00000100:00100000:1.0:1789395156.413216:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231789568 00000100:00100000:1.0:1789395156.413299:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23627 00000100:00100000:1.0:1789395156.413311:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+167:19219:x1876316231789568:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.413343:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.413371:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bdef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062c0 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.413556:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.413576:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.413590:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.413609:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.413617:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.413622:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.414118:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9db:0x0], index 1: 0 00010000:00010000:1.0:1789395156.414326:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316be04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414343:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316be04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414351:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316be04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.414442:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983677 00010000:00010000:1.0:1789395156.414487:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414495:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414502:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414510:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414517:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.414522:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414532:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414547:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.414550:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.414555:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414567:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bdf6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.414585:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac5809e6 reply state 0000000085861057 transno 4294983678 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414598:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414605:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfd213ed2 (ffff89a3ca363e00) 00010000:00010000:1.0:1789395156.414608:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.414610:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.414648:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bdef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062c0 expref: 171 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414666:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316be04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062c0 expref: 170 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.414674:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff89a3ca363d00) 00010000:00010000:1.0:1789395156.414677:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.414680:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534a00, rc 0) 00000100:00100000:1.0:1789395156.414768:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+171:19219:x1876316231789568:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1458us (1697us total) trans 4294983678 rc 0/0 00000100:00100000:1.0:1789395156.414789:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23627 00000020:00080000:1.0:1789395156.414796:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.418878:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.418985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231789824 00000100:00100000:0.0:1789395156.419000:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231789824 00000100:00100000:0.0:1789395156.419069:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5124 00000100:00100000:0.0:1789395156.419081:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+171:19219:x1876316231789824:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.419504:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983679 00000100:00100000:0.0:1789395156.419624:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+173:19219:x1876316231789824:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 544us (762us total) trans 4294983680 rc 0/0 00000100:00100000:0.0:1789395156.419634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5124 00000020:00080000:0.0:1789395156.419640:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.424104:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.424309:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231790080 00000100:00100000:0.0:1789395156.424321:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231790080 00000100:00100000:0.0:1789395156.424512:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23628 00000100:00100000:0.0:1789395156.424525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+173:19219:x1876316231790080:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.424560:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.424589:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316be12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062c7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.425168:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.425186:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.425199:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.425218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.425225:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.425232:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.426002:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9db:0x0], index 0: 0 00010000:00010000:0.0:1789395156.426345:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316be27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426360:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316be27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426371:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316be27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.426579:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983681 00010000:00010000:0.0:1789395156.426620:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426629:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426635:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426643:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426655:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.426661:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426670:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426685:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.426689:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.426694:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426701:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316be19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.426719:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092fa7820 reply state 0000000050a1a7a6 transno 4294983682 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426732:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426738:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x81a24dd2 (ffff89a4d3f0bd00) 00010000:00010000:0.0:1789395156.426741:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.426744:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.426792:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316be12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062c7 expref: 177 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426809:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316be27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062c7 expref: 176 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.426824:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:0.0:1789395156.426826:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.426829:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:0.0:1789395156.427097:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+177:19219:x1876316231790080:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2573us (3006us total) trans 4294983682 rc 0/0 00000100:00100000:0.0:1789395156.427106:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23628 00000020:00080000:0.0:1789395156.427114:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.431762:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.431860:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231790336 00000100:00100000:0.0:1789395156.431875:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231790336 00000100:00100000:0.0:1789395156.431943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5125 00000100:00100000:0.0:1789395156.431955:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+177:19219:x1876316231790336:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.432299:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983683 00000100:00100000:0.0:1789395156.432447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+179:19219:x1876316231790336:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 492us (697us total) trans 4294983684 rc 0/0 00000100:00100000:0.0:1789395156.432456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5125 00000020:00080000:0.0:1789395156.432462:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.436507:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.436660:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231790592 00000100:00100000:2.0:1789395156.436673:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231790592 00000100:00100000:2.0:1789395156.436750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23629 00000100:00100000:2.0:1789395156.436762:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+179:19219:x1876316231790592:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.436803:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.436833:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316be35 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062ce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.436997:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.437017:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.437030:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.437046:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.437053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.437060:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.438014:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dc:0x0], index 1: 0 00010000:00010000:2.0:1789395156.439676:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316be4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.439705:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316be4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.439717:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316be4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.440360:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983685 00010000:00010000:2.0:1789395156.440978:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.440991:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441003:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441010:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441016:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.441022:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441030:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441048:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.441051:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.441057:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441064:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.441080:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6562cb0 reply state 0000000022a2e95b transno 4294983686 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441093:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441101:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6cc088d2 (ffff89a3ca366d00) 00010000:00010000:2.0:1789395156.441103:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.441107:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.441311:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316be35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ce expref: 183 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441332:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316be4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ce expref: 182 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.441340:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff89a3ca366500) 00010000:00010000:2.0:1789395156.441342:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.441345:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfe00, rc 0) 00000100:00100000:2.0:1789395156.441721:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+183:19219:x1876316231790592:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4959us (5224us total) trans 4294983686 rc 0/0 00000100:00100000:2.0:1789395156.441731:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23629 00000020:00080000:2.0:1789395156.441741:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.447226:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.447432:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231790848 00000100:00100000:1.0:1789395156.447446:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231790848 00000100:00100000:1.0:1789395156.447523:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5126 00000100:00100000:1.0:1789395156.447536:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+183:19219:x1876316231790848:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.447915:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983687 00000100:00100000:1.0:1789395156.448047:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+185:19219:x1876316231790848:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 511us (834us total) trans 4294983688 rc 0/0 00000100:00100000:1.0:1789395156.448055:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5126 00000020:00080000:1.0:1789395156.448061:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.452153:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.452424:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231791104 00000100:00100000:2.0:1789395156.452438:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231791104 00000100:00100000:2.0:1789395156.452513:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23630 00000100:00100000:2.0:1789395156.452524:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+185:19219:x1876316231791104:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.452557:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.452588:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316be58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062d5 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.452729:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.452749:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.452761:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.452792:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.452800:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.452807:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.453647:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dc:0x0], index 0: 0 00010000:00010000:2.0:1789395156.453897:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316be6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.453911:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316be6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.453920:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316be6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.453992:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983689 00010000:00010000:2.0:1789395156.454031:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454039:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454047:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454055:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454065:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.454070:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454079:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454094:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.454097:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.454103:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454110:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316be5f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.454127:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058197d03 reply state 000000007e275ff4 transno 4294983690 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454139:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454145:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe9ca17d2 (ffff89a3ca366b00) 00010000:00010000:2.0:1789395156.454148:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.454151:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.454203:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316be58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062d5 expref: 189 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454220:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316be6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062d5 expref: 188 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.454234:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff89a3ca366e00) 00010000:00010000:2.0:1789395156.454237:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.454610:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395156.454822:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+189:19219:x1876316231791104:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2296us (2681us total) trans 4294983690 rc 0/0 00000100:00100000:2.0:1789395156.454831:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23630 00000020:00080000:2.0:1789395156.454840:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.459331:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.459421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231791360 00000100:00100000:2.0:1789395156.459435:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231791360 00000100:00100000:2.0:1789395156.459511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5127 00000100:00100000:2.0:1789395156.459523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+189:19219:x1876316231791360:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395156.459883:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983691 00000100:00100000:2.0:1789395156.460561:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+191:19219:x1876316231791360:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1035us (1239us total) trans 4294983692 rc 0/0 00000100:00100000:2.0:1789395156.460572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5127 00000020:00080000:2.0:1789395156.460579:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.464632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.464831:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231791616 00000100:00100000:1.0:1789395156.464843:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231791616 00000100:00100000:1.0:1789395156.464998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23631 00000100:00100000:1.0:1789395156.465012:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+191:19219:x1876316231791616:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.465046:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.465075:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316be7b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.465345:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.465364:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.465378:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.465523:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.465530:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.465541:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.465982:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dd:0x0], index 1: 0 00010000:00010000:1.0:1789395156.466714:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316be90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466730:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316be90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466741:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316be90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.466843:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983693 00010000:00010000:1.0:1789395156.466910:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466919:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466927:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466936:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466941:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.466947:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466955:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.466975:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.466982:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.466989:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316be82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.467008:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7af0e35 reply state 00000000351df966 transno 4294983694 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.467020:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.467031:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa846083f (ffff89a3ca363700) 00010000:00010000:1.0:1789395156.467034:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.467037:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.467079:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316be7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062dc expref: 195 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.467095:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316be90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062dc expref: 194 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.467102:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:1.0:1789395156.467105:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.467107:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535e00, rc 0) 00000100:00100000:1.0:1789395156.467497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+195:19219:x1876316231791616:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2487us (2876us total) trans 4294983694 rc 0/0 00000100:00100000:1.0:1789395156.467508:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23631 00000020:00080000:1.0:1789395156.467516:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.471997:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.472097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231791872 00000100:00100000:0.0:1789395156.472111:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231791872 00000100:00100000:0.0:1789395156.472325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5128 00000100:00100000:0.0:1789395156.472338:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+195:19219:x1876316231791872:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.472976:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983695 00000100:00100000:0.0:1789395156.473112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+197:19219:x1876316231791872:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 773us (1126us total) trans 4294983696 rc 0/0 00000100:00100000:0.0:1789395156.473121:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5128 00000020:00080000:0.0:1789395156.473127:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.477106:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.477206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231792128 00000100:00100000:1.0:1789395156.477220:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231792128 00000100:00100000:1.0:1789395156.477307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23632 00000100:00100000:1.0:1789395156.477319:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+197:19219:x1876316231792128:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.477353:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.477420:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316be9e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.477561:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.477578:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.477592:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.477609:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.477615:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.477622:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.478047:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dd:0x0], index 0: 0 00010000:00010000:1.0:1789395156.478253:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316beb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478268:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316beb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478276:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316beb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.478339:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983697 00010000:00010000:1.0:1789395156.478380:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478426:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478434:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478441:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478449:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.478454:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478463:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478479:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.478482:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.478487:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478495:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bea5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.478515:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fd15820 reply state 00000000aa55bcbd transno 4294983698 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478526:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478532:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb56f173f (ffff89a4c7eb6e00) 00010000:00010000:1.0:1789395156.478534:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.478536:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.478571:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316be9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062e3 expref: 201 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478586:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316beb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062e3 expref: 200 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.478593:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:1.0:1789395156.478596:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.478598:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0e00, rc 0) 00000100:00100000:1.0:1789395156.478677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+201:19219:x1876316231792128:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1360us (1586us total) trans 4294983698 rc 0/0 00000100:00100000:1.0:1789395156.478687:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23632 00000020:00080000:1.0:1789395156.478693:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.489698:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.490562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231792384 00000100:00100000:2.0:1789395156.490579:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231792384 00000100:00100000:2.0:1789395156.490658:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5129 00000100:00100000:2.0:1789395156.490671:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+201:19219:x1876316231792384:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.491316:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983699 00000100:00100000:0.0:1789395156.491486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+203:19219:x1876316231792384:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 815us (1800us total) trans 4294983700 rc 0/0 00000100:00100000:0.0:1789395156.491496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5129 00000020:00080000:0.0:1789395156.491502:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.498248:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.502079:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231792640 00000100:00100000:2.0:1789395156.502103:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231792640 00000100:00100000:2.0:1789395156.502214:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23633 00000100:00100000:2.0:1789395156.502227:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+203:19219:x1876316231792640:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.502266:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.502294:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316bec1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062ea expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.502738:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.502758:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.502781:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.502800:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.502807:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.502813:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.503326:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9de:0x0], index 1: 0 00010000:00010000:2.0:1789395156.504039:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316bed6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504055:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316bed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504065:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316bed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.504253:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983701 00010000:00010000:2.0:1789395156.504299:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504308:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504316:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504324:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504330:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.504335:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504344:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504361:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.504365:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.504370:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504377:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bec8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.504528:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbac3a34 reply state 000000001ff194bd transno 4294983702 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504548:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504554:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5432ea3f (ffff89a3ca366300) 00010000:00010000:2.0:1789395156.504557:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.504561:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.504607:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316bec1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ea expref: 207 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504624:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316bed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ea expref: 206 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.504633:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff89a3ca366c00) 00010000:00010000:2.0:1789395156.504635:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.504637:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dee00, rc 0) 00000100:00100000:2.0:1789395156.504913:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+207:19219:x1876316231792640:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2687us (6679us total) trans 4294983702 rc 0/0 00000100:00100000:2.0:1789395156.504924:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23633 00000020:00080000:2.0:1789395156.504933:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.521555:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.521710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231792896 00000100:00100000:0.0:1789395156.521723:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231792896 00000100:00100000:0.0:1789395156.521798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5130 00000100:00100000:0.0:1789395156.521810:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+207:19219:x1876316231792896:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.522303:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983703 00000100:00100000:0.0:1789395156.522648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+209:19219:x1876316231792896:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 837us (1106us total) trans 4294983704 rc 0/0 00000100:00100000:0.0:1789395156.522658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5130 00000020:00080000:0.0:1789395156.522664:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.533965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.534632:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231793152 00000100:00100000:1.0:1789395156.534646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231793152 00000100:00100000:1.0:1789395156.534730:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23634 00000100:00100000:1.0:1789395156.534742:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+209:19219:x1876316231793152:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.534786:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.534825:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bee4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062f1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.535560:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.535580:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.535594:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.535612:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.535619:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.535626:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.536529:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9de:0x0], index 0: 0 00010000:00010000:1.0:1789395156.536757:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542035:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542072:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.542419:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983705 00010000:00010000:1.0:1789395156.542512:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542523:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542530:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542538:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542545:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.542550:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542558:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542576:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.542579:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.542585:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542592:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316beeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.542609:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3fe6222 reply state 00000000511155e1 transno 4294983706 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542622:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542628:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7f3c793f (ffff89a4c7eb6100) 00010000:00010000:1.0:1789395156.542631:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.542635:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.542694:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bee4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062f1 expref: 213 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542713:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062f1 expref: 212 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.542722:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395156.542724:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.542727:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534e00, rc 0) 00000100:00100000:1.0:1789395156.543065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+213:19219:x1876316231793152:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 8323us (9114us total) trans 4294983706 rc 0/0 00000100:00100000:1.0:1789395156.543074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23634 00000020:00080000:1.0:1789395156.543082:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.552914:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.553205:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231793408 00000100:00100000:0.0:1789395156.553223:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231793408 00000100:00100000:0.0:1789395156.553297:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5131 00000100:00100000:0.0:1789395156.553310:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+213:19219:x1876316231793408:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.554035:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983707 00000100:00100000:0.0:1789395156.554463:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+215:19219:x1876316231793408:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1152us (1560us total) trans 4294983708 rc 0/0 00000100:00100000:0.0:1789395156.554473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5131 00000020:00080000:0.0:1789395156.554479:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.560784:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.560950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231793664 00000100:00100000:0.0:1789395156.560963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231793664 00000100:00100000:0.0:1789395156.561035:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23635 00000100:00100000:0.0:1789395156.561046:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+215:19219:x1876316231793664:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.561077:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.561104:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316bf07 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062f8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.561265:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.561282:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.561295:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.561312:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.561320:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.561326:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.561783:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9df:0x0], index 1: 0 00010000:00010000:0.0:1789395156.561997:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316bf1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562008:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316bf1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562016:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316bf1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.562081:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983709 00010000:00010000:0.0:1789395156.562123:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562132:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562138:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562145:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562151:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.562155:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562163:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562178:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.562181:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.562187:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562194:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bf0e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.562210:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000302d087f reply state 00000000b612983c transno 4294983710 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562226:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562232:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x98e9a43f (ffff89a3c8b1da00) 00010000:00010000:0.0:1789395156.562235:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.562239:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.562275:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316bf07 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062f8 expref: 219 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562290:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316bf1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062f8 expref: 218 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.562299:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff89a3c8b1dc00) 00010000:00010000:0.0:1789395156.562300:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.562303:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c200, rc 0) 00000100:00100000:0.0:1789395156.562443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+219:19219:x1876316231793664:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1339us (1622us total) trans 4294983710 rc 0/0 00000100:00100000:0.0:1789395156.562453:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23635 00000020:00080000:0.0:1789395156.562460:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.571036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.571446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231793920 00000100:00100000:0.0:1789395156.571462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231793920 00000100:00100000:0.0:1789395156.571540:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5132 00000100:00100000:0.0:1789395156.571553:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+219:19219:x1876316231793920:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.571956:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983711 00000100:00100000:0.0:1789395156.572108:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+221:19219:x1876316231793920:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 556us (1083us total) trans 4294983712 rc 0/0 00000100:00100000:0.0:1789395156.572122:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5132 00000020:00080000:0.0:1789395156.572129:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.576226:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.576344:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231794176 00000100:00100000:2.0:1789395156.576357:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231794176 00000100:00100000:2.0:1789395156.576451:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23636 00000100:00100000:2.0:1789395156.576464:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+221:19219:x1876316231794176:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.576497:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.576525:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316bf2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021062ff expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.576683:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.576703:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.576718:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.576740:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.576748:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.576755:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.577223:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9df:0x0], index 0: 0 00010000:00010000:2.0:1789395156.578354:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bf3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578376:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bf3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578401:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bf3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.578505:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983713 00010000:00010000:2.0:1789395156.578553:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578566:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578573:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578581:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578587:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.578592:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578602:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578617:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.578620:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.578626:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578633:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.578649:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab6a82a6 reply state 00000000f81a0ce4 transno 4294983714 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578661:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578668:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x43f3333f (ffff89a3ca366100) 00010000:00010000:2.0:1789395156.578671:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.578675:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.578719:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316bf2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ff expref: 225 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578736:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bf3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ff expref: 224 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.578744:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff89a3ca366700) 00010000:00010000:2.0:1789395156.578746:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.578748:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3cd600, rc 0) 00000100:00100000:2.0:1789395156.578859:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+225:19219:x1876316231794176:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2397us (2647us total) trans 4294983714 rc 0/0 00000100:00100000:2.0:1789395156.578869:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23636 00000020:00080000:2.0:1789395156.578876:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.589100:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.589604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231794432 00000100:00100000:0.0:1789395156.589618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231794432 00000100:00100000:0.0:1789395156.589691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5133 00000100:00100000:0.0:1789395156.589703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+225:19219:x1876316231794432:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.590080:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983715 00000100:00100000:0.0:1789395156.590202:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+227:19219:x1876316231794432:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 500us (1116us total) trans 4294983716 rc 0/0 00000100:00100000:0.0:1789395156.590211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5133 00000020:00080000:0.0:1789395156.590217:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.599275:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.599734:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231794688 00000100:00100000:1.0:1789395156.599748:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231794688 00000100:00100000:1.0:1789395156.599881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23637 00000100:00100000:1.0:1789395156.599894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+227:19219:x1876316231794688:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.599929:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.599960:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bf4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106306 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.600100:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.600119:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.600134:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.600152:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.600161:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.600168:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.601100:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e0:0x0], index 1: 0 00010000:00010000:1.0:1789395156.601320:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c400/0xff35729af316bf62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601337:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c400/0xff35729af316bf62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601347:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c400/0xff35729af316bf62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.601440:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983717 00010000:00010000:1.0:1789395156.601483:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601492:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601500:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601513:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601521:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.601526:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601536:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601552:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.601555:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.601561:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316bf54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.601589:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe057b83 reply state 0000000040fc7c82 transno 4294983718 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601602:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601609:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5ae1063f (ffff89a4c7eb6700) 00010000:00010000:1.0:1789395156.601611:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.601615:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.601658:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316bf4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106306 expref: 231 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601681:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c400/0xff35729af316bf62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106306 expref: 230 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.601688:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:1.0:1789395156.601690:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.601693:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47c400, rc 0) 00000100:00100000:1.0:1789395156.601804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+231:19219:x1876316231794688:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1911us (2543us total) trans 4294983718 rc 0/0 00000100:00100000:1.0:1789395156.601814:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23637 00000020:00080000:1.0:1789395156.601820:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.615787:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.628472:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231794944 00000100:00100000:0.0:1789395156.628496:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231794944 00000100:00100000:0.0:1789395156.628803:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5134 00000100:00100000:0.0:1789395156.628818:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+231:19219:x1876316231794944:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.629194:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983719 00000100:00100000:0.0:1789395156.629634:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+233:19219:x1876316231794944:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 817us (13871us total) trans 4294983720 rc 0/0 00000100:00100000:0.0:1789395156.629644:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5134 00000020:00080000:0.0:1789395156.629651:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.637515:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.637805:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231795200 00000100:00100000:1.0:1789395156.637818:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231795200 00000100:00100000:1.0:1789395156.637910:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23638 00000100:00100000:1.0:1789395156.638102:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+233:19219:x1876316231795200:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.638138:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.638166:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316bf70 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210630d expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.638323:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.638341:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.638355:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.638380:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.638524:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.638532:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.639209:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e0:0x0], index 0: 0 00010000:00010000:1.0:1789395156.640149:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d400/0xff35729af316bf85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640184:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d400/0xff35729af316bf85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640196:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d400/0xff35729af316bf85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.640323:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983721 00010000:00010000:1.0:1789395156.640370:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640379:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640424:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640433:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640445:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.640451:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640461:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640476:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.640480:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.640486:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640493:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316bf77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.640514:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c1b6dc7 reply state 00000000fd0438c6 transno 4294983722 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640526:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640533:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6fe0153f (ffff89a4c7eb6600) 00010000:00010000:1.0:1789395156.640535:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.640538:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.640582:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316bf70 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210630d expref: 237 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640599:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d400/0xff35729af316bf85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210630d expref: 236 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.640614:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff89a4c7eb6a00) 00010000:00010000:1.0:1789395156.640616:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.640619:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47d400, rc 0) 00000100:00100000:1.0:1789395156.640713:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+237:19219:x1876316231795200:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2616us (3212us total) trans 4294983722 rc 0/0 00000100:00100000:1.0:1789395156.640724:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23638 00000020:00080000:1.0:1789395156.640733:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.647339:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.647475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231795456 00000100:00100000:0.0:1789395156.647488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231795456 00000100:00100000:0.0:1789395156.647558:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5135 00000100:00100000:0.0:1789395156.647569:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+237:19219:x1876316231795456:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.647941:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983723 00000100:00100000:0.0:1789395156.648072:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+239:19219:x1876316231795456:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 502us (745us total) trans 4294983724 rc 0/0 00000100:00100000:0.0:1789395156.648081:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5135 00000020:00080000:0.0:1789395156.648087:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.655121:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.656553:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231795712 00000100:00100000:2.0:1789395156.656571:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231795712 00000100:00100000:2.0:1789395156.656654:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23639 00000100:00100000:2.0:1789395156.656665:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+239:19219:x1876316231795712:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.656700:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.656796:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316bf93 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106314 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.658441:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.658471:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.658491:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.658513:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.658521:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.658529:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.659329:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e1:0x0], index 1: 0 00010000:00010000:2.0:1789395156.660541:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316bfa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660565:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316bfa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660578:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316bfa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.660710:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983725 00010000:00010000:2.0:1789395156.660849:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660857:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660865:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660879:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660886:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.660891:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660900:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.660983:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.660988:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.660994:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.661002:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316bf9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.661020:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c366c15a reply state 0000000099b0e327 transno 4294983726 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.661033:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.661040:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa91e503f (ffff89a3ca366a00) 00010000:00010000:2.0:1789395156.661108:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.661112:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.661163:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316bf93 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106314 expref: 243 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.661259:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316bfa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106314 expref: 242 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.661269:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff89a3ca366f00) 00010000:00010000:2.0:1789395156.661272:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.661274:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57a00, rc 0) 00000100:00100000:2.0:1789395156.661377:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+243:19219:x1876316231795712:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4712us (6269us total) trans 4294983726 rc 0/0 00000100:00100000:2.0:1789395156.661818:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23639 00000020:00080000:2.0:1789395156.661827:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.672166:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.672990:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231795968 00000100:00100000:0.0:1789395156.673007:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231795968 00000100:00100000:0.0:1789395156.673094:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5136 00000100:00100000:0.0:1789395156.673106:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+243:19219:x1876316231795968:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.673554:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983727 00000100:00100000:0.0:1789395156.673684:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+245:19219:x1876316231795968:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 578us (1531us total) trans 4294983728 rc 0/0 00000100:00100000:0.0:1789395156.673693:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5136 00000020:00080000:0.0:1789395156.673699:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.684007:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.684349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231796224 00000100:00100000:0.0:1789395156.684363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231796224 00000100:00100000:0.0:1789395156.684476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23640 00000100:00100000:0.0:1789395156.684488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+245:19219:x1876316231796224:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.684523:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.684551:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bfb6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210631b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.698739:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.698787:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.698802:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.698825:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.698833:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.698840:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.699581:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e1:0x0], index 0: 0 00010000:00010000:3.0:1789395156.699828:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316bfcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.699842:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316bfcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.699852:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316bfcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.699918:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983729 00010000:00010000:3.0:1789395156.699964:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.699973:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.699979:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.699986:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.699993:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.699998:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.700007:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.700022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.700026:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.700032:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.700039:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.700060:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000614edf5d reply state 00000000500b7404 transno 4294983730 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.700072:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.700078:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfc27df3f (ffff89a3c90d5400) 00010000:00010000:3.0:1789395156.700081:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.700084:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.700131:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316bfb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210631b expref: 249 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.702907:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316bfcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210631b expref: 248 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.702931:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:3.0:1789395156.702935:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.702940:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23a000, rc 0) 00000100:00100000:3.0:1789395156.703046:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+249:19219:x1876316231796224:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 18557us (19051us total) trans 4294983730 rc 0/0 00000100:00100000:3.0:1789395156.703057:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23640 00000020:00080000:3.0:1789395156.703066:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.709547:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.709659:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231796480 00000100:00100000:3.0:1789395156.709672:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231796480 00000100:00100000:3.0:1789395156.709791:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5137 00000100:00100000:3.0:1789395156.709803:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+249:19219:x1876316231796480:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395156.710144:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983731 00000100:00100000:3.0:1789395156.710759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+251:19219:x1876316231796480:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 955us (1224us total) trans 4294983732 rc 0/0 00000100:00100000:3.0:1789395156.710779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5137 00000020:00080000:3.0:1789395156.710787:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.715306:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.715428:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231796736 00000100:00100000:3.0:1789395156.715440:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231796736 00000100:00100000:3.0:1789395156.715499:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23641 00000100:00100000:3.0:1789395156.715511:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+251:19219:x1876316231796736:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.715543:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.715572:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106322 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.715709:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.715727:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.715740:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.715757:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.715764:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.715780:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.716268:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e2:0x0], index 1: 0 00010000:00010000:3.0:1789395156.716519:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bfee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716532:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bfee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716542:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bfee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.716605:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983733 00010000:00010000:3.0:1789395156.716645:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716654:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716661:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716669:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716681:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.716686:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716696:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716712:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.716715:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.716721:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716728:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316bfe0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.716747:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006977a020 reply state 000000006069770a transno 4294983734 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716759:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716767:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a358594 (ffff89a3c90d5100) 00010000:00010000:3.0:1789395156.716769:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.716784:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.716823:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316bfd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106322 expref: 255 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716841:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bfee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106322 expref: 254 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.716856:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff89a3c90d5900) 00010000:00010000:3.0:1789395156.716858:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.716861:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b000, rc 0) 00000100:00100000:3.0:1789395156.716971:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+255:19219:x1876316231796736:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1462us (1679us total) trans 4294983734 rc 0/0 00000100:00100000:3.0:1789395156.716981:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23641 00000020:00080000:3.0:1789395156.716988:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789395156.721688:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395156.727506:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.727618:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231796992 00000100:00100000:0.0:1789395156.727633:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231796992 00000100:00100000:0.0:1789395156.727735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5138 00000100:00100000:0.0:1789395156.727747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+255:19219:x1876316231796992:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.728125:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983735 00000100:00100000:0.0:1789395156.728278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+257:19219:x1876316231796992:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 532us (890us total) trans 4294983736 rc 0/0 00000100:00100000:0.0:1789395156.728287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5138 00000020:00080000:0.0:1789395156.728293:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.731804:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.732065:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231797248 00000100:00100000:1.0:1789395156.732079:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231797248 00000100:00100000:1.0:1789395156.732167:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23642 00000100:00100000:1.0:1789395156.732179:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+257:19219:x1876316231797248:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.732212:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.732251:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316bffc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106329 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.732436:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.732456:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.732470:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.732489:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.732497:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.732503:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.732909:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e2:0x0], index 0: 0 00010000:00010000:1.0:1789395156.733120:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c000/0xff35729af316c011 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733134:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c000/0xff35729af316c011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733141:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c000/0xff35729af316c011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.733202:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983737 00010000:00010000:1.0:1789395156.733242:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733250:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733256:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733262:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733273:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.733278:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733287:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733301:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.733304:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.733310:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733317:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c003 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.733331:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6b07100 reply state 000000004bf496d1 transno 4294983738 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733343:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733349:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3f3f1494 (ffff89a4c7eb6800) 00010000:00010000:1.0:1789395156.733351:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.733354:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.733417:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316bffc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106329 expref: 261 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733432:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c000/0xff35729af316c011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106329 expref: 260 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.733445:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff89a4c7eb6300) 00010000:00010000:1.0:1789395156.733447:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.733449:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47c000, rc 0) 00000100:00100000:1.0:1789395156.733533:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+261:19219:x1876316231797248:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1356us (1743us total) trans 4294983738 rc 0/0 00000100:00100000:1.0:1789395156.733541:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23642 00000020:00080000:1.0:1789395156.733548:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.738565:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.738689:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231797504 00000100:00100000:0.0:1789395156.738702:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231797504 00000100:00100000:0.0:1789395156.738764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5139 00000100:00100000:0.0:1789395156.738785:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+261:19219:x1876316231797504:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.739136:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983739 00000100:00100000:0.0:1789395156.739258:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+263:19219:x1876316231797504:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 484us (707us total) trans 4294983740 rc 0/0 00000100:00100000:0.0:1789395156.739267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5139 00000020:00080000:0.0:1789395156.739273:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.750051:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.750562:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231797760 00000100:00100000:1.0:1789395156.750577:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231797760 00000100:00100000:1.0:1789395156.750656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23643 00000100:00100000:1.0:1789395156.750668:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+263:19219:x1876316231797760:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.750702:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.750731:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c01f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106330 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.750879:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.750897:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.750910:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.750927:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.750934:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.750941:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.751614:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e3:0x0], index 1: 0 00010000:00010000:1.0:1789395156.751849:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ce00/0xff35729af316c034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.751862:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ce00/0xff35729af316c034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.751871:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ce00/0xff35729af316c034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.751941:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983741 00010000:00010000:1.0:1789395156.751987:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.751996:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752004:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752012:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752019:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.752024:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752032:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752049:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.752052:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.752058:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752065:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c026 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.752082:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007db72515 reply state 0000000017e4a4e9 transno 4294983742 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752095:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752101:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x584c3f94 (ffff89a4c7eb6000) 00010000:00010000:1.0:1789395156.752103:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.752106:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.752300:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c01f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106330 expref: 267 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752320:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ce00/0xff35729af316c034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106330 expref: 266 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.752329:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff89a4c3ab8600) 00010000:00010000:1.0:1789395156.752332:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.752335:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47ce00, rc 0) 00000100:00100000:1.0:1789395156.752572:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+267:19219:x1876316231797760:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1905us (2535us total) trans 4294983742 rc 0/0 00000100:00100000:1.0:1789395156.752582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23643 00000020:00080000:1.0:1789395156.752589:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.757351:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.757549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231798016 00000100:00100000:0.0:1789395156.757563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231798016 00000100:00100000:0.0:1789395156.757636:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5140 00000100:00100000:0.0:1789395156.757648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+267:19219:x1876316231798016:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.758015:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983743 00000100:00100000:0.0:1789395156.758146:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+269:19219:x1876316231798016:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 498us (808us total) trans 4294983744 rc 0/0 00000100:00100000:0.0:1789395156.758154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5140 00000020:00080000:0.0:1789395156.758160:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.762336:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.762583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231798272 00000100:00100000:3.0:1789395156.762596:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231798272 00000100:00100000:3.0:1789395156.762706:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23644 00000100:00100000:3.0:1789395156.762718:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+269:19219:x1876316231798272:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.762752:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.762790:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c042 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106337 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.762944:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.762964:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.762978:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763000:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763008:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763015:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.763512:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e3:0x0], index 0: 0 00010000:00010000:3.0:1789395156.763729:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316c057 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763740:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316c057 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763749:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316c057 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.763824:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983745 00010000:00010000:3.0:1789395156.763877:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763885:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763891:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763898:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763911:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.763916:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763925:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763942:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.763945:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.763950:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763957:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c049 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.763977:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbe8e245 reply state 000000000718065e transno 4294983746 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763990:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.763997:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x55367694 (ffff89a3c90d5300) 00010000:00010000:3.0:1789395156.763999:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.764003:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.764044:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c042 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106337 expref: 273 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.764062:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316c057 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106337 expref: 272 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.764074:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff89a3c90d5600) 00010000:00010000:3.0:1789395156.764076:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.764079:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b600, rc 0) 00000100:00100000:3.0:1789395156.764176:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+273:19219:x1876316231798272:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1460us (1854us total) trans 4294983746 rc 0/0 00000100:00100000:3.0:1789395156.764184:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23644 00000020:00080000:3.0:1789395156.764191:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.769532:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.769628:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231798528 00000100:00100000:0.0:1789395156.769641:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231798528 00000100:00100000:0.0:1789395156.769708:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5141 00000100:00100000:0.0:1789395156.769720:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+273:19219:x1876316231798528:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.770067:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983747 00000100:00100000:0.0:1789395156.770180:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+275:19219:x1876316231798528:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 460us (661us total) trans 4294983748 rc 0/0 00000100:00100000:0.0:1789395156.770189:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5141 00000020:00080000:0.0:1789395156.770195:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.774192:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.774307:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231798784 00000100:00100000:2.0:1789395156.774319:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231798784 00000100:00100000:2.0:1789395156.774436:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23645 00000100:00100000:2.0:1789395156.774449:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+275:19219:x1876316231798784:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.774484:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.774515:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c065 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210633e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.774654:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.774672:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.774686:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.774702:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.774707:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.774711:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.775222:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e4:0x0], index 1: 0 00010000:00010000:2.0:1789395156.775465:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316c07a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775477:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316c07a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775486:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316c07a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.775550:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983749 00010000:00010000:2.0:1789395156.775595:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775603:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775610:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775618:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775635:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.775640:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775649:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775664:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.775668:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.775674:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775681:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c06c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.775699:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082bf2602 reply state 000000002c37161f transno 4294983750 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775709:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775715:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf0e3a194 (ffff89a3ca366600) 00010000:00010000:2.0:1789395156.775717:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.775720:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.775757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c065 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210633e expref: 279 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775782:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316c07a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210633e expref: 278 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.775795:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:2.0:1789395156.775797:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.775799:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56c00, rc 0) 00000100:00100000:2.0:1789395156.775887:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+279:19219:x1876316231798784:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1441us (1710us total) trans 4294983750 rc 0/0 00000100:00100000:2.0:1789395156.775895:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23645 00000020:00080000:2.0:1789395156.775901:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.779090:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.779185:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231799040 00000100:00100000:0.0:1789395156.779198:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231799040 00000100:00100000:0.0:1789395156.779260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5142 00000100:00100000:0.0:1789395156.779271:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+279:19219:x1876316231799040:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.779650:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983751 00000100:00100000:0.0:1789395156.779798:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+281:19219:x1876316231799040:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 527us (722us total) trans 4294983752 rc 0/0 00000100:00100000:0.0:1789395156.779806:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5142 00000020:00080000:0.0:1789395156.779813:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.782884:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.782945:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231799296 00000100:00100000:3.0:1789395156.782959:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231799296 00000100:00100000:3.0:1789395156.783032:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23646 00000100:00100000:3.0:1789395156.783043:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+281:19219:x1876316231799296:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.783074:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.783104:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c088 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106345 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.783258:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.783276:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.783290:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.783315:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.783328:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.783334:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.783784:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e4:0x0], index 0: 0 00010000:00010000:3.0:1789395156.783990:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316c09d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784001:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316c09d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784010:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316c09d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.784074:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983753 00010000:00010000:3.0:1789395156.784116:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784124:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784132:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784141:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784148:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.784154:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784165:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784181:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.784185:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.784191:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784198:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c08f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.784216:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000348696da reply state 000000000dd71823 transno 4294983754 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784228:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784236:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2fe2b094 (ffff89a3c90d5000) 00010000:00010000:3.0:1789395156.784238:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.784241:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.784278:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c088 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106345 expref: 285 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784294:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316c09d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106345 expref: 284 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.784302:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff89a3c90d5700) 00010000:00010000:3.0:1789395156.784304:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.784307:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015800, rc 0) 00000100:00100000:3.0:1789395156.784427:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+285:19219:x1876316231799296:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1384us (1555us total) trans 4294983754 rc 0/0 00000100:00100000:3.0:1789395156.784436:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23646 00000020:00080000:3.0:1789395156.784443:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.788708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.788897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231799552 00000100:00100000:1.0:1789395156.788910:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231799552 00000100:00100000:1.0:1789395156.788991:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5143 00000100:00100000:1.0:1789395156.789003:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+285:19219:x1876316231799552:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.789607:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983755 00000100:00100000:1.0:1789395156.789762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+287:19219:x1876316231799552:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 759us (1066us total) trans 4294983756 rc 0/0 00000100:00100000:1.0:1789395156.789780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5143 00000020:00080000:1.0:1789395156.789785:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.796129:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.796240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231799808 00000100:00100000:3.0:1789395156.796253:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231799808 00000100:00100000:3.0:1789395156.796323:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23647 00000100:00100000:3.0:1789395156.796335:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+287:19219:x1876316231799808:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.796366:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.796419:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c0ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210634c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.796554:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.796571:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.796585:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.796601:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.796610:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.796617:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.797287:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e5:0x0], index 1: 0 00010000:00010000:3.0:1789395156.797535:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316c0c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797549:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316c0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797560:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316c0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.797626:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983757 00010000:00010000:3.0:1789395156.797663:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797672:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797680:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797688:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797694:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.797699:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797709:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797723:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.797727:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.797732:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797738:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.797755:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e543f21c reply state 00000000d9504ed0 transno 4294983758 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797768:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797786:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xc8efdb94 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395156.797789:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.797791:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.797835:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c0ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210634c expref: 291 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797852:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316c0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210634c expref: 290 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.797859:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff89a4c8e8dd00) 00010000:00010000:3.0:1789395156.797861:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.797864:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015c00, rc 0) 00000100:00100000:3.0:1789395156.797947:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+291:19219:x1876316231799808:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1614us (1830us total) trans 4294983758 rc 0/0 00000100:00100000:3.0:1789395156.797956:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23647 00000020:00080000:3.0:1789395156.801710:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.808706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.808887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231800064 00000100:00100000:0.0:1789395156.808900:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231800064 00000100:00100000:0.0:1789395156.808978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5144 00000100:00100000:0.0:1789395156.808992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+291:19219:x1876316231800064:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.809337:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983759 00000100:00100000:0.0:1789395156.809496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+293:19219:x1876316231800064:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 507us (805us total) trans 4294983760 rc 0/0 00000100:00100000:0.0:1789395156.809505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5144 00000020:00080000:0.0:1789395156.809511:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395156.825257:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.825373:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231800320 00000100:00100000:2.0:1789395156.825435:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231800320 00000100:00100000:2.0:1789395156.825514:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23648 00000100:00100000:2.0:1789395156.825526:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+293:19219:x1876316231800320:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.825560:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.825587:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c0ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106353 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.826135:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.826156:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.826170:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.826189:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.826201:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.826208:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.826670:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e5:0x0], index 0: 0 00010000:00010000:2.0:1789395156.827542:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316c0e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827561:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316c0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827571:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316c0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.827653:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983761 00010000:00010000:2.0:1789395156.827695:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827703:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827711:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827718:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827736:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.827742:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827751:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827766:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.827777:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.827784:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827791:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c0d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.827814:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059b250b3 reply state 00000000848bb6ac transno 4294983762 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827825:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827831:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x45da1294 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395156.827833:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.827836:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.827881:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c0ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106353 expref: 297 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827899:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316c0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106353 expref: 296 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.827907:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395156.827909:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.827912:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56e00, rc 0) 00000100:00100000:2.0:1789395156.828029:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+297:19219:x1876316231800320:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2504us (2787us total) trans 4294983762 rc 0/0 00000100:00100000:2.0:1789395156.828039:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23648 00000020:00080000:2.0:1789395156.828055:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.832947:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.833050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231800576 00000100:00100000:1.0:1789395156.833064:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231800576 00000100:00100000:1.0:1789395156.833180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5145 00000100:00100000:1.0:1789395156.833192:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+297:19219:x1876316231800576:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.833595:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983763 00000100:00100000:1.0:1789395156.833726:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+299:19219:x1876316231800576:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 535us (795us total) trans 4294983764 rc 0/0 00000100:00100000:1.0:1789395156.833735:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5145 00000020:00080000:1.0:1789395156.833741:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.840097:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.840449:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231800832 00000100:00100000:3.0:1789395156.840464:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231800832 00000100:00100000:3.0:1789395156.840573:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23649 00000100:00100000:3.0:1789395156.840583:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+299:19219:x1876316231800832:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.840613:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.840637:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c0f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210635a expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.840790:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.840809:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.840823:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.840841:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.840856:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.840863:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395156.841355:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e6:0x0], index 1: 0 00010000:00010000:3.0:1789395156.841597:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316c106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841607:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316c106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841620:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316c106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395156.841684:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983765 00010000:00010000:3.0:1789395156.841725:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841732:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841739:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841746:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841754:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395156.841759:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841768:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841799:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395156.841802:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395156.841807:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841814:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c0f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395156.841836:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060360fe3 reply state 000000004c536120 transno 4294983766 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841848:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841855:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd2f04d94 (ffff89a4c8e8d900) 00010000:00010000:3.0:1789395156.841858:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395156.841860:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395156.841899:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c0f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210635a expref: 303 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841920:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316c106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210635a expref: 302 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.841927:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:3.0:1789395156.841929:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395156.841931:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015000, rc 0) 00000100:00100000:3.0:1789395156.842019:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+303:19219:x1876316231800832:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1437us (1936us total) trans 4294983766 rc 0/0 00000100:00100000:3.0:1789395156.842028:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23649 00000020:00080000:3.0:1789395156.842034:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.846307:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.846440:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231801088 00000100:00100000:1.0:1789395156.846452:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231801088 00000100:00100000:1.0:1789395156.846594:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5146 00000100:00100000:1.0:1789395156.846607:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+303:19219:x1876316231801088:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.846938:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983767 00000100:00100000:1.0:1789395156.847337:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+305:19219:x1876316231801088:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 730us (1042us total) trans 4294983768 rc 0/0 00000100:00100000:1.0:1789395156.847348:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5146 00000020:00080000:1.0:1789395156.847354:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.850791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.850955:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231801344 00000100:00100000:3.0:1789395156.851032:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231801344 00000100:00100000:3.0:1789395156.851112:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23650 00000100:00100000:3.0:1789395156.851124:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+305:19219:x1876316231801344:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395156.851159:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395156.851187:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c114 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106361 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.851323:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.851342:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.851356:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.851375:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.855805:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395156.856275:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.857292:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e6:0x0], index 0: 0 00010000:00010000:2.0:1789395156.858552:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316c129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858579:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316c129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858593:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316c129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.858685:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983769 00010000:00010000:2.0:1789395156.858731:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858739:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858745:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858753:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858759:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.858764:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858785:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858801:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.858804:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.858810:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858817:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c11b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.858833:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef2d4ca1 reply state 00000000fdc9708a transno 4294983770 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858844:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.858850:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7df9dc94 (ffff89a4c8e8d800) 00010000:00010000:2.0:1789395156.858853:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.858856:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.858902:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c114 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106361 expref: 309 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.859126:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316c129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106361 expref: 308 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.859136:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:2.0:1789395156.859138:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.859141:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57600, rc 0) 00000100:00100000:2.0:1789395156.859320:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+309:19219:x1876316231801344:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 8197us (8556us total) trans 4294983770 rc 0/0 00000100:00100000:2.0:1789395156.859329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23650 00000020:00080000:2.0:1789395156.859338:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.874605:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.877584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231801600 00000100:00100000:1.0:1789395156.877607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231801600 00000100:00100000:0.0:1789395156.881678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5147 00000100:00100000:0.0:1789395156.881696:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+309:19219:x1876316231801600:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.882098:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983771 00000100:00100000:0.0:1789395156.882263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+311:19219:x1876316231801600:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 570us (7674us total) trans 4294983772 rc 0/0 00000100:00100000:0.0:1789395156.882272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5147 00000020:00080000:0.0:1789395156.882278:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395156.888308:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395156.888427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231801856 00000100:00100000:2.0:1789395156.888440:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231801856 00000100:00100000:2.0:1789395156.888516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23651 00000100:00100000:2.0:1789395156.888528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+311:19219:x1876316231801856:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395156.888560:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395156.888590:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c137 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106368 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.888734:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.888753:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.888766:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.888792:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.888799:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.888806:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395156.889843:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e7:0x0], index 1: 0 00010000:00010000:2.0:1789395156.890086:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316c14c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890103:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316c14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890114:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316c14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.890437:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983773 00010000:00010000:2.0:1789395156.890483:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890494:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890501:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890509:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890515:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.890521:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890530:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890546:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.890551:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.890556:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890563:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c13e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.890583:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5e530d1 reply state 00000000a839d110 transno 4294983774 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890595:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890602:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xda336479 (ffff89a3ca35f000) 00010000:00010000:2.0:1789395156.890605:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.890608:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.890651:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c137 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106368 expref: 315 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890667:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316c14c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106368 expref: 314 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.890676:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:2.0:1789395156.890679:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.890681:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56800, rc 0) 00000100:00100000:2.0:1789395156.890790:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+315:19219:x1876316231801856:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2264us (2547us total) trans 4294983774 rc 0/0 00000100:00100000:2.0:1789395156.890800:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23651 00000020:00080000:2.0:1789395156.890808:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.903351:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.903778:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231802112 00000100:00100000:1.0:1789395156.903791:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231802112 00000100:00100000:1.0:1789395156.903862:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5148 00000100:00100000:1.0:1789395156.903873:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+315:19219:x1876316231802112:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395156.905541:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983775 00000100:00100000:1.0:1789395156.905793:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+317:19219:x1876316231802112:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1916us (2452us total) trans 4294983776 rc 0/0 00000100:00100000:1.0:1789395156.905805:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5148 00000020:00080000:1.0:1789395156.905813:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.919065:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395156.922450:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231802368 00000100:00100000:3.0:1789395156.922475:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231802368 00000100:00100000:0.0:1789395156.924983:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23652 00000100:00100000:0.0:1789395156.925000:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+317:19219:x1876316231802368:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.925033:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.925063:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c15a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210636f expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925217:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925245:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925259:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925278:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925285:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925291:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.925759:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e7:0x0], index 0: 0 00010000:00010000:0.0:1789395156.925977:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316c16f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925988:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316c16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.925997:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316c16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.926059:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983777 00010000:00010000:0.0:1789395156.926100:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926109:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926116:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926124:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926130:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.926135:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926145:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926160:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.926164:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.926170:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926177:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c161 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.926193:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b52ba4e5 reply state 000000001ed469e2 transno 4294983778 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926205:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926211:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3abc7379 (ffff89a3c8b1de00) 00010000:00010000:0.0:1789395156.926213:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.926216:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.926252:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c15a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210636f expref: 321 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926267:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316c16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210636f expref: 320 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.926275:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff89a3c8b1dd00) 00010000:00010000:0.0:1789395156.926277:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.926279:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c600, rc 0) 00000100:00100000:0.0:1789395156.926359:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+321:19219:x1876316231802368:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1363us (7309us total) trans 4294983778 rc 0/0 00000100:00100000:0.0:1789395156.926367:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23652 00000020:00080000:0.0:1789395156.926374:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.936793:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.936948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231802624 00000100:00100000:0.0:1789395156.936962:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231802624 00000100:00100000:0.0:1789395156.937028:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5149 00000100:00100000:0.0:1789395156.937038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+321:19219:x1876316231802624:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.937629:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983779 00000100:00100000:0.0:1789395156.938122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+323:19219:x1876316231802624:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1082us (1349us total) trans 4294983780 rc 0/0 00000100:00100000:0.0:1789395156.938133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5149 00000020:00080000:0.0:1789395156.938140:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.943632:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.944293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231802880 00000100:00100000:0.0:1789395156.944309:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231802880 00000100:00100000:0.0:1789395156.944433:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23653 00000100:00100000:0.0:1789395156.944447:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+323:19219:x1876316231802880:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.944480:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.944511:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c17d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106376 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.944659:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.944678:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.944692:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.944709:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.944715:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.944723:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395156.945279:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e8:0x0], index 1: 0 00010000:00010000:0.0:1789395156.945543:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316c192 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945555:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316c192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945564:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316c192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395156.945630:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983781 00010000:00010000:0.0:1789395156.945670:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945677:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945685:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945692:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945698:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395156.945703:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945713:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945729:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395156.945732:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395156.945739:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945747:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c184 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395156.945765:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0eec7e1 reply state 00000000ae01cbe9 transno 4294983782 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945790:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x32204679 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395156.945800:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395156.945803:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395156.945845:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c17d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106376 expref: 327 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945862:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316c192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106376 expref: 326 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.945870:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395156.945872:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395156.945875:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ce00, rc 0) 00000100:00100000:0.0:1789395156.945956:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+327:19219:x1876316231802880:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1511us (2339us total) trans 4294983782 rc 0/0 00000100:00100000:0.0:1789395156.945966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23653 00000020:00080000:0.0:1789395156.945974:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.955888:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.955996:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231803136 00000100:00100000:0.0:1789395156.956010:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231803136 00000100:00100000:0.0:1789395156.956111:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5150 00000100:00100000:0.0:1789395156.956122:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+327:19219:x1876316231803136:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.956638:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983783 00000100:00100000:0.0:1789395156.956825:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+329:19219:x1876316231803136:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 702us (950us total) trans 4294983784 rc 0/0 00000100:00100000:0.0:1789395156.956835:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5150 00000020:00080000:0.0:1789395156.956841:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.962036:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.962226:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231803392 00000100:00100000:1.0:1789395156.962305:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231803392 00000100:00100000:1.0:1789395156.962575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23654 00000100:00100000:1.0:1789395156.962588:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+329:19219:x1876316231803392:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.962621:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.962651:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210637d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.963063:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.963086:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.963101:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.963118:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.963126:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.963132:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.964215:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e8:0x0], index 0: 0 00010000:00010000:2.0:1789395156.964847:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c1b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.964868:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.964880:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395156.964964:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983785 00010000:00010000:2.0:1789395156.965013:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965021:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965029:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965037:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965044:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395156.965049:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965059:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965075:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395156.965080:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395156.965085:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965092:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395156.965110:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dbc3c14 reply state 000000007263ef1c transno 4294983786 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965123:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965129:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2f29d579 (ffff89a4c3ab8300) 00010000:00010000:2.0:1789395156.965132:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395156.965135:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395156.965318:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210637d expref: 333 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965337:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210637d expref: 332 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395156.965346:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff89a3ca35f700) 00010000:00010000:2.0:1789395156.965348:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395156.965350:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56000, rc 0) 00000100:00100000:2.0:1789395156.965725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+333:19219:x1876316231803392:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3137us (3702us total) trans 4294983786 rc 0/0 00000100:00100000:2.0:1789395156.965736:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23654 00000020:00080000:2.0:1789395156.965745:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.971217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.971376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231803648 00000100:00100000:0.0:1789395156.971447:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231803648 00000100:00100000:0.0:1789395156.971563:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5151 00000100:00100000:0.0:1789395156.971575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+333:19219:x1876316231803648:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.971964:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983787 00000100:00100000:0.0:1789395156.972132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+335:19219:x1876316231803648:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 558us (997us total) trans 4294983788 rc 0/0 00000100:00100000:0.0:1789395156.972142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5151 00000020:00080000:0.0:1789395156.972155:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395156.982648:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.982763:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231803904 00000100:00100000:0.0:1789395156.982783:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231803904 00000100:00100000:0.0:1789395156.982870:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23655 00000100:00100000:0.0:1789395156.982880:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+335:19219:x1876316231803904:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395156.982914:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395156.982941:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c1c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106384 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.983088:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.983105:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.983118:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.983133:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.983138:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395156.983155:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.984519:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e9:0x0], index 1: 0 00010000:00010000:1.0:1789395156.984728:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d200/0xff35729af316c1d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984743:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d200/0xff35729af316c1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984822:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d200/0xff35729af316c1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.984892:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983789 00010000:00010000:1.0:1789395156.984936:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984950:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984957:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984965:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984972:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.984977:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.984986:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.985001:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.985005:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.985011:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.985018:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c1ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.985035:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4137802 reply state 000000003deab6d2 transno 4294983790 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.985046:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.985053:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xcad70079 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395156.985057:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.985059:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.985101:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c1c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106384 expref: 339 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.985117:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d200/0xff35729af316c1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106384 expref: 338 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.985125:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff89a4c3ab8700) 00010000:00010000:1.0:1789395156.985127:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.985130:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47d200, rc 0) 00000100:00100000:1.0:1789395156.985486:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+339:19219:x1876316231803904:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2604us (2849us total) trans 4294983790 rc 0/0 00000100:00100000:1.0:1789395156.985497:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23655 00000020:00080000:1.0:1789395156.985504:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.990055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395156.990225:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231804160 00000100:00100000:0.0:1789395156.990298:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231804160 00000100:00100000:0.0:1789395156.990504:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5152 00000100:00100000:0.0:1789395156.990518:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+339:19219:x1876316231804160:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395156.990993:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983791 00000100:00100000:0.0:1789395156.991144:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+341:19219:x1876316231804160:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 628us (1100us total) trans 4294983792 rc 0/0 00000100:00100000:0.0:1789395156.991161:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5152 00000020:00080000:0.0:1789395156.991167:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395156.996367:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395156.996583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231804416 00000100:00100000:1.0:1789395156.996596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231804416 00000100:00100000:1.0:1789395156.996709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23656 00000100:00100000:1.0:1789395156.996721:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+341:19219:x1876316231804416:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395156.996767:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395156.996806:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c1e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210638b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.996967:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.996986:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.997003:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.997020:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.997028:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.997034:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395156.997765:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e9:0x0], index 0: 0 00010000:00010000:1.0:1789395156.998002:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316c1fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998016:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316c1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998026:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316c1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395156.998090:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983793 00010000:00010000:1.0:1789395156.998132:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998141:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998482:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998496:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998503:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47de00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395156.998508:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998517:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998534:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395156.998538:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395156.998544:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998551:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c1ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395156.998570:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d305047c reply state 000000006fcedbe1 transno 4294983794 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998583:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998590:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x71408f79 (ffff89a4c3ab8100) 00010000:00010000:1.0:1789395156.998592:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395156.998596:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395156.998640:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c1e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210638b expref: 345 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998663:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316c1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210638b expref: 344 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395156.998671:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff89a4c3ab8000) 00010000:00010000:1.0:1789395156.998674:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395156.998676:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47da00, rc 0) 00000100:00100000:1.0:1789395156.998947:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+345:19219:x1876316231804416:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2227us (2593us total) trans 4294983794 rc 0/0 00000100:00100000:1.0:1789395156.998957:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23656 00000020:00080000:1.0:1789395156.998964:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.003667:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.003783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231804672 00000100:00100000:2.0:1789395157.003796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231804672 00000100:00100000:2.0:1789395157.003899:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5153 00000100:00100000:2.0:1789395157.003912:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+345:19219:x1876316231804672:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.005083:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983795 00000100:00100000:2.0:1789395157.005364:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+347:19219:x1876316231804672:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1449us (1709us total) trans 4294983796 rc 0/0 00000100:00100000:2.0:1789395157.005375:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5153 00000020:00080000:2.0:1789395157.005382:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789395157.005511:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395157.009894:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.010037:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231804928 00000100:00100000:2.0:1789395157.010050:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231804928 00000100:00100000:2.0:1789395157.010125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23657 00000100:00100000:2.0:1789395157.010136:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+347:19219:x1876316231804928:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.010176:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.010207:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c209 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.010368:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.010418:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.010433:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.010451:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.010459:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.010466:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.011348:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ea:0x0], index 1: 0 00010000:00010000:2.0:1789395157.012042:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c21e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012060:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c21e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012072:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c21e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.012220:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983797 00010000:00010000:2.0:1789395157.012612:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012622:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012629:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012638:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012644:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.012650:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012661:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012676:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.012679:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.012686:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012693:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c210 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.012710:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a5460d3 reply state 00000000f54b5ab6 transno 4294983798 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012724:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012731:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa2c3e279 (ffff89a3ca35fd00) 00010000:00010000:2.0:1789395157.012733:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.012737:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.012925:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c209 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106392 expref: 351 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012944:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c21e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106392 expref: 350 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.012953:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:2.0:1789395157.012955:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.012958:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56600, rc 0) 00000100:00100000:2.0:1789395157.013087:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+351:19219:x1876316231804928:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2953us (3206us total) trans 4294983798 rc 0/0 00000100:00100000:2.0:1789395157.013097:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23657 00000020:00080000:2.0:1789395157.013106:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.018495:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.018583:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231805184 00000100:00100000:0.0:1789395157.018596:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231805184 00000100:00100000:0.0:1789395157.018666:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5154 00000100:00100000:0.0:1789395157.018677:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+351:19219:x1876316231805184:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395157.019055:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983799 00000100:00100000:0.0:1789395157.019181:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+353:19219:x1876316231805184:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 505us (701us total) trans 4294983800 rc 0/0 00000100:00100000:0.0:1789395157.019190:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5154 00000020:00080000:0.0:1789395157.019196:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.023839:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.023991:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231805440 00000100:00100000:2.0:1789395157.024005:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231805440 00000100:00100000:2.0:1789395157.024082:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23658 00000100:00100000:2.0:1789395157.024094:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+353:19219:x1876316231805440:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.024127:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.024164:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c22c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106399 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.024329:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.024347:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.024360:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.024377:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.024427:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.024435:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.025049:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ea:0x0], index 0: 0 00010000:00010000:2.0:1789395157.025274:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025287:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025295:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.025362:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983801 00010000:00010000:2.0:1789395157.025477:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025486:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025493:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025499:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025506:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.025511:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025520:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025535:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.025538:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.025544:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025557:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c233 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.025573:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e02a64e reply state 0000000082c059f6 transno 4294983802 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025586:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025592:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77cd7179 (ffff89a3ca35f600) 00010000:00010000:2.0:1789395157.025595:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.025598:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.025639:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c22c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106399 expref: 357 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025656:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106399 expref: 356 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.025665:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:2.0:1789395157.025668:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.025670:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57800, rc 0) 00000100:00100000:2.0:1789395157.025787:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+357:19219:x1876316231805440:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1695us (1962us total) trans 4294983802 rc 0/0 00000100:00100000:2.0:1789395157.025796:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23658 00000020:00080000:2.0:1789395157.025803:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.031267:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.031558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231805696 00000100:00100000:3.0:1789395157.031571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231805696 00000100:00100000:3.0:1789395157.031653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5155 00000100:00100000:3.0:1789395157.031665:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+357:19219:x1876316231805696:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.032049:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983803 00000100:00100000:3.0:1789395157.032222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+359:19219:x1876316231805696:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 558us (968us total) trans 4294983804 rc 0/0 00000100:00100000:3.0:1789395157.032232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5155 00000020:00080000:3.0:1789395157.032246:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.036776:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.036888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231805952 00000100:00100000:1.0:1789395157.036903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231805952 00000100:00100000:1.0:1789395157.036973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23659 00000100:00100000:1.0:1789395157.036984:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+359:19219:x1876316231805952:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.037013:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.037042:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c24f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037182:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037199:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037217:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037236:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037254:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037262:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.037725:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9eb:0x0], index 1: 0 00010000:00010000:1.0:1789395157.037946:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037957:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.037966:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.038063:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983805 00010000:00010000:1.0:1789395157.038105:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038113:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038120:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038132:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038138:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.038143:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038153:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038168:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.038171:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.038177:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038185:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c256 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.038201:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000315567f1 reply state 0000000091b7bc86 transno 4294983806 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038213:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038219:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe58bac79 (ffff89a4c3ab8b00) 00010000:00010000:1.0:1789395157.038221:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.038224:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.038258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c24f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063a0 expref: 363 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038278:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063a0 expref: 362 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.038285:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff89a4c3ab8400) 00010000:00010000:1.0:1789395157.038287:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.038290:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47d800, rc 0) 00000100:00100000:1.0:1789395157.038375:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+363:19219:x1876316231805952:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1393us (1633us total) trans 4294983806 rc 0/0 00000100:00100000:1.0:1789395157.038415:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23659 00000020:00080000:1.0:1789395157.038422:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.044670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.045109:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231806208 00000100:00100000:1.0:1789395157.045124:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231806208 00000100:00100000:1.0:1789395157.045208:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5156 00000100:00100000:1.0:1789395157.045221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+363:19219:x1876316231806208:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.045613:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983807 00000100:00100000:1.0:1789395157.045748:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+365:19219:x1876316231806208:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 529us (1094us total) trans 4294983808 rc 0/0 00000100:00100000:1.0:1789395157.045757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5156 00000020:00080000:1.0:1789395157.045763:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.049991:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.050109:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231806464 00000100:00100000:0.0:1789395157.050122:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231806464 00000100:00100000:0.0:1789395157.050210:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23660 00000100:00100000:0.0:1789395157.050222:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+365:19219:x1876316231806464:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.050261:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.050288:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c272 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063a7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.050471:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.050489:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.050502:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.050519:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.050529:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.050535:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.050949:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9eb:0x0], index 0: 0 00010000:00010000:0.0:1789395157.051127:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051137:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051146:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.051206:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983809 00010000:00010000:0.0:1789395157.051249:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051258:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051265:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051272:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051278:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.051283:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051293:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051307:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.051310:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.051315:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051322:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c279 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.051337:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be0e3899 reply state 00000000120f5d5f transno 4294983810 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051348:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051355:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8bf53b79 (ffff89a3c8b1d700) 00010000:00010000:0.0:1789395157.051357:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.051360:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.051433:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c272 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063a7 expref: 369 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051447:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063a7 expref: 368 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.051455:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:0.0:1789395157.051458:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.051461:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10da00, rc 0) 00000100:00100000:0.0:1789395157.051548:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+369:19219:x1876316231806464:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1328us (1573us total) trans 4294983810 rc 0/0 00000100:00100000:0.0:1789395157.051557:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23660 00000020:00080000:0.0:1789395157.051563:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.058716:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.058828:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231806720 00000100:00100000:1.0:1789395157.058842:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231806720 00000100:00100000:1.0:1789395157.058925:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5157 00000100:00100000:1.0:1789395157.058938:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+369:19219:x1876316231806720:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.059330:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983811 00000100:00100000:1.0:1789395157.059776:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+371:19219:x1876316231806720:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 829us (1063us total) trans 4294983812 rc 0/0 00000100:00100000:1.0:1789395157.059788:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5157 00000020:00080000:1.0:1789395157.059794:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.064028:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.064143:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231806976 00000100:00100000:1.0:1789395157.064222:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231806976 00000100:00100000:1.0:1789395157.066320:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23661 00000100:00100000:1.0:1789395157.066355:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+371:19219:x1876316231806976:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.066409:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.066443:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c295 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063ae expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.066589:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.066609:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.066624:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.066645:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.066653:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.066661:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.067933:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ec:0x0], index 1: 0 00010000:00010000:1.0:1789395157.068294:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316c2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068314:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316c2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068325:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316c2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.068518:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983813 00010000:00010000:1.0:1789395157.068561:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068570:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068577:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068586:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068593:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.068598:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068607:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068623:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.068626:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.068632:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068638:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c29c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.068654:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092c7184c reply state 00000000a3cdbf89 transno 4294983814 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068666:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068673:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa6a2e1ce (ffff89a4c3ab8f00) 00010000:00010000:1.0:1789395157.068675:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.068678:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.068719:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c295 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ae expref: 375 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068735:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316c2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ae expref: 374 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.068744:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:1.0:1789395157.068746:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.068749:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534400, rc 0) 00000100:00100000:1.0:1789395157.068852:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+375:19219:x1876316231806976:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2515us (4836us total) trans 4294983814 rc 0/0 00000100:00100000:1.0:1789395157.068862:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23661 00000020:00080000:1.0:1789395157.068870:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.073114:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.073324:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231807232 00000100:00100000:3.0:1789395157.073337:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231807232 00000100:00100000:3.0:1789395157.073518:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5158 00000100:00100000:3.0:1789395157.073531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+375:19219:x1876316231807232:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.073898:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983815 00000100:00100000:3.0:1789395157.074023:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+377:19219:x1876316231807232:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 494us (923us total) trans 4294983816 rc 0/0 00000100:00100000:3.0:1789395157.074032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5158 00000020:00080000:3.0:1789395157.074037:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.078042:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.078311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231807488 00000100:00100000:2.0:1789395157.078324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231807488 00000100:00100000:2.0:1789395157.078428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23662 00000100:00100000:2.0:1789395157.078439:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+377:19219:x1876316231807488:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.078468:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.078496:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c2b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.078625:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.078643:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.078658:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.078675:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.078682:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.078689:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.079119:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ec:0x0], index 0: 0 00010000:00010000:2.0:1789395157.079684:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c2cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.079700:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.079709:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.080105:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983817 00010000:00010000:2.0:1789395157.080220:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080229:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080301:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080310:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080317:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.080324:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080333:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080350:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.080353:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.080360:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080367:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.080888:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd6c1fb7 reply state 000000009632f368 transno 4294983818 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080904:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080912:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4d0c70ce (ffff89a3ca35f900) 00010000:00010000:2.0:1789395157.080915:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.080918:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.080967:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c2b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063b5 expref: 381 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080986:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c2cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063b5 expref: 380 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.080994:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:2.0:1789395157.080997:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.080999:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57000, rc 0) 00000100:00100000:2.0:1789395157.081100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+381:19219:x1876316231807488:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2661us (3072us total) trans 4294983818 rc 0/0 00000100:00100000:2.0:1789395157.081110:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23662 00000020:00080000:2.0:1789395157.081117:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.088133:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.088292:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231807744 00000100:00100000:1.0:1789395157.088305:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231807744 00000100:00100000:1.0:1789395157.088379:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5159 00000100:00100000:1.0:1789395157.088426:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+381:19219:x1876316231807744:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.088794:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983819 00000100:00100000:1.0:1789395157.088914:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+383:19219:x1876316231807744:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 489us (791us total) trans 4294983820 rc 0/0 00000100:00100000:1.0:1789395157.088923:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5159 00000020:00080000:1.0:1789395157.088930:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.093302:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.094557:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231808000 00000100:00100000:2.0:1789395157.094576:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231808000 00000100:00100000:2.0:1789395157.094665:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23663 00000100:00100000:2.0:1789395157.094677:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+383:19219:x1876316231808000:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.094713:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.094742:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c2db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063bc expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.094896:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.094915:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.094929:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.094961:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.094969:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.094976:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.095633:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ed:0x0], index 1: 0 00010000:00010000:2.0:1789395157.095871:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d000/0xff35729af316c2f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.095884:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d000/0xff35729af316c2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.095892:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d000/0xff35729af316c2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.095960:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983821 00010000:00010000:2.0:1789395157.096003:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096012:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096019:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096026:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096033:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.096038:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096046:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096061:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.096064:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.096070:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096077:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c2e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.096094:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb78dfbc reply state 00000000e4a9a86e transno 4294983822 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096110:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096116:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe8b99bce (ffff89a3ca35f300) 00010000:00010000:2.0:1789395157.096119:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.096122:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.096171:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c2db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063bc expref: 387 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096187:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d000/0xff35729af316c2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063bc expref: 386 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.096195:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff89a3ca35fb00) 00010000:00010000:2.0:1789395157.096198:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.096200:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37d000, rc 0) 00000100:00100000:2.0:1789395157.096900:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+387:19219:x1876316231808000:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2218us (3606us total) trans 4294983822 rc 0/0 00000100:00100000:2.0:1789395157.096911:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23663 00000020:00080000:2.0:1789395157.096920:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.105265:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.105343:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231808256 00000100:00100000:3.0:1789395157.105356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231808256 00000100:00100000:3.0:1789395157.105455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5160 00000100:00100000:3.0:1789395157.105466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+387:19219:x1876316231808256:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.105800:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983823 00000100:00100000:3.0:1789395157.105911:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+389:19219:x1876316231808256:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 445us (658us total) trans 4294983824 rc 0/0 00000100:00100000:3.0:1789395157.105919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5160 00000020:00080000:3.0:1789395157.105925:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.118713:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.118806:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231808512 00000100:00100000:1.0:1789395157.118820:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231808512 00000100:00100000:1.0:1789395157.118903:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23664 00000100:00100000:1.0:1789395157.118916:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+389:19219:x1876316231808512:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.118950:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.118985:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c2fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063c3 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.119131:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.119183:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.119198:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.119215:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.119223:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.119229:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.121350:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ed:0x0], index 0: 0 00010000:00010000:1.0:1789395157.121667:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bace00/0xff35729af316c313 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121687:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bace00/0xff35729af316c313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121701:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bace00/0xff35729af316c313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.121809:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983825 00010000:00010000:1.0:1789395157.121866:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121874:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121881:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121889:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121895:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.121900:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121909:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121924:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.121927:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.121934:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121945:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c305 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.121970:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f758a1e8 reply state 00000000a3d2d1ed transno 4294983826 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121983:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.121990:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x91a3d2ce (ffff89a4c3ab8d00) 00010000:00010000:1.0:1789395157.121992:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.121996:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.122045:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c2fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063c3 expref: 393 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.122062:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bace00/0xff35729af316c313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063c3 expref: 392 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.122070:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff89a4c3ab8900) 00010000:00010000:1.0:1789395157.122073:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.122076:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bace00, rc 0) 00000100:00100000:1.0:1789395157.122191:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+393:19219:x1876316231808512:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3276us (3493us total) trans 4294983826 rc 0/0 00000100:00100000:1.0:1789395157.122201:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23664 00000020:00080000:1.0:1789395157.122209:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.127947:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.128028:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231808768 00000100:00100000:3.0:1789395157.128041:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231808768 00000100:00100000:3.0:1789395157.128111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5161 00000100:00100000:3.0:1789395157.128123:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+393:19219:x1876316231808768:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.128515:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983827 00000100:00100000:3.0:1789395157.128700:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+395:19219:x1876316231808768:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 578us (767us total) trans 4294983828 rc 0/0 00000100:00100000:3.0:1789395157.128710:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5161 00000020:00080000:3.0:1789395157.128716:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.135460:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.135764:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231809024 00000100:00100000:2.0:1789395157.135883:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231809024 00000100:00100000:2.0:1789395157.136010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23665 00000100:00100000:2.0:1789395157.136022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+395:19219:x1876316231809024:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.136048:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.136069:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c321 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063ca expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.136187:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.136202:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.136213:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.136227:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.136354:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.136364:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.137098:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ee:0x0], index 1: 0 00010000:00010000:2.0:1789395157.137468:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37de00/0xff35729af316c336 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137480:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37de00/0xff35729af316c336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137489:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37de00/0xff35729af316c336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.137554:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983829 00010000:00010000:2.0:1789395157.137590:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137602:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137609:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137616:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137622:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.137627:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137635:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137648:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.137651:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.137656:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137663:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c328 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.137757:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d78df221 reply state 00000000630de8a9 transno 4294983830 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137901:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137912:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0d0fdce (ffff89a3ca35fe00) 00010000:00010000:2.0:1789395157.137916:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.137919:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.137957:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c321 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ca expref: 399 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137972:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37de00/0xff35729af316c336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ca expref: 398 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.137979:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:2.0:1789395157.137982:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.137984:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37de00, rc 0) 00000100:00100000:2.0:1789395157.138059:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+399:19219:x1876316231809024:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2039us (2607us total) trans 4294983830 rc 0/0 00000100:00100000:2.0:1789395157.138068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23665 00000020:00080000:2.0:1789395157.138073:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.144046:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.144159:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231809280 00000100:00100000:1.0:1789395157.144172:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231809280 00000100:00100000:1.0:1789395157.144327:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5162 00000100:00100000:1.0:1789395157.144340:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+399:19219:x1876316231809280:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.144688:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983831 00000100:00100000:1.0:1789395157.144812:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+401:19219:x1876316231809280:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 475us (779us total) trans 4294983832 rc 0/0 00000100:00100000:1.0:1789395157.148028:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5162 00000020:00080000:1.0:1789395157.148044:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.149566:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.149685:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231809536 00000100:00100000:2.0:1789395157.149701:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231809536 00000100:00100000:2.0:1789395157.149801:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23666 00000100:00100000:2.0:1789395157.149812:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+401:19219:x1876316231809536:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.149839:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.149862:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c344 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063d1 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.149972:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.149986:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150001:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150015:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150023:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150030:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.150342:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ee:0x0], index 0: 0 00010000:00010000:2.0:1789395157.150546:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d400/0xff35729af316c359 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150557:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d400/0xff35729af316c359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150564:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d400/0xff35729af316c359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.150620:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983833 00010000:00010000:2.0:1789395157.150659:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150666:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150674:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150684:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150690:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.150694:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150702:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150714:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.150717:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.150722:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150728:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c34b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.150741:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002032de1e reply state 00000000eeb54273 transno 4294983834 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150750:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150755:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95b00cce (ffff89a3ca2fb500) 00010000:00010000:2.0:1789395157.150757:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.150759:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.150804:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c344 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063d1 expref: 405 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150824:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d400/0xff35729af316c359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063d1 expref: 404 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.150831:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:2.0:1789395157.150833:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.150835:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37d400, rc 0) 00000100:00100000:2.0:1789395157.150907:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+405:19219:x1876316231809536:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1097us (1353us total) trans 4294983834 rc 0/0 00000100:00100000:2.0:1789395157.150914:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23666 00000020:00080000:2.0:1789395157.150920:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.158153:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.158345:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231809792 00000100:00100000:2.0:1789395157.158361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231809792 00000100:00100000:2.0:1789395157.158468:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5163 00000100:00100000:2.0:1789395157.158478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+405:19219:x1876316231809792:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.158734:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983835 00000100:00100000:2.0:1789395157.158911:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+407:19219:x1876316231809792:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 434us (781us total) trans 4294983836 rc 0/0 00000100:00100000:2.0:1789395157.159083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5163 00000020:00080000:2.0:1789395157.159091:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.163031:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.163189:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231810048 00000100:00100000:1.0:1789395157.163201:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231810048 00000100:00100000:1.0:1789395157.163279:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23667 00000100:00100000:1.0:1789395157.163292:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+407:19219:x1876316231810048:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.163325:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.163352:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c367 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063d8 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.163535:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.163554:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.163568:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.163584:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.163592:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.163603:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.164339:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ef:0x0], index 1: 0 00010000:00010000:1.0:1789395157.164635:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac000/0xff35729af316c37c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164650:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac000/0xff35729af316c37c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164659:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac000/0xff35729af316c37c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.164728:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983837 00010000:00010000:1.0:1789395157.164779:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164787:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164795:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164802:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164809:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9baca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.164814:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164822:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164838:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.164841:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.164847:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164853:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c36e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.164870:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bca4d61 reply state 000000008582818e transno 4294983838 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164881:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164887:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd0dd37ce (ffff89a4c3ab8200) 00010000:00010000:1.0:1789395157.164890:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.164893:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.164931:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c367 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063d8 expref: 411 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.164946:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac000/0xff35729af316c37c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063d8 expref: 410 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.165198:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff89a4c3ab8c00) 00010000:00010000:1.0:1789395157.165201:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.165204:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bac000, rc 0) 00000100:00100000:1.0:1789395157.165499:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+411:19219:x1876316231810048:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2207us (2479us total) trans 4294983838 rc 0/0 00000100:00100000:1.0:1789395157.165507:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23667 00000020:00080000:1.0:1789395157.165515:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.172185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.172684:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231810304 00000100:00100000:1.0:1789395157.172698:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231810304 00000100:00100000:1.0:1789395157.172895:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5164 00000100:00100000:1.0:1789395157.172908:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+411:19219:x1876316231810304:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.173308:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983839 00000100:00100000:1.0:1789395157.173466:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+413:19219:x1876316231810304:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 560us (1294us total) trans 4294983840 rc 0/0 00000100:00100000:1.0:1789395157.173476:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5164 00000020:00080000:1.0:1789395157.173482:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.177818:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.177919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231810560 00000100:00100000:2.0:1789395157.177934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231810560 00000100:00100000:2.0:1789395157.178006:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23668 00000100:00100000:2.0:1789395157.178017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+413:19219:x1876316231810560:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.178047:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.178074:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c38a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178225:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178266:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178283:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178290:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178296:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.178732:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ef:0x0], index 0: 0 00010000:00010000:2.0:1789395157.178940:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c000/0xff35729af316c39f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178952:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c000/0xff35729af316c39f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.178961:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c000/0xff35729af316c39f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.179028:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983841 00010000:00010000:2.0:1789395157.179068:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179081:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179088:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179095:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179102:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.179106:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179116:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179131:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.179135:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.179140:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179148:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c391 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.179163:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000413abc1e reply state 00000000db6205d3 transno 4294983842 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179175:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179180:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77c76ece (ffff89a3ca2fba00) 00010000:00010000:2.0:1789395157.179183:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.179186:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.179222:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c38a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063df expref: 417 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179237:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c000/0xff35729af316c39f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063df expref: 416 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.179244:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff89a3ca2fb700) 00010000:00010000:2.0:1789395157.179246:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.179248:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37c000, rc 0) 00000100:00100000:2.0:1789395157.179339:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+417:19219:x1876316231810560:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1323us (1535us total) trans 4294983842 rc 0/0 00000100:00100000:2.0:1789395157.179346:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23668 00000020:00080000:2.0:1789395157.179352:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.183227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.183473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231810816 00000100:00100000:2.0:1789395157.183487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231810816 00000100:00100000:2.0:1789395157.183658:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5165 00000100:00100000:2.0:1789395157.183672:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+417:19219:x1876316231810816:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.184034:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983843 00000100:00100000:2.0:1789395157.184164:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+419:19219:x1876316231810816:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 494us (951us total) trans 4294983844 rc 0/0 00000100:00100000:2.0:1789395157.184172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5165 00000020:00080000:2.0:1789395157.184179:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.188187:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.188270:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231811072 00000100:00100000:1.0:1789395157.188283:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231811072 00000100:00100000:1.0:1789395157.188361:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23669 00000100:00100000:1.0:1789395157.188373:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+419:19219:x1876316231811072:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.188437:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.188464:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c3ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063e6 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.188814:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.188834:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.188848:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.188865:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.188878:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.188885:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.191001:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f0:0x0], index 1: 0 00010000:00010000:1.0:1789395157.191310:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad800/0xff35729af316c3c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191331:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad800/0xff35729af316c3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191345:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad800/0xff35729af316c3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.191506:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983845 00010000:00010000:1.0:1789395157.191555:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191575:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191582:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191590:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191597:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9baca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.191602:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191622:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191638:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.191642:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.191648:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191685:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.191701:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051eb1e41 reply state 000000009eeb7616 transno 4294983846 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191714:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191721:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe585a9ce (ffff89a4c3ab8a00) 00010000:00010000:1.0:1789395157.191724:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.191727:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.191781:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c3ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063e6 expref: 423 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191800:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad800/0xff35729af316c3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063e6 expref: 422 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.191809:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff89a4c3ab8800) 00010000:00010000:1.0:1789395157.191811:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.191814:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bad800, rc 0) 00000100:00100000:1.0:1789395157.191910:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+423:19219:x1876316231811072:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3538us (3736us total) trans 4294983846 rc 0/0 00000100:00100000:1.0:1789395157.191920:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23669 00000020:00080000:1.0:1789395157.191927:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.201965:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.202031:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231811328 00000100:00100000:1.0:1789395157.202045:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231811328 00000100:00100000:1.0:1789395157.202119:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5166 00000100:00100000:1.0:1789395157.202131:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+423:19219:x1876316231811328:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.202527:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983847 00000100:00100000:1.0:1789395157.202672:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+425:19219:x1876316231811328:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 542us (720us total) trans 4294983848 rc 0/0 00000100:00100000:1.0:1789395157.202682:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5166 00000020:00080000:1.0:1789395157.202687:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.212282:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.213155:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231811584 00000100:00100000:1.0:1789395157.213171:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231811584 00000100:00100000:1.0:1789395157.213255:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23670 00000100:00100000:1.0:1789395157.213268:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+425:19219:x1876316231811584:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.213298:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.213326:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c3d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063ed expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.213519:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.213537:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.213551:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.213571:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.213578:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.213585:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.216110:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f0:0x0], index 0: 0 00010000:00010000:1.0:1789395157.216475:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad000/0xff35729af316c3e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216495:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad000/0xff35729af316c3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216507:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad000/0xff35729af316c3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.216602:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983849 00010000:00010000:1.0:1789395157.216649:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216659:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216667:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216674:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216686:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9baca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.216691:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216701:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216717:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.216719:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.216725:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216733:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c3d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.216751:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad514134 reply state 0000000080693d7e transno 4294983850 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216764:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216782:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4de4b8ce (ffff89a4d0654f00) 00010000:00010000:1.0:1789395157.216784:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.216788:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.216835:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c3d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ed expref: 429 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216853:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad000/0xff35729af316c3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ed expref: 428 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.216866:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff89a4d0654000) 00010000:00010000:1.0:1789395157.216869:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.216871:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bad000, rc 0) 00000100:00100000:1.0:1789395157.216962:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+429:19219:x1876316231811584:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3697us (4693us total) trans 4294983850 rc 0/0 00000100:00100000:1.0:1789395157.216972:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23670 00000020:00080000:1.0:1789395157.216979:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.227973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.228076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231811840 00000100:00100000:1.0:1789395157.228091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231811840 00000100:00100000:1.0:1789395157.228170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5167 00000100:00100000:1.0:1789395157.228184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+429:19219:x1876316231811840:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.228617:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983851 00000100:00100000:1.0:1789395157.229826:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+431:19219:x1876316231811840:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1635us (1857us total) trans 4294983852 rc 0/0 00000100:00100000:1.0:1789395157.229840:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5167 00000020:00080000:1.0:1789395157.229848:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.235909:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.236016:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231812096 00000100:00100000:2.0:1789395157.236029:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231812096 00000100:00100000:2.0:1789395157.236093:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23671 00000100:00100000:2.0:1789395157.236106:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+431:19219:x1876316231812096:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.236138:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.236164:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c3f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.236314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.236330:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.236352:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.236372:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.236379:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.236473:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.237537:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f1:0x0], index 1: 0 00010000:00010000:2.0:1789395157.237872:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c400/0xff35729af316c408 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.237887:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c400/0xff35729af316c408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.237897:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c400/0xff35729af316c408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.237965:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983853 00010000:00010000:2.0:1789395157.238009:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238017:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238025:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238032:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238039:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.238045:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238053:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238068:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.238071:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.238076:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238083:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c3fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.238098:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c446f9ef reply state 00000000dc78943e transno 4294983854 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238114:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238120:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5501ae7b (ffff89a3ca2fb400) 00010000:00010000:2.0:1789395157.238122:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.238125:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.238161:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c3f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063f4 expref: 435 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238175:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c400/0xff35729af316c408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063f4 expref: 434 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.238182:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:2.0:1789395157.238184:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.238187:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37c400, rc 0) 00000100:00100000:2.0:1789395157.238538:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+435:19219:x1876316231812096:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2432us (2641us total) trans 4294983854 rc 0/0 00000100:00100000:2.0:1789395157.238547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23671 00000020:00080000:2.0:1789395157.238554:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.258254:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.258363:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231812352 00000100:00100000:1.0:1789395157.258376:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231812352 00000100:00100000:1.0:1789395157.258483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5168 00000100:00100000:1.0:1789395157.258495:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+435:19219:x1876316231812352:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.258867:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983855 00000100:00100000:1.0:1789395157.258984:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+437:19219:x1876316231812352:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 490us (755us total) trans 4294983856 rc 0/0 00000100:00100000:1.0:1789395157.258994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5168 00000020:00080000:1.0:1789395157.259000:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.268661:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.268848:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231812608 00000100:00100000:1.0:1789395157.268862:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231812608 00000100:00100000:1.0:1789395157.269269:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23672 00000100:00100000:1.0:1789395157.269283:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+437:19219:x1876316231812608:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.269317:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.269357:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c416 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021063fb expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.269553:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.269571:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.269584:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.269614:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.269621:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.269628:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.270076:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f1:0x0], index 0: 0 00010000:00010000:1.0:1789395157.270287:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac600/0xff35729af316c42b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270297:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac600/0xff35729af316c42b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270306:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac600/0xff35729af316c42b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.270367:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983857 00010000:00010000:1.0:1789395157.270447:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270455:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270463:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270470:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270477:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9baca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.270482:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270492:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270507:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.270510:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.270516:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270523:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c41d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.270542:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a51f9a1 reply state 00000000eb08b027 transno 4294983858 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270554:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270560:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3d7b (ffff89a4d0654900) 00010000:00010000:1.0:1789395157.270562:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.270565:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.270599:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c416 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063fb expref: 441 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270614:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac600/0xff35729af316c42b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063fb expref: 440 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.270622:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff89a4d0654c00) 00010000:00010000:1.0:1789395157.270624:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.270626:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bac600, rc 0) 00000100:00100000:1.0:1789395157.270721:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+441:19219:x1876316231812608:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1442us (2075us total) trans 4294983858 rc 0/0 00000100:00100000:1.0:1789395157.270729:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23672 00000020:00080000:1.0:1789395157.270736:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.281627:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.281726:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231812864 00000100:00100000:1.0:1789395157.281750:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231812864 00000100:00100000:1.0:1789395157.281830:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5169 00000100:00100000:1.0:1789395157.281843:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+441:19219:x1876316231812864:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.282190:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983859 00000100:00100000:1.0:1789395157.282555:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+443:19219:x1876316231812864:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 712us (939us total) trans 4294983860 rc 0/0 00000100:00100000:1.0:1789395157.282565:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5169 00000020:00080000:1.0:1789395157.282571:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.293095:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.293289:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231813120 00000100:00100000:1.0:1789395157.293302:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231813120 00000100:00100000:1.0:1789395157.293375:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23673 00000100:00100000:1.0:1789395157.293419:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+443:19219:x1876316231813120:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.293448:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.293473:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c439 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106402 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.293592:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.293608:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.293618:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.293629:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.293634:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.293638:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.294147:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f2:0x0], index 1: 0 00000100:00100000:2.0:1789395157.295205:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876316239734016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789395157.295285:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395157.295355:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c7a34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789395157.296341:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734016 00000100:00100000:3.0:1789395157.296354:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734016 00000100:00100000:3.0:1789395157.296454:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5241 00000100:00100000:3.0:1789395157.296466:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:10002:x1876316239734016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789395157.296520:0:14639:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2562 00010000:00010000:1.0:1789395157.297207:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad200/0xff35729af316c44e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297229:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad200/0xff35729af316c44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297255:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad200/0xff35729af316c44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.297358:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983861 00010000:00010000:1.0:1789395157.297425:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297433:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297440:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297447:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297453:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9baca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.297459:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297467:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297482:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.297486:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.297492:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297505:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c440 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.297521:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075c8d613 reply state 000000008ddc4352 transno 4294983862 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297534:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297541:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x170e687b (ffff89a4d0654800) 00010000:00010000:1.0:1789395157.297544:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.297547:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.297591:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c439 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106402 expref: 447 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297608:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad200/0xff35729af316c44e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106402 expref: 446 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.297615:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff89a4d0654100) 00010000:00010000:1.0:1789395157.297618:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.297621:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bad200, rc 0) 00000100:00100000:1.0:1789395157.297706:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+447:19219:x1876316231813120:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4322us (4627us total) trans 4294983862 rc 0/0 00000100:00100000:1.0:1789395157.297715:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23673 00000020:00080000:1.0:1789395157.297721:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.301499:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:10002:x1876316239734016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5026us (6204us total) trans 4294969900 rc 0/0 00000100:00100000:3.0:1789395157.301514:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5241 00000100:00100000:2.0:1789395157.304616:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10002:1876316239734016:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789395157.304646:0:10002:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9f2:0x0]-[0x2c0000401:0xa21:0x0] 00000100:00100000:3.0:1789395157.310859:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.311028:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231813376 00000100:00100000:2.0:1789395157.311043:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231813376 00000100:00100000:2.0:1789395157.311122:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5170 00000100:00100000:2.0:1789395157.311134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+447:19219:x1876316231813376:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.311575:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983863 00000100:00100000:2.0:1789395157.311708:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+449:19219:x1876316231813376:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 575us (872us total) trans 4294983864 rc 0/0 00000100:00100000:2.0:1789395157.311717:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5170 00000020:00080000:2.0:1789395157.311723:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.316345:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.316490:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231813632 00000100:00100000:2.0:1789395157.316503:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231813632 00000100:00100000:2.0:1789395157.316580:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23674 00000100:00100000:2.0:1789395157.316592:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+449:19219:x1876316231813632:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.316622:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.316649:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c45c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106409 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.316796:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.316814:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.316828:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.316846:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.316854:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.316867:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.317350:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f2:0x0], index 0: 0 00000100:00100000:3.0:1789395157.317704:0:8904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1876316239734144:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789395157.317799:0:8904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395157.317843:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734144 00000100:00100000:3.0:1789395157.317865:0:8904:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca06a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395157.317915:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734144 00000100:00100000:0.0:1789395157.317987:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242 00000100:00100000:0.0:1789395157.317997:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8904:x1876316239734144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789395157.318049:0:10007:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2562 00010000:00010000:1.0:1789395157.319021:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319043:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319056:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.319140:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983865 00010000:00010000:1.0:1789395157.319307:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319316:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319322:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319330:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319336:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.319341:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319349:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319365:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.319368:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.319374:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319381:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c463 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.319427:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdf0e83c reply state 000000008174ecd6 transno 4294983866 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319438:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319445:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95f89f7b (ffff89a3ca2fb100) 00010000:00010000:1.0:1789395157.319448:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.319450:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.319490:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c45c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106409 expref: 453 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319505:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106409 expref: 452 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.319513:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff89a4d0654700) 00010000:00010000:1.0:1789395157.319516:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.319518:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bac800, rc 0) 00000100:00100000:1.0:1789395157.319663:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+453:19219:x1876316231813632:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3072us (3331us total) trans 4294983866 rc 0/0 00000100:00100000:1.0:1789395157.319673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23674 00000020:00080000:1.0:1789395157.319679:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.324987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.325174:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231813888 00000100:00100000:1.0:1789395157.325187:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231813888 00000100:00100000:1.0:1789395157.325267:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5171 00000100:00100000:1.0:1789395157.325282:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+453:19219:x1876316231813888:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.325647:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983867 00000100:00100000:1.0:1789395157.325809:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+455:19219:x1876316231813888:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 528us (832us total) trans 4294983868 rc 0/0 00000100:00100000:1.0:1789395157.325818:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5171 00000020:00080000:1.0:1789395157.325825:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.326313:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8904:x1876316239734144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8311us (8506us total) trans 4294969901 rc 0/0 00000100:00100000:0.0:1789395157.326326:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242 00000100:00100000:3.0:1789395157.326472:0:8904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1876316239734144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789395157.326492:0:8904:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9f2:0x0]-[0x280000401:0xa21:0x0] 00000100:00100000:3.0:1789395157.332026:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.332213:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231814144 00000100:00100000:1.0:1789395157.332226:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231814144 00000100:00100000:1.0:1789395157.332310:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23675 00000100:00100000:1.0:1789395157.332322:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+455:19219:x1876316231814144:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.332353:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.332382:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c47f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106410 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.332567:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.332587:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.332601:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.332619:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.332626:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.332633:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.333059:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f3:0x0], index 1: 0 00010000:00010000:1.0:1789395157.333263:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333275:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333283:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.333346:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983869 00010000:00010000:1.0:1789395157.333420:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333429:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333436:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333445:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333453:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bac400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.333458:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333467:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333481:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.333485:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.333490:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333503:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c486 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.333519:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009393589 reply state 00000000fa1104aa transno 4294983870 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333531:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333537:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd905ca7b (ffff89a4d0654200) 00010000:00010000:1.0:1789395157.333539:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.333542:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.333578:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c47f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106410 expref: 459 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333594:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106410 expref: 458 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.333602:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff89a4d0654400) 00010000:00010000:1.0:1789395157.333605:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.333608:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca47de00, rc 0) 00000100:00100000:1.0:1789395157.333695:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+459:19219:x1876316231814144:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1374us (1684us total) trans 4294983870 rc 0/0 00000100:00100000:1.0:1789395157.333706:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23675 00000020:00080000:1.0:1789395157.333712:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.339474:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.339654:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231814400 00000100:00100000:3.0:1789395157.339672:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231814400 00000100:00100000:3.0:1789395157.339744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5172 00000100:00100000:3.0:1789395157.339761:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+459:19219:x1876316231814400:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.340135:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983871 00000100:00100000:3.0:1789395157.340353:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+461:19219:x1876316231814400:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 596us (886us total) trans 4294983872 rc 0/0 00000100:00100000:3.0:1789395157.340362:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5172 00000020:00080000:3.0:1789395157.340370:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.343465:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.343540:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231814656 00000100:00100000:1.0:1789395157.343556:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231814656 00000100:00100000:1.0:1789395157.343648:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23676 00000100:00100000:1.0:1789395157.343661:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+461:19219:x1876316231814656:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.343693:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.343721:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106417 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.343973:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.343991:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344004:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344022:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344029:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344035:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.344555:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f3:0x0], index 0: 0 00010000:00010000:1.0:1789395157.344786:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316c4b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344799:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316c4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344807:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316c4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.344873:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983873 00010000:00010000:1.0:1789395157.344917:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344926:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344934:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344941:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344948:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.344953:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344962:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344976:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.344979:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.344985:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.344993:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.345010:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b99d888 reply state 000000000edeb61f transno 4294983874 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.345027:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.345033:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xee04d97b (ffff89a4d0654e00) 00010000:00010000:1.0:1789395157.345036:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.345039:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.345083:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106417 expref: 465 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.345100:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316c4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106417 expref: 464 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.345109:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff89a3ca1c2000) 00010000:00010000:1.0:1789395157.345111:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.345113:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4c148b400, rc 0) 00000100:00100000:1.0:1789395157.345208:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+465:19219:x1876316231814656:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1548us (1751us total) trans 4294983874 rc 0/0 00000100:00100000:1.0:1789395157.345218:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23676 00000020:00080000:1.0:1789395157.345224:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.349956:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.350042:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231814912 00000100:00100000:1.0:1789395157.350056:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231814912 00000100:00100000:1.0:1789395157.350123:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5173 00000100:00100000:1.0:1789395157.350134:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a48c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+465:19219:x1876316231814912:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.350520:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983875 00000100:00100000:1.0:1789395157.350629:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a48c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+467:19219:x1876316231814912:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 496us (688us total) trans 4294983876 rc 0/0 00000100:00100000:1.0:1789395157.350643:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5173 00000020:00080000:1.0:1789395157.350647:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.354664:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.354782:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231815168 00000100:00100000:1.0:1789395157.354794:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231815168 00000100:00100000:1.0:1789395157.354877:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23677 00000100:00100000:1.0:1789395157.354889:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+467:19219:x1876316231815168:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.354920:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.354947:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210641e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.355082:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.355099:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.355113:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.355131:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.355139:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.355146:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.355834:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f4:0x0], index 1: 0 00010000:00010000:1.0:1789395157.356045:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c4da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356059:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356068:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.356131:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983877 00010000:00010000:1.0:1789395157.356721:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356732:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356739:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356747:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356754:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.356760:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356778:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356794:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.356797:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.356802:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356810:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c4cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.356830:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031b0dd99 reply state 00000000c4e4a815 transno 4294983878 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356843:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356860:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdfb2047b (ffff89a3ca1c2d00) 00010000:00010000:1.0:1789395157.356863:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.356866:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.356913:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c4c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210641e expref: 471 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356930:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c4da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210641e expref: 470 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.356938:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff89a3ca1c2c00) 00010000:00010000:1.0:1789395157.356941:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.356944:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9bac400, rc 0) 00000100:00100000:1.0:1789395157.357042:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+471:19219:x1876316231815168:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2155us (2392us total) trans 4294983878 rc 0/0 00000100:00100000:1.0:1789395157.357052:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23677 00000020:00080000:1.0:1789395157.357059:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.362319:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.362613:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231815424 00000100:00100000:3.0:1789395157.362626:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231815424 00000100:00100000:3.0:1789395157.362695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5174 00000100:00100000:3.0:1789395157.362708:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+471:19219:x1876316231815424:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.363097:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983879 00000100:00100000:3.0:1789395157.363229:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+473:19219:x1876316231815424:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 521us (922us total) trans 4294983880 rc 0/0 00000100:00100000:3.0:1789395157.364036:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5174 00000020:00080000:3.0:1789395157.364046:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.367308:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.367435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231815680 00000100:00100000:3.0:1789395157.367449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231815680 00000100:00100000:3.0:1789395157.367523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23678 00000100:00100000:3.0:1789395157.367534:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+473:19219:x1876316231815680:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.367565:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.367590:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c4e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106425 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.367737:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.367755:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.367776:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.367828:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.367837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.367845:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395157.368286:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f4:0x0], index 0: 0 00010000:00010000:3.0:1789395157.369022:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316c4fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369038:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316c4fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369048:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316c4fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395157.369125:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983881 00010000:00010000:3.0:1789395157.369478:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369489:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369496:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369503:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369510:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.369515:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369525:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369541:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.369544:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.369550:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369558:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c4ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.369576:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d22b1d7a reply state 000000001d519edd transno 4294983882 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369592:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369599:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x869c3b7b (ffff89a4c8e8db00) 00010000:00010000:3.0:1789395157.369602:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.369604:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.369649:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c4e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106425 expref: 477 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369666:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316c4fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106425 expref: 476 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.369675:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff89a4c8e8d000) 00010000:00010000:3.0:1789395157.369677:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395157.369680:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca014c00, rc 0) 00000100:00100000:3.0:1789395157.369829:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+477:19219:x1876316231815680:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2295us (2534us total) trans 4294983882 rc 0/0 00000100:00100000:3.0:1789395157.369840:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23678 00000020:00080000:3.0:1789395157.369856:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.374484:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.374608:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231815936 00000100:00100000:1.0:1789395157.374622:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231815936 00000100:00100000:1.0:1789395157.374685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5175 00000100:00100000:1.0:1789395157.374696:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+477:19219:x1876316231815936:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.375062:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983883 00000100:00100000:1.0:1789395157.375200:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+479:19219:x1876316231815936:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 504us (732us total) trans 4294983884 rc 0/0 00000100:00100000:1.0:1789395157.375208:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5175 00000020:00080000:1.0:1789395157.375215:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.379678:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.379789:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231816192 00000100:00100000:2.0:1789395157.379803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231816192 00000100:00100000:2.0:1789395157.379877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23679 00000100:00100000:2.0:1789395157.379889:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+479:19219:x1876316231816192:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.379921:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.379949:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c50b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210642c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380087:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380105:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380118:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380136:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380161:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380169:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.380660:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f5:0x0], index 1: 0 00010000:00010000:2.0:1789395157.380891:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c520 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380903:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.380912:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.380979:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983885 00010000:00010000:2.0:1789395157.381020:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381029:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381037:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381046:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381052:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.381058:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381069:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381085:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.381088:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.381093:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381101:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c512 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.381117:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054e44e5f reply state 00000000e71ddbc7 transno 4294983886 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381130:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381137:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9bba767b (ffff89a3ca2fb300) 00010000:00010000:2.0:1789395157.381139:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.381142:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.381178:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c50b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210642c expref: 483 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381197:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210642c expref: 482 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.381205:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:2.0:1789395157.381208:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.381210:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37c600, rc 0) 00000100:00100000:2.0:1789395157.381299:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+483:19219:x1876316231816192:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1412us (1637us total) trans 4294983886 rc 0/0 00000100:00100000:2.0:1789395157.381308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23679 00000020:00080000:2.0:1789395157.381315:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.386758:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.386888:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231816448 00000100:00100000:1.0:1789395157.386902:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231816448 00000100:00100000:1.0:1789395157.386972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5176 00000100:00100000:1.0:1789395157.386985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+483:19219:x1876316231816448:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.387554:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983887 00000100:00100000:1.0:1789395157.387676:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+485:19219:x1876316231816448:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 691us (933us total) trans 4294983888 rc 0/0 00000100:00100000:1.0:1789395157.387687:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5176 00000020:00080000:1.0:1789395157.387694:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.392493:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.392584:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231816704 00000100:00100000:1.0:1789395157.392595:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231816704 00000100:00100000:1.0:1789395157.392696:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23680 00000100:00100000:1.0:1789395157.392710:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+485:19219:x1876316231816704:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.392748:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.392787:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c52e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106433 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.392925:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.392944:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.392958:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.392977:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.392984:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.392990:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.393524:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f5:0x0], index 0: 0 00010000:00010000:1.0:1789395157.393719:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0ca00/0xff35729af316c543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393731:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0ca00/0xff35729af316c543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393740:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0ca00/0xff35729af316c543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.393813:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983889 00010000:00010000:1.0:1789395157.393854:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393862:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393869:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393876:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393886:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.393891:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393899:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393914:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.393917:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.393922:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393929:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c535 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.393946:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006927cd2a reply state 00000000381882b4 transno 4294983890 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393958:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.393965:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b9857b (ffff89a3ca1c2900) 00010000:00010000:1.0:1789395157.393967:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.393969:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.394006:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c52e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106433 expref: 489 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.394022:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0ca00/0xff35729af316c543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106433 expref: 488 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.394035:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff89a3ca1c2800) 00010000:00010000:1.0:1789395157.394037:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.394039:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4fbd0ca00, rc 0) 00000100:00100000:1.0:1789395157.394129:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+489:19219:x1876316231816704:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1423us (1651us total) trans 4294983890 rc 0/0 00000100:00100000:1.0:1789395157.394140:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23680 00000020:00080000:1.0:1789395157.394146:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.403523:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.403638:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231816960 00000100:00100000:2.0:1789395157.403652:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231816960 00000100:00100000:2.0:1789395157.403730:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5177 00000100:00100000:2.0:1789395157.403741:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+489:19219:x1876316231816960:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.404098:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983891 00000100:00100000:2.0:1789395157.405445:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+491:19219:x1876316231816960:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1696us (1927us total) trans 4294983892 rc 0/0 00000100:00100000:2.0:1789395157.405459:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5177 00000020:00080000:2.0:1789395157.405468:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.410867:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.410956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231817216 00000100:00100000:3.0:1789395157.410970:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231817216 00000100:00100000:3.0:1789395157.411072:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23681 00000100:00100000:3.0:1789395157.411083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+491:19219:x1876316231817216:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.411120:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.411153:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c551 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210643a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.411296:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.411315:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.411328:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.411344:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.411352:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.411359:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395157.411907:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f6:0x0], index 1: 0 00010000:00010000:3.0:1789395157.412123:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412135:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412144:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395157.412209:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983893 00010000:00010000:3.0:1789395157.412249:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412262:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412269:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412276:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412282:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.412287:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412296:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412310:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.412314:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.412320:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c558 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.412344:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d5d1535 reply state 0000000086ee3765 transno 4294983894 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412356:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412362:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb4d1abd0 (ffff89a4c8e8d400) 00010000:00010000:3.0:1789395157.412366:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.412369:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.412451:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c551 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210643a expref: 495 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412466:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c566 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210643a expref: 494 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.412474:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff89a4c8e8df00) 00010000:00010000:3.0:1789395157.412476:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395157.412478:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca015e00, rc 0) 00000100:00100000:3.0:1789395157.412569:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+495:19219:x1876316231817216:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1488us (1716us total) trans 4294983894 rc 0/0 00000100:00100000:3.0:1789395157.412577:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23681 00000020:00080000:3.0:1789395157.412583:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.416833:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.417013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231817472 00000100:00100000:1.0:1789395157.417026:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231817472 00000100:00100000:1.0:1789395157.417360:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5178 00000100:00100000:1.0:1789395157.417374:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+495:19219:x1876316231817472:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.417783:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983895 00000100:00100000:1.0:1789395157.417932:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+497:19219:x1876316231817472:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 560us (1113us total) trans 4294983896 rc 0/0 00000100:00100000:1.0:1789395157.417942:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5178 00000020:00080000:1.0:1789395157.417947:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.422250:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.422468:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231817728 00000100:00100000:2.0:1789395157.422481:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231817728 00000100:00100000:2.0:1789395157.422556:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23682 00000100:00100000:2.0:1789395157.422568:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+497:19219:x1876316231817728:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.422599:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.422625:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c574 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106441 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.422787:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.422807:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.422826:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.422844:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.422852:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.422859:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.423311:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f6:0x0], index 0: 0 00010000:00010000:2.0:1789395157.423588:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c589 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423599:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423607:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.423702:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983897 00010000:00010000:2.0:1789395157.423744:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423752:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423758:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423781:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423787:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.423792:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423801:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423815:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.423818:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.423823:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423829:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c57b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.423855:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062d648fa reply state 000000008278cfb7 transno 4294983898 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423867:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423874:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7db3ad0 (ffff89a3ca2fbc00) 00010000:00010000:2.0:1789395157.423876:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.423879:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.423917:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c574 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106441 expref: 501 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423937:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106441 expref: 500 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.423945:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff89a3ca2fbe00) 00010000:00010000:2.0:1789395157.423947:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.423950:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfc00, rc 0) 00000100:00100000:2.0:1789395157.424032:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+501:19219:x1876316231817728:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1465us (1796us total) trans 4294983898 rc 0/0 00000100:00100000:2.0:1789395157.424041:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23682 00000020:00080000:2.0:1789395157.424049:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.432341:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.433540:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231817984 00000100:00100000:1.0:1789395157.433557:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231817984 00000100:00100000:1.0:1789395157.433673:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5179 00000100:00100000:1.0:1789395157.433687:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+501:19219:x1876316231817984:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.434045:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983899 00000100:00100000:1.0:1789395157.434203:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+503:19219:x1876316231817984:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 518us (1874us total) trans 4294983900 rc 0/0 00000100:00100000:1.0:1789395157.434212:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5179 00000020:00080000:1.0:1789395157.434219:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.438932:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.438974:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231818240 00000100:00100000:1.0:1789395157.438986:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231818240 00000100:00100000:1.0:1789395157.439061:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23683 00000100:00100000:1.0:1789395157.439074:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+503:19219:x1876316231818240:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395157.439106:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395157.439133:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c597 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106448 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.439456:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.439476:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.439489:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.439506:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.439513:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.439521:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395157.439933:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f7:0x0], index 1: 0 00010000:00010000:1.0:1789395157.440132:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c5ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.440758:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.440785:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c5ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395157.440944:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983901 00010000:00010000:1.0:1789395157.440997:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441006:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441013:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441020:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441026:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4fbd0c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.441030:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441038:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441053:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.441057:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.441061:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441068:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c59e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.441088:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ce881bb reply state 000000005add69cd transno 4294983902 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441098:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441226:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x798865d0 (ffff89a3ca1c2e00) 00010000:00010000:1.0:1789395157.441229:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.441298:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395157.441348:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c597 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106448 expref: 507 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441367:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c5ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106448 expref: 506 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.441374:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff89a3ca1c2500) 00010000:00010000:1.0:1789395157.441376:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395157.441379:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4c148bc00, rc 0) 00000100:00100000:1.0:1789395157.441558:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+507:19219:x1876316231818240:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2485us (2639us total) trans 4294983902 rc 0/0 00000100:00100000:1.0:1789395157.441567:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23683 00000020:00080000:1.0:1789395157.441574:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.446153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.446249:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231818496 00000100:00100000:1.0:1789395157.446263:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231818496 00000100:00100000:1.0:1789395157.446353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5180 00000100:00100000:1.0:1789395157.446365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+507:19219:x1876316231818496:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.446762:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983903 00000100:00100000:1.0:1789395157.446899:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+509:19219:x1876316231818496:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 535us (761us total) trans 4294983904 rc 0/0 00000100:00100000:1.0:1789395157.446910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5180 00000020:00080000:1.0:1789395157.446916:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.459621:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.459850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231818752 00000100:00100000:3.0:1789395157.459863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231818752 00000100:00100000:3.0:1789395157.460025:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23684 00000100:00100000:3.0:1789395157.460039:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+509:19219:x1876316231818752:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.460072:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.460100:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c5ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210644f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.460532:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.460551:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.460570:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.460588:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.460595:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.460602:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395157.461553:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f7:0x0], index 0: 0 00010000:00010000:3.0:1789395157.461864:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c5cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.461879:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c5cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.461890:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c5cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395157.462039:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983905 00010000:00010000:3.0:1789395157.462084:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462093:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462101:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462114:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462121:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.462125:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462135:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462223:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.462227:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.462381:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462418:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c5c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.462438:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd4f97ff reply state 00000000b6bd32fc transno 4294983906 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462451:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462457:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0729cd0 (ffff89a4c8e8dc00) 00010000:00010000:3.0:1789395157.462460:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.462464:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.462510:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c5ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210644f expref: 513 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462532:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c5cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210644f expref: 512 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.462540:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff89a4e7d25c00) 00010000:00010000:3.0:1789395157.462542:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395157.462545:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca23b400, rc 0) 00000100:00100000:3.0:1789395157.462908:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+513:19219:x1876316231818752:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2870us (3301us total) trans 4294983906 rc 0/0 00000100:00100000:3.0:1789395157.462918:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23684 00000020:00080000:3.0:1789395157.462925:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.469840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.470028:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231819008 00000100:00100000:1.0:1789395157.470041:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231819008 00000100:00100000:1.0:1789395157.470139:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5181 00000100:00100000:1.0:1789395157.470158:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+513:19219:x1876316231819008:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.470722:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983907 00000100:00100000:1.0:1789395157.470866:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+515:19219:x1876316231819008:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 707us (1039us total) trans 4294983908 rc 0/0 00000100:00100000:1.0:1789395157.470875:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5181 00000020:00080000:1.0:1789395157.470882:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.475260:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.475511:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231819264 00000100:00100000:2.0:1789395157.475524:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231819264 00000100:00100000:2.0:1789395157.475596:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23685 00000100:00100000:2.0:1789395157.475607:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+515:19219:x1876316231819264:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.475637:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.475666:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c5dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106456 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.475818:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.475837:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.475849:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.475867:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.475874:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.475881:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.476373:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f8:0x0], index 1: 0 00010000:00010000:2.0:1789395157.476656:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316c5f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476667:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316c5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476676:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316c5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.476744:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983909 00010000:00010000:2.0:1789395157.476797:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476806:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476813:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476821:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476834:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.476839:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476848:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476863:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.476866:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.476872:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476879:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c5e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.476895:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e06a22e6 reply state 000000000a5fe7cf transno 4294983910 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476906:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476912:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe37fc7d0 (ffff89a3ca2fb000) 00010000:00010000:2.0:1789395157.476914:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.476917:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.476954:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c5dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106456 expref: 519 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476969:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316c5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106456 expref: 518 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.476982:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff89a4d99b8100) 00010000:00010000:2.0:1789395157.476984:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.476987:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff5a00, rc 0) 00000100:00100000:2.0:1789395157.477067:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+519:19219:x1876316231819264:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1462us (1830us total) trans 4294983910 rc 0/0 00000100:00100000:2.0:1789395157.477075:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23685 00000020:00080000:2.0:1789395157.477081:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.482159:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.482262:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231819520 00000100:00100000:1.0:1789395157.482276:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231819520 00000100:00100000:1.0:1789395157.482360:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5182 00000100:00100000:1.0:1789395157.482373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+519:19219:x1876316231819520:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395157.482909:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983911 00000100:00100000:0.0:1789395157.483046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+521:19219:x1876316231819520:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 672us (909us total) trans 4294983912 rc 0/0 00000100:00100000:0.0:1789395157.483055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5182 00000020:00080000:0.0:1789395157.483061:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395157.487124:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.487436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231819776 00000100:00100000:1.0:1789395157.487450:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231819776 00000100:00100000:1.0:1789395157.488470:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23686 00000100:00100000:0.0:1789395157.488756:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+521:19219:x1876316231819776:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.488806:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.488837:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c600 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210645d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.488995:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.489013:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.489027:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.489046:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.489053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.489060:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.489931:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f8:0x0], index 0: 0 00010000:00010000:0.0:1789395157.490154:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316c615 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.490169:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316c615 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.490179:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316c615 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.491362:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983913 00010000:00010000:0.0:1789395157.491628:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491640:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491648:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491655:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491662:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.491667:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491676:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491695:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.491699:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.491704:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491711:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c607 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.491728:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078e6e110 reply state 00000000bfbb184b transno 4294983914 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491742:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491749:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x507ed6d0 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395157.491752:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.491756:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.491819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c600 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210645d expref: 525 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491836:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316c615 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210645d expref: 524 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.491907:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff89a3c8b1d600) 00010000:00010000:0.0:1789395157.491911:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.491915:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca2aa400, rc 0) 00000100:00100000:0.0:1789395157.492066:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+525:19219:x1876316231819776:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3583us (4955us total) trans 4294983914 rc 0/0 00000100:00100000:0.0:1789395157.492076:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23686 00000020:00080000:0.0:1789395157.492085:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.498999:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.499105:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231820032 00000100:00100000:3.0:1789395157.499119:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231820032 00000100:00100000:3.0:1789395157.499199:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5183 00000100:00100000:3.0:1789395157.499210:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+525:19219:x1876316231820032:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.500547:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983915 00000100:00100000:1.0:1789395157.500706:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+527:19219:x1876316231820032:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 1483us (1707us total) trans 4294983916 rc 0/0 00000100:00100000:1.0:1789395157.500719:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5183 00000020:00080000:1.0:1789395157.500726:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.505200:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.505328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231820288 00000100:00100000:3.0:1789395157.505343:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231820288 00000100:00100000:3.0:1789395157.505440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23687 00000100:00100000:3.0:1789395157.505452:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+527:19219:x1876316231820288:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.505484:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.505510:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c623 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106464 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.505653:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.505670:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.505684:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.505701:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.505707:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.505713:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395157.506209:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f9:0x0], index 1: 0 00010000:00010000:3.0:1789395157.506454:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8600/0xff35729af316c638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506466:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8600/0xff35729af316c638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506475:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8600/0xff35729af316c638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395157.506536:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983917 00010000:00010000:3.0:1789395157.506578:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506587:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506593:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506605:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506611:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.506616:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506625:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506638:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.506642:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.506647:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506654:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015400/0xff35729af316c62a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.506668:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000075dfd40 reply state 00000000954be357 transno 4294983918 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506680:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506686:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea2c01d0 (ffff89a3ca308300) 00010000:00010000:3.0:1789395157.506689:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.506692:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.506725:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316c623 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106464 expref: 531 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506748:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8600/0xff35729af316c638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106464 expref: 530 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.506757:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff89a3ca308e00) 00010000:00010000:3.0:1789395157.506759:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395157.506762:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9ac8600, rc 0) 00000100:00100000:3.0:1789395157.506852:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+531:19219:x1876316231820288:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1402us (1665us total) trans 4294983918 rc 0/0 00000100:00100000:3.0:1789395157.506860:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23687 00000020:00080000:3.0:1789395157.506866:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.512995:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.513667:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231820544 00000100:00100000:3.0:1789395157.513682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231820544 00000100:00100000:2.0:1789395157.513941:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5184 00000100:00100000:2.0:1789395157.513955:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+531:19219:x1876316231820544:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.514338:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983919 00000100:00100000:2.0:1789395157.514508:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+533:19219:x1876316231820544:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 555us (1526us total) trans 4294983920 rc 0/0 00000100:00100000:2.0:1789395157.514517:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5184 00000020:00080000:2.0:1789395157.514523:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.518667:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.518785:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231820800 00000100:00100000:3.0:1789395157.518799:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231820800 00000100:00100000:3.0:1789395157.518878:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23688 00000100:00100000:3.0:1789395157.518890:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+533:19219:x1876316231820800:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.518922:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.518948:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316c646 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210646b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519096:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519116:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519130:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519158:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519166:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519173:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395157.519641:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f9:0x0], index 0: 0 00010000:00010000:3.0:1789395157.519860:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8a00/0xff35729af316c65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519870:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8a00/0xff35729af316c65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519878:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8a00/0xff35729af316c65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395157.519941:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983921 00010000:00010000:3.0:1789395157.519983:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519992:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.519997:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520005:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520016:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.520021:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520030:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520044:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.520048:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.520054:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520061:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c64d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.520076:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085c10d45 reply state 00000000637471fc transno 4294983922 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520089:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520096:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe91638d0 (ffff89a3ca308d00) 00010000:00010000:3.0:1789395157.520099:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.520101:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.520136:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316c646 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210646b expref: 537 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520151:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8a00/0xff35729af316c65b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210646b expref: 536 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.520164:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff89a3ca308800) 00010000:00010000:3.0:1789395157.520166:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395157.520169:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9ac8a00, rc 0) 00000100:00100000:3.0:1789395157.520261:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+537:19219:x1876316231820800:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1373us (1609us total) trans 4294983922 rc 0/0 00000100:00100000:3.0:1789395157.520269:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23688 00000020:00080000:3.0:1789395157.520275:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.525647:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.525746:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231821056 00000100:00100000:1.0:1789395157.525760:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231821056 00000100:00100000:1.0:1789395157.525931:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5185 00000100:00100000:1.0:1789395157.525944:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a49450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+537:19219:x1876316231821056:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.526530:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983923 00000100:00100000:1.0:1789395157.526658:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a49450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+539:19219:x1876316231821056:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 714us (1023us total) trans 4294983924 rc 0/0 00000100:00100000:1.0:1789395157.526666:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5185 00000020:00080000:1.0:1789395157.526672:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.533929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.534199:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231821312 00000100:00100000:0.0:1789395157.534213:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231821312 00000100:00100000:0.0:1789395157.534300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23689 00000100:00100000:0.0:1789395157.534312:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+539:19219:x1876316231821312:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.534345:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.534373:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c669 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106472 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.534551:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.534568:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.534581:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.534600:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.534607:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.534614:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.535116:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fa:0x0], index 1: 0 00010000:00010000:0.0:1789395157.535338:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316c67e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535350:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316c67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535359:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316c67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.535460:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983925 00010000:00010000:0.0:1789395157.535502:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535510:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535516:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535523:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535529:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.535534:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535542:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535557:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.535560:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.535566:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535574:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c670 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.535594:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faa17ea0 reply state 00000000828ea49b transno 4294983926 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535606:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535611:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfe3473d0 (ffff89a3c8b1d500) 00010000:00010000:0.0:1789395157.535613:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.535616:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.535657:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c669 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106472 expref: 543 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535673:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316c67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106472 expref: 542 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.535681:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff89a3c8b1d900) 00010000:00010000:0.0:1789395157.535683:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.535686:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca417200, rc 0) 00000100:00100000:0.0:1789395157.535785:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+543:19219:x1876316231821312:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1474us (1868us total) trans 4294983926 rc 0/0 00000100:00100000:0.0:1789395157.535795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23689 00000020:00080000:0.0:1789395157.535801:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.540100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.540249:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231821568 00000100:00100000:3.0:1789395157.540263:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231821568 00000100:00100000:3.0:1789395157.540333:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5186 00000100:00100000:3.0:1789395157.540344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+543:19219:x1876316231821568:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.540734:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983927 00000100:00100000:3.0:1789395157.540866:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+545:19219:x1876316231821568:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 523us (779us total) trans 4294983928 rc 0/0 00000100:00100000:3.0:1789395157.540874:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5186 00000020:00080000:3.0:1789395157.540879:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.544961:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.545048:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231821824 00000100:00100000:0.0:1789395157.545062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231821824 00000100:00100000:0.0:1789395157.545139:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23690 00000100:00100000:0.0:1789395157.545151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+545:19219:x1876316231821824:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.545184:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.545213:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316c68c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106479 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.545366:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.545427:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.545442:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.545464:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.545472:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.545479:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.545917:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fa:0x0], index 0: 0 00010000:00010000:0.0:1789395157.546123:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316c6a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546134:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316c6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546143:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316c6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.546207:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983929 00010000:00010000:0.0:1789395157.546249:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546259:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546266:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546275:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546282:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.546287:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546297:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546313:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.546317:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.546322:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546330:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c693 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.546349:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2c8af7f reply state 000000006af8c8c2 transno 4294983930 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546361:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546368:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x133382d0 (ffff89a3c8b1d200) 00010000:00010000:0.0:1789395157.546371:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.546375:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.546450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316c68c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106479 expref: 549 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546468:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316c6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106479 expref: 548 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.546476:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff89a3c8b1d100) 00010000:00010000:0.0:1789395157.546479:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.546481:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca416400, rc 0) 00000100:00100000:0.0:1789395157.546571:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+549:19219:x1876316231821824:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1422us (1625us total) trans 4294983930 rc 0/0 00000100:00100000:0.0:1789395157.546580:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23690 00000020:00080000:0.0:1789395157.546587:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.550915:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.551013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231822080 00000100:00100000:2.0:1789395157.551027:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231822080 00000100:00100000:2.0:1789395157.551100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5187 00000100:00100000:2.0:1789395157.551112:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+549:19219:x1876316231822080:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.551531:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983931 00000100:00100000:2.0:1789395157.551656:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+551:19219:x1876316231822080:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 545us (755us total) trans 4294983932 rc 0/0 00000100:00100000:2.0:1789395157.551665:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5187 00000020:00080000:2.0:1789395157.551671:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.556972:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.557019:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.557065:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.557149:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231822208 00000100:00100000:1.0:1789395157.557163:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231822208 00000100:00100000:1.0:1789395157.557244:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 445 00000100:00100000:1.0:1789395157.557257:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231822208:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395157.557346:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231822208:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 91us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395157.557355:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 445 00000100:00100000:0.0:1789395157.557741:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231822336 00000100:00100000:0.0:1789395157.557748:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231822336 00000100:00080000:0.0:1789395157.557793:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395157.557835:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 628 00000100:00100000:0.0:1789395157.557844:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231822336:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395157.557890:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231822336:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 48us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395157.557897:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 628 00000100:00100000:3.0:1789395157.558156:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231822464 00000100:00100000:3.0:1789395157.558162:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231822464 00000100:00100000:3.0:1789395157.558207:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 423 00000100:00100000:3.0:1789395157.558215:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231822464:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395157.559806:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231822464:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 1576us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395157.559823:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 423 00000100:00080000:0.0:1789395157.560128:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395157.562079:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.562880:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231822592 00000100:00100000:3.0:1789395157.562899:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231822592 00000100:00100000:3.0:1789395157.563107:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 424 00000100:00100000:3.0:1789395157.563119:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231822592:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:1.0:1789395157.563677:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789395157.563715:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231822592:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 597us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395157.563724:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 424 00000100:00100000:2.0:1789395157.567891:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.567974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231822848 00000100:00100000:3.0:1789395157.567987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231822848 00000100:00100000:3.0:1789395157.568054:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23691 00000100:00100000:3.0:1789395157.568066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+551:19219:x1876316231822848:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.568099:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.568126:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316c6af lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106480 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.568286:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.568305:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.568317:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.568337:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.568344:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.568355:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395157.568828:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fb:0x0], index 1: 0 00010000:00010000:3.0:1789395157.569067:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9800/0xff35729af316c6c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569079:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9800/0xff35729af316c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569087:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9800/0xff35729af316c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395157.569152:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983933 00010000:00010000:3.0:1789395157.569195:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569203:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569209:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569216:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569222:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.569227:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569236:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569250:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.569253:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.569258:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569264:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c6b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.569280:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ea4b702 reply state 0000000057875b34 transno 4294983934 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569291:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569297:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xeedd9295 (ffff89a3ca308b00) 00010000:00010000:3.0:1789395157.569300:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.569303:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.569340:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316c6af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106480 expref: 555 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569355:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9800/0xff35729af316c6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106480 expref: 554 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.569363:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff89a3ca308000) 00010000:00010000:3.0:1789395157.569365:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395157.569367:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9ac9800, rc 0) 00000100:00100000:2.0:1789395157.569997:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+555:19219:x1876316231822848:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1927us (2115us total) trans 4294983934 rc 0/0 00000100:00100000:2.0:1789395157.570007:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23691 00000020:00080000:2.0:1789395157.570015:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.574452:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.574556:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231823104 00000100:00100000:2.0:1789395157.574569:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231823104 00000100:00100000:2.0:1789395157.574635:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5188 00000100:00100000:2.0:1789395157.574647:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+555:19219:x1876316231823104:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.575019:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983935 00000100:00100000:2.0:1789395157.575149:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+557:19219:x1876316231823104:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 503us (710us total) trans 4294983936 rc 0/0 00000100:00100000:2.0:1789395157.575157:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5188 00000020:00080000:2.0:1789395157.575163:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.579104:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.579197:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231823360 00000100:00100000:3.0:1789395157.579210:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231823360 00000100:00100000:3.0:1789395157.579292:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23692 00000100:00100000:3.0:1789395157.579305:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+557:19219:x1876316231823360:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395157.579340:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395157.579368:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316c6d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106487 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.583726:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.583758:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.583782:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.583811:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.583818:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.583825:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.584514:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fb:0x0], index 0: 0 00010000:00010000:2.0:1789395157.584754:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4800/0xff35729af316c6e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584775:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4800/0xff35729af316c6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584784:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4800/0xff35729af316c6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.584852:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983937 00010000:00010000:2.0:1789395157.584894:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584903:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584910:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584917:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584929:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.584935:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584945:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584960:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.584963:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.584968:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.584976:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c6d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.584994:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34fbfad reply state 00000000f8f98bc5 transno 4294983938 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.585007:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.585013:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6be72195 (ffff89a4d99b8900) 00010000:00010000:2.0:1789395157.585015:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.585019:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.585063:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316c6d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106487 expref: 561 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.585083:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4800/0xff35729af316c6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106487 expref: 560 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.585097:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff89a4d99b8b00) 00010000:00010000:2.0:1789395157.585099:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.585102:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff4800, rc 0) 00000100:00100000:2.0:1789395157.585484:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+561:19219:x1876316231823360:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 6179us (6392us total) trans 4294983938 rc 0/0 00000100:00100000:2.0:1789395157.585494:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23692 00000020:00080000:2.0:1789395157.585502:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.589999:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.590095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231823616 00000100:00100000:3.0:1789395157.590108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231823616 00000100:00100000:3.0:1789395157.590329:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5189 00000100:00100000:3.0:1789395157.590342:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+561:19219:x1876316231823616:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.590716:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983939 00000100:00100000:3.0:1789395157.590900:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+563:19219:x1876316231823616:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 560us (914us total) trans 4294983940 rc 0/0 00000100:00100000:3.0:1789395157.590909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5189 00000020:00080000:3.0:1789395157.590915:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.595120:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.595215:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231823872 00000100:00100000:0.0:1789395157.595228:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231823872 00000100:00100000:0.0:1789395157.595320:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23693 00000100:00100000:0.0:1789395157.595333:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+563:19219:x1876316231823872:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.595367:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.595420:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316c6f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210648e expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.595567:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.595586:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.595599:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.595620:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.595628:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.595635:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.596128:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fc:0x0], index 1: 0 00010000:00010000:0.0:1789395157.596582:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c70a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596596:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c70a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596607:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c70a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.596683:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983941 00010000:00010000:0.0:1789395157.596726:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596735:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596743:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596750:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596757:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.596775:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596786:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596802:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.596806:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.596812:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596819:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c6fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.596836:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000835bdff7 reply state 000000005a684cf1 transno 4294983942 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596854:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596860:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6d724c95 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395157.596863:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.596866:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.596906:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316c6f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210648e expref: 567 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596922:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c70a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210648e expref: 566 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.596930:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff89a4df47ab00) 00010000:00010000:0.0:1789395157.596932:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.596935:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:0.0:1789395157.597030:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+567:19219:x1876316231823872:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1699us (1925us total) trans 4294983942 rc 0/0 00000100:00100000:0.0:1789395157.597040:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23693 00000020:00080000:0.0:1789395157.597047:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.606361:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.606505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231824128 00000100:00100000:3.0:1789395157.606518:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231824128 00000100:00100000:3.0:1789395157.606589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5190 00000100:00100000:3.0:1789395157.606600:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+567:19219:x1876316231824128:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.606960:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983943 00000100:00100000:3.0:1789395157.607079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+569:19219:x1876316231824128:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 479us (732us total) trans 4294983944 rc 0/0 00000100:00100000:3.0:1789395157.607087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5190 00000020:00080000:3.0:1789395157.607093:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.613600:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.613715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231824384 00000100:00100000:2.0:1789395157.613729:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231824384 00000100:00100000:2.0:1789395157.613811:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23694 00000100:00100000:2.0:1789395157.613824:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+569:19219:x1876316231824384:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.613864:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.613893:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c718 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106495 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614040:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614059:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614072:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614091:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614098:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614105:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.614630:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fc:0x0], index 0: 0 00010000:00010000:2.0:1789395157.614881:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c72d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614894:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.614902:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c72d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.614964:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983945 00010000:00010000:2.0:1789395157.615007:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615015:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615022:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615028:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615034:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.615039:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615047:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615063:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.615066:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.615071:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615078:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c71f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.615094:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6f33c87 reply state 0000000001da1eb3 transno 4294983946 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615106:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615112:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a5c8395 (ffff89a4d99b8500) 00010000:00010000:2.0:1789395157.615115:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.615118:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.615301:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c718 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106495 expref: 573 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615515:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c72d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106495 expref: 572 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.615525:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff89a4d99b8800) 00010000:00010000:2.0:1789395157.615528:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.615531:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca37da00, rc 0) 00000100:00100000:1.0:1789395157.616800:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+573:19219:x1876316231824384:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2967us (3205us total) trans 4294983946 rc 0/0 00000100:00100000:1.0:1789395157.616814:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23694 00000020:00080000:1.0:1789395157.616823:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.621801:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.621892:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231824640 00000100:00100000:3.0:1789395157.621907:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231824640 00000100:00100000:3.0:1789395157.621986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5191 00000100:00100000:3.0:1789395157.621998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+573:19219:x1876316231824640:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.622557:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983947 00000100:00100000:3.0:1789395157.622682:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+575:19219:x1876316231824640:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 686us (895us total) trans 4294983948 rc 0/0 00000100:00100000:3.0:1789395157.622691:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5191 00000020:00080000:3.0:1789395157.622696:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.626204:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.626326:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231824896 00000100:00100000:2.0:1789395157.626339:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231824896 00000100:00100000:2.0:1789395157.626454:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23695 00000100:00100000:2.0:1789395157.626466:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+575:19219:x1876316231824896:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.626495:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.626523:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c73b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210649c expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.626669:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.626689:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.626701:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.626720:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.626727:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.626733:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.627154:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fd:0x0], index 1: 0 00010000:00010000:2.0:1789395157.627356:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2dc00/0xff35729af316c750 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627367:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2dc00/0xff35729af316c750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627375:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2dc00/0xff35729af316c750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.627473:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983949 00010000:00010000:2.0:1789395157.627515:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627523:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627530:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627537:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627544:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.627550:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627557:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627574:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.627577:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.627582:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627588:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c742 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.627603:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ddd9cef reply state 00000000de5a63d7 transno 4294983950 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627620:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627626:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x609ae95 (ffff89a4d99b8400) 00010000:00010000:2.0:1789395157.627628:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.627631:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.627666:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c73b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210649c expref: 579 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627680:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2dc00/0xff35729af316c750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210649c expref: 578 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.627688:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff89a4d99b8700) 00010000:00010000:2.0:1789395157.627690:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.627692:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4e7f2dc00, rc 0) 00000100:00100000:2.0:1789395157.627783:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+579:19219:x1876316231824896:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1318us (1593us total) trans 4294983950 rc 0/0 00000100:00100000:2.0:1789395157.627792:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23695 00000020:00080000:2.0:1789395157.627798:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.632906:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.633161:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231825152 00000100:00100000:2.0:1789395157.633174:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231825152 00000100:00100000:2.0:1789395157.633255:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5192 00000100:00100000:2.0:1789395157.633268:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+579:19219:x1876316231825152:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.633636:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983951 00000100:00100000:2.0:1789395157.633776:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+581:19219:x1876316231825152:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 501us (875us total) trans 4294983952 rc 0/0 00000100:00100000:2.0:1789395157.633791:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5192 00000020:00080000:2.0:1789395157.633797:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.637807:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.637924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231825408 00000100:00100000:2.0:1789395157.637938:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231825408 00000100:00100000:2.0:1789395157.638016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23696 00000100:00100000:2.0:1789395157.638029:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+581:19219:x1876316231825408:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.638062:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.638092:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c75e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064a3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638242:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638259:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638273:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638290:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638298:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638305:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.638773:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fd:0x0], index 0: 0 00010000:00010000:2.0:1789395157.638982:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2cc00/0xff35729af316c773 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.638993:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2cc00/0xff35729af316c773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639001:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2cc00/0xff35729af316c773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.639062:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983953 00010000:00010000:2.0:1789395157.639103:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639111:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639118:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639126:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639132:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.639137:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639145:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639161:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.639163:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.639169:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639175:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c765 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.639194:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a98fa3e reply state 00000000c0cd3099 transno 4294983954 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639205:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639212:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9d08bd95 (ffff89a4d99b8f00) 00010000:00010000:2.0:1789395157.639215:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.639218:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.639254:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c75e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064a3 expref: 585 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639272:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2cc00/0xff35729af316c773 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064a3 expref: 584 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.639280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff89a4d99b8200) 00010000:00010000:2.0:1789395157.639282:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.639285:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4e7f2cc00, rc 0) 00000100:00100000:2.0:1789395157.639370:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+585:19219:x1876316231825408:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1343us (1575us total) trans 4294983954 rc 0/0 00000100:00100000:2.0:1789395157.639378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23696 00000020:00080000:2.0:1789395157.639450:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.643732:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.643823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231825664 00000100:00100000:3.0:1789395157.643837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231825664 00000100:00100000:3.0:1789395157.643906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5193 00000100:00100000:3.0:1789395157.643918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+585:19219:x1876316231825664:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.644287:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983955 00000100:00100000:3.0:1789395157.644450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+587:19219:x1876316231825664:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 533us (729us total) trans 4294983956 rc 0/0 00000100:00100000:3.0:1789395157.644460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5193 00000020:00080000:3.0:1789395157.644466:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.648184:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.648499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231825920 00000100:00100000:2.0:1789395157.648512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231825920 00000100:00100000:2.0:1789395157.648580:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23697 00000100:00100000:2.0:1789395157.648593:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+587:19219:x1876316231825920:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.648623:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.648652:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c781 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.648810:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.648829:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.648843:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.648874:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.648882:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.648889:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.649379:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fe:0x0], index 1: 0 00010000:00010000:2.0:1789395157.650471:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c796 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650491:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650502:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c796 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.650588:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983957 00010000:00010000:2.0:1789395157.650631:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650639:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650646:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650654:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650660:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.650666:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650675:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650691:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.650694:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.650699:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650705:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c788 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.650723:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2cbca07 reply state 00000000a760ff7e transno 4294983958 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650735:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650741:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3615e895 (ffff89a4d99b8c00) 00010000:00010000:2.0:1789395157.650744:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.650748:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.650799:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c781 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064aa expref: 591 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650816:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c796 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064aa expref: 590 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.650825:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff89a4d99b8e00) 00010000:00010000:2.0:1789395157.650827:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.650829:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff4a00, rc 0) 00000100:00100000:2.0:1789395157.650938:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+591:19219:x1876316231825920:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2348us (2768us total) trans 4294983958 rc 0/0 00000100:00100000:2.0:1789395157.650948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23697 00000020:00080000:2.0:1789395157.650956:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.656177:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.656274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231826176 00000100:00100000:3.0:1789395157.656287:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231826176 00000100:00100000:3.0:1789395157.656365:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5194 00000100:00100000:3.0:1789395157.656377:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+591:19219:x1876316231826176:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:3.0:1789395157.656777:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983959 00000100:00100000:3.0:1789395157.656917:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+593:19219:x1876316231826176:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 540us (753us total) trans 4294983960 rc 0/0 00000100:00100000:3.0:1789395157.656926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5194 00000020:00080000:3.0:1789395157.656932:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.662116:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.662375:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231826432 00000100:00100000:0.0:1789395157.662690:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231826432 00000100:00100000:0.0:1789395157.662814:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23698 00000100:00100000:0.0:1789395157.662827:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+593:19219:x1876316231826432:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.662870:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.662902:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316c7a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064b1 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663059:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663079:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663094:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663111:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663119:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663126:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.663620:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fe:0x0], index 0: 0 00010000:00010000:0.0:1789395157.663850:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376600/0xff35729af316c7b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663862:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376600/0xff35729af316c7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663871:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376600/0xff35729af316c7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.663936:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983961 00010000:00010000:0.0:1789395157.663982:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663992:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.663998:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664005:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664012:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.664017:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664027:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664043:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.664047:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.664052:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664060:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416c00/0xff35729af316c7ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.664077:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dc5a541 reply state 000000000f1b374c transno 4294983962 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664089:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664095:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3001f95 (ffff89a4df47a200) 00010000:00010000:0.0:1789395157.664098:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.664101:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.664140:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417e00/0xff35729af316c7a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064b1 expref: 597 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664156:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376600/0xff35729af316c7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064b1 expref: 596 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.664163:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:0.0:1789395157.664166:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.664168:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376600, rc 0) 00000100:00100000:0.0:1789395157.664257:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+597:19219:x1876316231826432:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1432us (2157us total) trans 4294983962 rc 0/0 00000100:00100000:0.0:1789395157.664265:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23698 00000020:00080000:0.0:1789395157.664272:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395157.669471:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.669572:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231826688 00000100:00100000:2.0:1789395157.669585:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231826688 00000100:00100000:2.0:1789395157.669687:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5195 00000100:00100000:2.0:1789395157.669698:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+597:19219:x1876316231826688:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:2.0:1789395157.670050:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983963 00000100:00100000:2.0:1789395157.670176:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+599:19219:x1876316231826688:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 479us (802us total) trans 4294983964 rc 0/0 00000100:00100000:2.0:1789395157.670184:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5195 00000020:00080000:2.0:1789395157.670191:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.676542:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.676681:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231826944 00000100:00100000:0.0:1789395157.676695:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231826944 00000100:00100000:0.0:1789395157.676770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23699 00000100:00100000:0.0:1789395157.676782:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+599:19219:x1876316231826944:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395157.676815:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395157.676843:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c7c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.676982:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677000:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677018:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677035:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677043:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677050:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395157.677526:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ff:0x0], index 1: 0 00010000:00010000:0.0:1789395157.677737:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316c7dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677749:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316c7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.677757:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316c7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395157.677829:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983965 00010000:00010000:0.0:1789395157.678346:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678357:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678363:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678376:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678548:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.678555:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678566:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678582:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.678586:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.678591:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678598:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c7ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.678617:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082a21665 reply state 0000000076609297 transno 4294983966 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678629:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678636:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x35965a95 (ffff89a4df47a300) 00010000:00010000:0.0:1789395157.678638:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.678642:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395157.678687:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c7c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064b8 expref: 603 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678708:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316c7dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064b8 expref: 602 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.678716:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff89a4df47aa00) 00010000:00010000:0.0:1789395157.678718:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395157.678721:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376400, rc 0) 00000100:00100000:0.0:1789395157.678867:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+603:19219:x1876316231826944:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2085us (2338us total) trans 4294983966 rc 0/0 00000100:00100000:0.0:1789395157.678877:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23699 00000020:00080000:0.0:1789395157.678885:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.683584:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.683689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231827200 00000100:00100000:0.0:1789395157.683704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231827200 00000100:00100000:0.0:1789395157.683800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5196 00000100:00100000:0.0:1789395157.683813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+603:19219:x1876316231827200:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:0.0:1789395157.684174:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983967 00000100:00100000:0.0:1789395157.684315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+605:19219:x1876316231827200:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 503us (744us total) trans 4294983968 rc 0/0 00000100:00100000:0.0:1789395157.684325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5196 00000020:00080000:0.0:1789395157.684331:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.694292:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.694340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231827456 00000100:00100000:2.0:1789395157.694352:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231827456 00000100:00100000:2.0:1789395157.694451:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23700 00000100:00100000:2.0:1789395157.694463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+605:19219:x1876316231827456:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395157.694495:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395157.694523:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c7ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.694662:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.694682:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.694696:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.694714:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.695356:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.695367:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395157.696104:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ff:0x0], index 0: 0 00010000:00010000:2.0:1789395157.696546:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094a00/0xff35729af316c7ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.696561:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094a00/0xff35729af316c7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.696571:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094a00/0xff35729af316c7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395157.696652:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983969 00010000:00010000:2.0:1789395157.696705:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.696714:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697210:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697218:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697224:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.697230:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697239:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697255:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.697258:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.697264:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697272:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316c7f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.697291:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058555178 reply state 0000000034297d32 transno 4294983970 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697308:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697315:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x74956995 (ffff89a4d99b8d00) 00010000:00010000:2.0:1789395157.697317:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.697320:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395157.697370:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316c7ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064bf expref: 609 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697419:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094a00/0xff35729af316c7ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064bf expref: 608 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.697429:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff89a4d99b8300) 00010000:00010000:2.0:1789395157.697431:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395157.697434:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9094a00, rc 0) 00000100:00100000:2.0:1789395157.697531:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+609:19219:x1876316231827456:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3069us (3251us total) trans 4294983970 rc 0/0 00000100:00100000:2.0:1789395157.697542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23700 00000020:00080000:2.0:1789395157.697550:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395157.709667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.709806:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231827712 00000100:00100000:1.0:1789395157.709821:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231827712 00000100:00100000:1.0:1789395157.709894:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5197 00000100:00100000:1.0:1789395157.709907:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+609:19219:x1876316231827712:12345-192.168.203.54@tcp:35:createmany.0 00000001:00080000:1.0:1789395157.710292:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983971 00000100:00100000:1.0:1789395157.710494:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+611:19219:x1876316231827712:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 589us (842us total) trans 4294983972 rc 0/0 00000100:00100000:1.0:1789395157.710504:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5197 00000020:00080000:1.0:1789395157.710511:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395157.730084:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.730193:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231827968 00000100:00100000:0.0:1789395157.730214:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231827968 00000100:00100000:0.0:1789395157.730306:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23701 00000100:00100000:0.0:1789395157.730318:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+611:19221:x1876316231827968:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.730459:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.730505:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316ba76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210620a expref: 611 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730530:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff89a3c90d5800) 00010000:00010000:0.0:1789395157.730543:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.730572:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730588:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730600:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730610:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730618:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730625:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730701:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730709:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.730715:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.731224:0:10512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789395157.731260:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789395157.731513:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000004:00080000:0.0:1789395157.731526:0:10512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 608785140038ns, next at 609785137006ns, rc = 0 00010000:00010000:0.0:1789395157.731626:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731640:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731651:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731659:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731667:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731675:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731709:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.731734:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731740:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731747:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731754:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.731760:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731781:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731794:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395157.731798:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.731804:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731810:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c81b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731833:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731840:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731846:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731853:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731858:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.731861:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731868:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731876:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.731879:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.731883:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731889:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c80d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.731900:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a8d7fd reply state 0000000029fcfe8d transno 4294983973 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731914:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.731920:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b93e778 (ffff89a3c90d5a00) 00010000:00010000:0.0:1789395157.731922:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.731925:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.732041:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+612:19221:x1876316231827968:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1720us (1960us total) trans 4294983973 rc 0/0 00000100:00100000:0.0:1789395157.732052:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23701 00010000:00010000:3.0:1789395157.734102:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.734116:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.734127:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.734132:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.734152:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.734174:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:3.0:1789395157.734178:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.734182:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.734189:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c822 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.734212:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.734214:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.734216:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.738726:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.738855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231828224 00000100:00100000:0.0:1789395157.738875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231828224 00000100:00100000:0.0:1789395157.738973:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23702 00000100:00100000:0.0:1789395157.738987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+612:19221:x1876316231828224:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.739074:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.739110:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aba00/0xff35729af316ba99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106211 expref: 612 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739137:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff89a4c875d000) 00010000:00010000:0.0:1789395157.739153:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.739182:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739198:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739210:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739222:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739229:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739236:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739327:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739336:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739343:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.739698:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2502, 64 off168320 00000004:00080000:0.0:1789395157.739712:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 608793326449ns, next at 609793321944ns, rc = 0 00010000:00010000:0.0:1789395157.739861:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739872:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739882:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739889:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739896:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739904:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739921:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.739943:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739949:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739956:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739963:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.739968:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739977:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.739987:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:0.0:1789395157.739990:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.739995:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740001:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c837 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740021:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740026:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740033:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740039:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740044:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.740047:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740052:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740059:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.740061:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.740063:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740070:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c829 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.740079:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004b3f145 reply state 00000000d32d7de2 transno 4294983974 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740092:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.740099:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x53a9537d (ffff89a4c875d100) 00010000:00010000:0.0:1789395157.740101:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.740104:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.740207:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+613:19221:x1876316231828224:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1221us (1489us total) trans 4294983974 rc 0/0 00000100:00100000:0.0:1789395157.740216:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23702 00010000:00010000:2.0:1789395157.740648:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.740658:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.740665:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.740670:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.740683:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.740694:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:2.0:1789395157.740696:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.740699:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.740705:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c83e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.740726:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.740728:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.740730:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395157.744965:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.745053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231828480 00000100:00100000:2.0:1789395157.745067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231828480 00000100:00100000:2.0:1789395157.745143:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23703 00000100:00100000:2.0:1789395157.745155:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+613:19221:x1876316231828480:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.745249:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.745285:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316babc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106218 expref: 613 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745313:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:2.0:1789395157.745327:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.745356:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745374:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745430:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745445:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745453:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745461:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745539:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745548:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745555:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.745857:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00010000:00010000:2.0:1789395157.745944:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745955:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745962:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745970:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745976:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.745981:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746014:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.746036:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746042:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746048:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746053:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.746059:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746067:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746077:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.746081:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.746084:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746090:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c853 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746113:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746119:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746124:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746130:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746135:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.746138:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746145:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746152:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.746155:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.746158:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746163:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c845 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.746173:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053e6f3bc reply state 00000000a2de35bc transno 4294983975 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746184:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.746191:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x756ed0d2 (ffff89a3c90d5c00) 00010000:00010000:2.0:1789395157.746193:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.746196:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.746284:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+614:19221:x1876316231828480:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1129us (1332us total) trans 4294983975 rc 0/0 00000100:00100000:2.0:1789395157.746293:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23703 00010000:00010000:1.0:1789395157.746502:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.746510:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.746517:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.746521:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.746528:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.746537:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:1.0:1789395157.746541:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.746544:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.746550:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c85a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.746567:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.746569:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.746571:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.746977:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395157.757529:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.757628:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231828736 00000100:00100000:0.0:1789395157.757642:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231828736 00000100:00100000:0.0:1789395157.757719:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23704 00000100:00100000:0.0:1789395157.757731:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+614:19221:x1876316231828736:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.757824:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.757859:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316badf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210621f expref: 614 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.757884:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff89a4f3d38400) 00010000:00010000:0.0:1789395157.757897:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.757927:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.757946:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.757958:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.757970:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.757978:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.757985:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758060:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758070:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758077:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.758579:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2503, 64 off168384 00010000:00010000:0.0:1789395157.758671:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758682:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758691:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758698:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758705:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758713:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758732:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.758754:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758760:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758779:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758786:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.758791:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758800:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758810:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:0.0:1789395157.758813:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.758817:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758823:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316c86f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758846:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758857:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758862:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758868:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758874:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.758877:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758884:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758891:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.758894:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.758896:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758902:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c861 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.758911:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb2bb7ce reply state 000000006932dada transno 4294983976 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758922:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.758928:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd3ce983f (ffff89a4f3d38800) 00010000:00010000:0.0:1789395157.758931:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.758933:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.759038:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+615:19221:x1876316231828736:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1305us (1521us total) trans 4294983976 rc 0/0 00000100:00100000:0.0:1789395157.759048:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23704 00010000:00010000:3.0:1789395157.762669:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.762688:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.762701:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.762706:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.762723:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.762745:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:3.0:1789395157.762748:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.762754:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.762761:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316c876 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.762800:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.762803:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.762804:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.765580:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.766937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231828992 00000100:00100000:0.0:1789395157.766957:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231828992 00000100:00100000:0.0:1789395157.767049:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23705 00000100:00100000:0.0:1789395157.767061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+615:19221:x1876316231828992:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.767152:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.767189:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316bb02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106226 expref: 615 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767215:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff89a4cbd92300) 00010000:00010000:0.0:1789395157.767240:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.767274:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767291:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767303:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767317:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767325:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767337:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767456:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767465:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767473:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.767780:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 64 off8384 00010000:00010000:0.0:1789395157.767873:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767884:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767893:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767901:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767908:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767916:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767946:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.767968:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767975:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767982:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.767989:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.767994:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768004:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768015:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395157.768018:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.768022:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768029:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316c88b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768049:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768056:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768062:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768072:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768077:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.768080:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768087:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768094:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.768097:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.768100:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768106:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316c87d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.768117:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000291a2207 reply state 00000000cad604fe transno 4294983977 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768130:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.768135:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdb9e9594 (ffff89a4cbd92100) 00010000:00010000:0.0:1789395157.768138:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.768141:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.768243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+616:19221:x1876316231828992:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1181us (2673us total) trans 4294983977 rc 0/0 00000100:00100000:0.0:1789395157.768251:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23705 00010000:00010000:3.0:1789395157.768367:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.768375:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.768404:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.768408:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.768415:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.768424:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:3.0:1789395157.768427:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.768430:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.768436:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316c892 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.768455:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.768457:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.768459:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395157.777207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.777329:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231829248 00000100:00100000:1.0:1789395157.777343:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231829248 00000100:00100000:1.0:1789395157.777455:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23706 00000100:00100000:1.0:1789395157.777469:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+616:19221:x1876316231829248:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395157.777553:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395157.777588:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316bb25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210622d expref: 616 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777613:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff89a4f3d38300) 00010000:00010000:1.0:1789395157.777628:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395157.777659:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777677:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777689:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777702:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777711:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777719:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777814:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777823:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.777830:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395157.778124:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2504, 64 off168448 00010000:00010000:1.0:1789395157.778241:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778251:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778259:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778268:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778275:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778283:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778315:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395157.778336:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778343:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778350:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778356:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.778361:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778371:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778381:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff89a4c3c17900) 00010000:00010000:1.0:1789395157.778414:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395157.778419:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778425:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c200/0xff35729af316c8a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778446:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778453:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778464:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778470:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778475:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4fbd0c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.778477:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778484:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778492:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.778494:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.778497:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778503:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c800/0xff35729af316c899 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.778515:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef4650c1 reply state 000000001e62717e transno 4294983978 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778528:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.778535:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe663f479 (ffff89a4f3d38600) 00010000:00010000:1.0:1789395157.778537:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.778540:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395157.778644:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+617:19221:x1876316231829248:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1175us (1449us total) trans 4294983978 rc 0/0 00000100:00100000:1.0:1789395157.778653:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23706 00010000:00010000:2.0:1789395157.778775:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.778784:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.778790:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.778794:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.778800:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.778810:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff89a4c3c17900) 00010000:00010000:2.0:1789395157.778812:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.778815:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.778821:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316c8ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.778838:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.778840:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.778842:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.786693:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.786813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231829504 00000100:00100000:2.0:1789395157.786828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231829504 00000100:00100000:2.0:1789395157.786908:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23707 00000100:00100000:2.0:1789395157.786920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+617:19221:x1876316231829504:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.787002:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.787037:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316bb48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106234 expref: 617 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787059:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff89a4f3d38700) 00010000:00010000:2.0:1789395157.787073:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.787104:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787121:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787134:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787154:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787162:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787169:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787262:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787275:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787282:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.787643:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 64 off8448 00010000:00010000:2.0:1789395157.787731:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787741:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787754:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787770:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787778:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787785:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787811:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.787833:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787840:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787851:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787857:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.787863:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787872:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787882:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:2.0:1789395157.787885:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.787889:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787896:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c8c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787916:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787922:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787928:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787934:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787939:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.787942:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787949:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787956:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.787959:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.787962:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787969:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.787979:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ecad20f reply state 0000000085fe9364 transno 4294983979 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787991:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.787997:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf8b3f1ce (ffff89a3c90d5b00) 00010000:00010000:2.0:1789395157.788000:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.788004:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.788104:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+618:19221:x1876316231829504:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1184us (1425us total) trans 4294983979 rc 0/0 00000100:00100000:2.0:1789395157.788113:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23707 00010000:00010000:3.0:1789395157.788623:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.788632:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.788640:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.788644:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.788652:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.788663:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:3.0:1789395157.788665:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.788668:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.788675:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c8ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.788694:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.788696:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.788698:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.794907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.794993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231829760 00000100:00100000:2.0:1789395157.795008:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231829760 00000100:00100000:2.0:1789395157.795082:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23708 00000100:00100000:2.0:1789395157.795094:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+618:19221:x1876316231829760:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.795379:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.795458:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316bb6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210623b expref: 618 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795485:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:2.0:1789395157.795500:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.795531:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795549:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795560:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795572:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795579:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795586:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795665:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795673:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.795679:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.796006:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2505, 64 off168512 00010000:00010000:2.0:1789395157.796095:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.796940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.796956:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.796966:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.796974:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.796980:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797004:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.797031:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797038:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797046:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797052:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.797058:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797068:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797083:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.797086:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.797091:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797097:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797130:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797137:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797143:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797158:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797163:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.797167:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797173:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797182:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.797185:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.797188:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797199:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.797210:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e65a4da reply state 00000000ac0fc93e transno 4294983980 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797222:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.797344:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d12be7b (ffff89a4cbd92800) 00010000:00010000:2.0:1789395157.797347:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.797351:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.797481:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+619:19221:x1876316231829760:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2383us (2583us total) trans 4294983980 rc 0/0 00000100:00100000:2.0:1789395157.797491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23708 00010000:00010000:3.0:1789395157.798075:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.798085:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.798092:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.798097:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.798116:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.798130:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:3.0:1789395157.798133:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.798137:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.798144:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c8e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.798165:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.798166:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.798168:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395157.805528:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.805694:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231830016 00000100:00100000:2.0:1789395157.805708:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231830016 00000100:00100000:2.0:1789395157.805788:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23709 00000100:00100000:2.0:1789395157.805801:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+619:19221:x1876316231830016:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.805882:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.805918:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa000/0xff35729af316bb8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106242 expref: 619 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.805941:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff89a4c875d600) 00010000:00010000:2.0:1789395157.805955:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.805985:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806007:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806019:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806031:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806039:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806046:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806140:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806150:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806158:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.806603:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 64 off8512 00010000:00010000:2.0:1789395157.806691:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806701:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806709:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806719:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806726:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.806734:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807163:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.807190:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807197:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807204:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807211:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.807216:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807224:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807305:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:2.0:1789395157.807309:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.807313:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807325:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c8fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807348:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807355:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807362:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807368:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807374:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.807378:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807405:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807413:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.807416:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.807419:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807425:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c8ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.807436:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011eea407 reply state 00000000febb7b2f transno 4294983981 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807451:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.807457:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6e2bbd0 (ffff89a4f3d38e00) 00010000:00010000:2.0:1789395157.807460:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.807463:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.807575:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+620:19221:x1876316231830016:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1773us (2059us total) trans 4294983981 rc 0/0 00000100:00100000:2.0:1789395157.807585:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23709 00010000:00010000:3.0:1789395157.810928:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.810949:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.810963:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.810969:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.810983:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.811007:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:3.0:1789395157.811011:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.811017:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.811029:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c902 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.811146:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.811149:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.811151:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395157.827295:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.827420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231830272 00000100:00100000:2.0:1789395157.827434:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231830272 00000100:00100000:2.0:1789395157.827575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23710 00000100:00100000:2.0:1789395157.827588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+620:19221:x1876316231830272:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.827671:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.827709:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab800/0xff35729af316bbb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106249 expref: 620 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827736:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff89a4c875dc00) 00010000:00010000:2.0:1789395157.827750:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.827790:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827807:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827822:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827832:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827839:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827856:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827939:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827947:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.827954:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.833529:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2506, 64 off168576 00010000:00010000:0.0:1789395157.833680:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833703:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833717:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833728:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833734:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833741:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833819:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.833850:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833857:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833864:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833869:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.833875:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833883:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833897:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:0.0:1789395157.833900:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.833906:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833912:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c917 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833939:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833945:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833950:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833955:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833960:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.833963:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833969:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833980:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.833983:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.833986:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.833991:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c909 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.834001:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bb45220 reply state 000000004a9b990e transno 4294983982 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.834014:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.834021:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x40eea295 (ffff89a4c875de00) 00010000:00010000:0.0:1789395157.834023:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.834027:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.834491:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+621:19221:x1876316231830272:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 6898us (7206us total) trans 4294983982 rc 0/0 00000100:00100000:0.0:1789395157.834503:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23710 00010000:00010000:2.0:1789395157.839858:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.839878:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.839892:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.839897:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.839908:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.839935:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:2.0:1789395157.839938:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.839944:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.839952:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316c91e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.839977:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.839980:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.839982:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.840643:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.840743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231830528 00000100:00100000:2.0:1789395157.840755:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231830528 00000100:00100000:2.0:1789395157.840876:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23711 00000100:00100000:2.0:1789395157.840888:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+621:19221:x1876316231830528:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.840964:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.840989:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abe00/0xff35729af316bbd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106250 expref: 621 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841006:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff89a4c875df00) 00010000:00010000:2.0:1789395157.841017:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.841045:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841061:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841073:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841089:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841097:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841104:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841195:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841205:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.841212:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.841996:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 64 off8576 00010000:00010000:2.0:1789395157.842078:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842090:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842099:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842108:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842115:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842124:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842210:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.842307:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842315:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842323:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842329:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.842335:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842345:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842358:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.842361:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.842365:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842373:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c933 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842425:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842437:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842443:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842450:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842455:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.842457:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842463:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842471:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.842473:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.842476:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842483:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c925 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.842494:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb7be48 reply state 000000001faf8d91 transno 4294983983 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842505:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.842511:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea16437d (ffff89a4c875d900) 00010000:00010000:2.0:1789395157.842514:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.842517:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.842813:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.842832:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.842838:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.842841:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.842858:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.842866:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:3.0:1789395157.842869:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.842871:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.842877:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c93a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.842897:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.842900:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.842902:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395157.843119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+622:19221:x1876316231830528:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2227us (2477us total) trans 4294983983 rc 0/0 00000100:00100000:2.0:1789395157.843130:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23711 00000100:00100000:1.0:1789395157.848498:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.849238:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231830784 00000100:00100000:0.0:1789395157.849254:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231830784 00000100:00100000:3.0:1789395157.849347:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23712 00000100:00100000:3.0:1789395157.849363:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+622:19221:x1876316231830784:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395157.849467:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395157.849501:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316bbf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106257 expref: 622 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849525:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:3.0:1789395157.849538:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395157.849567:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849584:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849595:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849607:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849616:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849622:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849702:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849709:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.849716:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395157.850302:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2507, 64 off168640 00010000:00010000:3.0:1789395157.850431:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850443:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850454:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850462:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850469:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850475:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850506:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395157.850529:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850535:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850543:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850549:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.850554:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850562:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850573:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff89a3ca308400) 00010000:00010000:3.0:1789395157.850576:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395157.850580:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850587:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c94f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850608:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850615:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850621:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850627:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850632:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.850635:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850642:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850650:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.850653:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.850656:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850667:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c941 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.850676:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5fca6a2 reply state 00000000a027a928 transno 4294983984 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850688:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.850695:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9897527d (ffff89a4c875d400) 00010000:00010000:3.0:1789395157.850697:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.850700:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395157.850806:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+623:19221:x1876316231830784:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1443us (2317us total) trans 4294983984 rc 0/0 00000100:00100000:3.0:1789395157.851186:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23712 00010000:00010000:1.0:1789395157.851284:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.851293:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.851300:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.851304:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.851311:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.851321:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff89a3ca308400) 00010000:00010000:1.0:1789395157.851324:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.851328:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.851334:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316c956 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.851352:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.851354:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.851355:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.856221:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.856479:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231831040 00000100:00100000:2.0:1789395157.856495:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231831040 00000100:00100000:2.0:1789395157.856572:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23713 00000100:00100000:2.0:1789395157.856584:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+623:19221:x1876316231831040:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.856664:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.856701:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316bc1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210625e expref: 623 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.856728:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff89a3ca363c00) 00010000:00010000:2.0:1789395157.856741:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.856782:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.856799:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.856812:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.856905:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.856913:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.856925:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857009:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857019:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857026:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.857558:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 64 off8640 00010000:00010000:2.0:1789395157.857651:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857661:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857669:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857678:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857685:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857692:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857717:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.857739:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857746:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857752:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857758:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.857773:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857782:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857793:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:2.0:1789395157.857797:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.857801:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.857807:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c96b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.857991:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.857999:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.858006:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.858010:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.858017:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.858026:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff89a3ca363800) 00010000:00010000:3.0:1789395157.858028:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.858031:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.858037:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316c972 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.858056:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.858058:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.858059:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.858220:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858298:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858305:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858316:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858322:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.858324:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858331:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858341:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.858343:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.858347:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858352:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c95d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.858365:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000410104b5 reply state 000000006c726c4f transno 4294983985 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858379:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.858479:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe423257d (ffff89a4c875d300) 00010000:00010000:2.0:1789395157.858482:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.858486:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.858666:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+624:19221:x1876316231831040:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2078us (2454us total) trans 4294983985 rc 0/0 00000100:00100000:2.0:1789395157.858677:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23713 00000100:00100000:2.0:1789395157.868932:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.869009:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231831296 00000100:00100000:3.0:1789395157.869022:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231831296 00000100:00100000:3.0:1789395157.869149:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23714 00000100:00100000:3.0:1789395157.869161:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+624:19221:x1876316231831296:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395157.869254:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395157.869291:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316bc3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106265 expref: 624 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869316:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff89a3ca363500) 00010000:00010000:3.0:1789395157.869330:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395157.869361:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869378:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869424:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869437:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869445:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869453:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869534:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869542:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869549:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395157.869854:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2508, 64 off168704 00010000:00010000:3.0:1789395157.869943:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869953:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869961:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869969:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869976:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.869982:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870005:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395157.870027:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870033:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870040:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870046:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.870051:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870059:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870069:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff89a3ca308600) 00010000:00010000:3.0:1789395157.870071:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395157.870075:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870081:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c987 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870101:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870107:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870113:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870124:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870129:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.870132:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870139:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870146:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.870149:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.870152:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870158:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c979 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.870167:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a4f371 reply state 000000005e462c04 transno 4294983986 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870180:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.870186:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x970cb47d (ffff89a3ca363200) 00010000:00010000:3.0:1789395157.870189:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.870192:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395157.870288:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+625:19221:x1876316231831296:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1126us (1368us total) trans 4294983986 rc 0/0 00000100:00100000:3.0:1789395157.870296:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23714 00010000:00010000:2.0:1789395157.870404:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.870412:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.870419:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.870422:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.870429:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.870438:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff89a3ca308600) 00010000:00010000:2.0:1789395157.870441:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.870444:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.870451:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316c98e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.870467:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.870469:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.870471:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.876704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.876818:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231831552 00000100:00100000:2.0:1789395157.876831:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231831552 00000100:00100000:2.0:1789395157.876996:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23715 00000100:00100000:2.0:1789395157.877009:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+625:19221:x1876316231831552:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.877091:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.877127:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316bc60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210626c expref: 625 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877168:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:2.0:1789395157.877181:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.877213:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877240:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877252:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877264:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877272:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877279:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877358:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877367:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877374:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.877727:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 64 off8704 00010000:00010000:2.0:1789395157.877823:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877833:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877842:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877864:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877871:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877877:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877898:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.877918:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877924:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877931:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877937:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.877942:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877950:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877960:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.877963:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.877967:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877972:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316c9a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877992:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.877998:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878002:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878008:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878012:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.878014:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878019:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878025:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.878028:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.878030:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878039:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316c995 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.878047:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ea36650 reply state 000000003c33f302 transno 4294983987 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878059:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.878065:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5239df7d (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395157.878067:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.878071:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.878165:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+626:19221:x1876316231831552:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1157us (1479us total) trans 4294983987 rc 0/0 00000100:00100000:2.0:1789395157.878173:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23715 00010000:00010000:3.0:1789395157.878272:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.878281:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.878287:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.878291:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.878297:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.878306:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:3.0:1789395157.878309:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.878312:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.878317:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316c9aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.878333:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.878335:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.878337:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.883052:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.883138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231831808 00000100:00100000:2.0:1789395157.883152:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231831808 00000100:00100000:2.0:1789395157.883228:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23716 00000100:00100000:2.0:1789395157.883249:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+626:19221:x1876316231831808:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.883332:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.883367:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316bc83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106273 expref: 626 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883435:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff89a3ca363b00) 00010000:00010000:2.0:1789395157.883449:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.883478:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883498:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883511:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883522:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883530:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883537:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883614:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883623:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.883630:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.883940:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2509, 64 off168768 00010000:00010000:2.0:1789395157.884026:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884045:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884053:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884060:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884067:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884085:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.884107:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884114:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884121:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884128:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.884133:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884142:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884152:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:2.0:1789395157.884155:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.884158:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884169:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316c9bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884190:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884196:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884202:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884209:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884214:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.884217:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884224:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884231:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.884233:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.884236:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884243:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316c9b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.884254:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035e48812 reply state 000000000d7d8c4b transno 4294983988 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884267:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.884273:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa5436e7d (ffff89a3ca363900) 00010000:00010000:2.0:1789395157.884276:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.884279:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.884380:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+627:19221:x1876316231831808:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1129us (1338us total) trans 4294983988 rc 0/0 00000100:00100000:2.0:1789395157.884420:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23716 00010000:00010000:1.0:1789395157.884515:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.884523:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.884530:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.884533:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.884541:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.884552:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:1.0:1789395157.884554:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.884558:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.884564:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316c9c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.884580:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.884582:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.884584:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.890269:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.890506:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231832064 00000100:00100000:3.0:1789395157.890519:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231832064 00000100:00100000:3.0:1789395157.890599:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23717 00000100:00100000:3.0:1789395157.890613:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+627:19221:x1876316231832064:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395157.890702:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395157.890740:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316bca6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210627a expref: 627 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890774:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff89a3ca363000) 00010000:00010000:3.0:1789395157.890789:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395157.890820:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890838:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890849:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890862:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890870:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890877:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890958:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890967:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.890975:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395157.891309:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].9, 64 off8768 00010000:00010000:3.0:1789395157.891451:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891462:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891471:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891479:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891485:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891492:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891512:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395157.891534:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891540:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891546:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891552:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.891557:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891566:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891575:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff89a3ca308500) 00010000:00010000:3.0:1789395157.891578:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395157.891582:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891588:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316c9db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891606:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891612:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891618:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891623:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891628:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.891631:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891636:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891642:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.891644:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.891647:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891653:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316c9cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.891662:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5e1749c reply state 0000000096d9bf85 transno 4294983989 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891674:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.891680:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xead1417d (ffff89a3ca363600) 00010000:00010000:3.0:1789395157.891682:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.891685:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395157.891783:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+628:19221:x1876316231832064:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1171us (1526us total) trans 4294983989 rc 0/0 00000100:00100000:3.0:1789395157.891790:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23717 00010000:00010000:2.0:1789395157.891895:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.891903:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.891911:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.891914:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.891920:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.891929:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff89a3ca308500) 00010000:00010000:2.0:1789395157.891931:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.891934:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.891939:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316c9e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.891954:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.891957:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.891959:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.896995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.897086:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231832320 00000100:00100000:2.0:1789395157.897099:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231832320 00000100:00100000:2.0:1789395157.897186:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23718 00000100:00100000:2.0:1789395157.897199:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+628:19221:x1876316231832320:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.897289:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.897325:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa200/0xff35729af316bcc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106281 expref: 628 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897350:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff89a4c875d800) 00010000:00010000:2.0:1789395157.897363:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.897438:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897455:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897467:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897479:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897487:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897493:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897566:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897574:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897582:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.897886:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2510, 64 off168832 00010000:00010000:2.0:1789395157.897974:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897984:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.897992:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898000:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898006:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898013:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898030:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.898050:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898057:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898068:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898075:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.898080:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898094:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898104:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:2.0:1789395157.898107:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.898110:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898116:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316c9f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898137:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898143:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898149:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898155:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898159:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.898163:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898169:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898176:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.898179:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.898182:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898188:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316c9e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.898198:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdbf57e3 reply state 0000000066258b0d transno 4294983990 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898212:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.898218:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d30507d (ffff89a4c875d500) 00010000:00010000:2.0:1789395157.898221:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.898224:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.898322:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+629:19221:x1876316231832320:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1123us (1340us total) trans 4294983990 rc 0/0 00000100:00100000:2.0:1789395157.898330:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23718 00010000:00010000:1.0:1789395157.898426:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.898434:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.898442:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.898446:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.898453:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.898464:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:1.0:1789395157.898466:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.898469:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.898476:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316c9fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.898492:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.898494:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.898495:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.903341:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.903492:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231832576 00000100:00100000:0.0:1789395157.903507:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231832576 00000100:00100000:0.0:1789395157.903584:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23719 00000100:00100000:0.0:1789395157.903596:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+629:19221:x1876316231832576:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.903691:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.903725:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab400/0xff35729af316bcec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106288 expref: 629 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903752:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff89a4c875da00) 00010000:00010000:0.0:1789395157.903775:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.903803:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903820:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903831:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903844:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903851:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903856:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903935:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903942:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.903949:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.904241:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].10, 64 off8832 00010000:00010000:0.0:1789395157.904327:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904337:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904344:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904352:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904359:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904365:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904855:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.904884:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904892:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904900:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904907:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.904912:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904920:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904936:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff89a4cbc0e800) 00010000:00010000:0.0:1789395157.904939:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.904943:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904949:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904972:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904979:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904984:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904990:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.904995:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.904999:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.905005:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.905012:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.905015:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.905018:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.905028:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.905037:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aca5222d reply state 000000003689e77e transno 4294983991 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.905050:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.905057:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa468b7d (ffff89a3ca363400) 00010000:00010000:0.0:1789395157.905060:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.905063:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.905171:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+630:19221:x1876316231832576:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1574us (1839us total) trans 4294983991 rc 0/0 00000100:00100000:0.0:1789395157.905181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23719 00010000:00010000:2.0:1789395157.906751:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.906776:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.906787:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.906793:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.906804:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.906823:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff89a4cbc0e800) 00010000:00010000:2.0:1789395157.906827:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.906831:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.906838:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.906861:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.906863:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.906865:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.911337:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.911442:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231832832 00000100:00100000:0.0:1789395157.911456:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231832832 00000100:00100000:0.0:1789395157.911528:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23720 00000100:00100000:0.0:1789395157.911540:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+630:19221:x1876316231832832:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.911619:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.911651:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316bd0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210628f expref: 630 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911675:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:0.0:1789395157.911686:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.911713:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911735:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911745:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911756:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911773:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911780:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911865:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911874:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.911881:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.912150:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2511, 64 off168896 00010000:00010000:0.0:1789395157.912235:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912245:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912253:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912261:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912269:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912275:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912300:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.912320:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912326:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912332:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912338:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.912343:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912352:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912359:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff89a4cbc0e600) 00010000:00010000:0.0:1789395157.912362:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.912366:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912376:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912442:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912449:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912454:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912460:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912464:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.912467:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912473:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912481:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.912483:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.912487:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912492:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.912502:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac058657 reply state 00000000a8d06941 transno 4294983992 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912513:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.912519:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdf501a7d (ffff89a3c90d5200) 00010000:00010000:0.0:1789395157.912521:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.912523:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.912613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+631:19221:x1876316231832832:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1074us (1288us total) trans 4294983992 rc 0/0 00000100:00100000:0.0:1789395157.912622:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23720 00010000:00010000:1.0:1789395157.912724:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.912733:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.912740:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.912743:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.912749:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.912759:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff89a4cbc0e600) 00010000:00010000:1.0:1789395157.912771:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.912775:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.912781:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.912802:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.912804:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.912806:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.918628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.918828:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231833088 00000100:00100000:2.0:1789395157.918841:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231833088 00000100:00100000:2.0:1789395157.918923:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23721 00000100:00100000:2.0:1789395157.918935:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+631:19221:x1876316231833088:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.919018:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.919055:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316bd32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106296 expref: 631 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919081:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff89a3ca363100) 00010000:00010000:2.0:1789395157.919093:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.919124:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919141:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919163:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919174:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919182:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919189:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919284:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919293:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919300:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.919628:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 64 off8896 00010000:00010000:2.0:1789395157.919712:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919721:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919728:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919736:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919743:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919750:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919783:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.919804:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919810:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919816:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919821:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.919827:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919835:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919844:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.919847:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.919851:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919857:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca4b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919879:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919884:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919889:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919893:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919897:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.919899:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919904:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919911:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.919913:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.919915:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919921:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.919929:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a8b9844 reply state 0000000064b3eaab transno 4294983993 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919941:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.919948:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b6840d2 (ffff89a3ca363f00) 00010000:00010000:2.0:1789395157.919950:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.919953:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.920048:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+632:19221:x1876316231833088:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1113us (1434us total) trans 4294983993 rc 0/0 00000100:00100000:2.0:1789395157.920057:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23721 00010000:00010000:0.0:1789395157.920245:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395157.920253:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.920261:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395157.920264:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.920272:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.920282:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:0.0:1789395157.920284:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395157.920287:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.920292:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.920309:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395157.920312:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395157.920314:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.928898:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.928972:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231833344 00000100:00100000:0.0:1789395157.928985:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231833344 00000100:00100000:0.0:1789395157.929055:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23722 00000100:00100000:0.0:1789395157.929066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+632:19221:x1876316231833344:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.929147:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.929182:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316bd55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210629d expref: 632 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929207:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff89a3ca363300) 00010000:00010000:0.0:1789395157.929220:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.929259:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929275:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929287:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929300:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929306:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929312:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929448:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929458:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929464:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.929756:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2512, 64 off168960 00010000:00010000:0.0:1789395157.929862:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929873:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929881:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929889:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929897:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929905:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929922:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.929944:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929952:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929963:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929969:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.929975:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929984:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.929994:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff89a4cbc0e100) 00010000:00010000:0.0:1789395157.929997:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.930002:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930008:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316ca67 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930028:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930034:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930039:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930044:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930049:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.930052:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930057:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930064:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.930066:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.930068:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930074:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ca59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.930083:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4e2946c reply state 0000000061fcc595 transno 4294983994 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930095:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.930101:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0674fd2 (ffff89a3ca363a00) 00010000:00010000:0.0:1789395157.930103:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.930106:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.930207:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+633:19221:x1876316231833344:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1139us (1320us total) trans 4294983994 rc 0/0 00000100:00100000:0.0:1789395157.930217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23722 00010000:00010000:1.0:1789395157.930847:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.930857:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.930866:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.930870:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.930880:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.930892:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff89a4cbc0e100) 00010000:00010000:1.0:1789395157.930894:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.930898:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.930904:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ca6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.930924:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.930926:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.930927:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.935179:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.935336:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231833600 00000100:00100000:2.0:1789395157.935351:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231833600 00000100:00100000:2.0:1789395157.935459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23723 00000100:00100000:2.0:1789395157.935473:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+633:19221:x1876316231833600:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.935553:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.935588:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316bd78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062a4 expref: 633 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935613:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff89a3c90d5e00) 00010000:00010000:2.0:1789395157.935627:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.935658:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935674:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935685:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935696:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935715:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935805:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935814:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.935821:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.936103:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 64 off8960 00010000:00010000:2.0:1789395157.936191:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936201:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936209:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936218:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936225:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936643:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936666:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.936692:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936699:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936705:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936712:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.936717:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936726:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936737:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.936740:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.936745:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936752:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316ca83 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936781:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936788:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936798:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936804:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936809:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.936812:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936818:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936827:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.936830:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.936833:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936839:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ca75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.936857:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f03da814 reply state 00000000fd3eaf07 transno 4294983995 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936869:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.936875:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x65f522d2 (ffff89a3c90d5f00) 00010000:00010000:2.0:1789395157.936878:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.936880:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395157.937044:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.937052:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.937060:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.937063:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.937070:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.937080:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:3.0:1789395157.937082:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.937085:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.937095:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316ca8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.937111:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.937113:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.937115:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395157.937153:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+634:19221:x1876316231833600:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1679us (1985us total) trans 4294983995 rc 0/0 00000100:00100000:2.0:1789395157.937162:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23723 00000100:00100000:0.0:1789395157.944771:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395157.944932:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231833856 00000100:00100000:3.0:1789395157.944948:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231833856 00000100:00100000:3.0:1789395157.945057:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23724 00000100:00100000:3.0:1789395157.945071:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+634:19221:x1876316231833856:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395157.945166:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395157.945202:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316bd9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ab expref: 634 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945236:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff89a3ca366000) 00010000:00010000:3.0:1789395157.945251:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395157.945284:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945302:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945314:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945327:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945335:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945342:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945473:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945482:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.945490:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395157.945798:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2513, 64 off169024 00010000:00010000:3.0:1789395157.946110:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946123:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946131:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946139:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946146:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946153:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946169:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395157.946192:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946199:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946206:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946212:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.946219:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.946322:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.946330:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.946336:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.946340:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.946349:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.946361:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff89a3ca308900) 00010000:00010000:1.0:1789395157.946364:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.946368:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.946374:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316caa6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.946418:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.946421:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.946423:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395157.946496:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946507:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff89a3ca308900) 00010000:00010000:3.0:1789395157.946510:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395157.946513:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946519:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316ca9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946546:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946553:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946559:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946570:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946575:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395157.946578:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946584:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946592:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395157.946595:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395157.946598:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946604:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316ca91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395157.946613:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a25ba6ca reply state 00000000fe849761 transno 4294983996 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946626:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.946633:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x38feb1d2 (ffff89a3ca366200) 00010000:00010000:3.0:1789395157.946635:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395157.946638:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395157.946757:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+635:19221:x1876316231833856:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1686us (2005us total) trans 4294983996 rc 0/0 00000100:00100000:3.0:1789395157.946777:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23724 00000100:00100000:1.0:1789395157.951064:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.951142:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231834112 00000100:00100000:2.0:1789395157.951162:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231834112 00000100:00100000:2.0:1789395157.951244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23725 00000100:00100000:2.0:1789395157.951257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+635:19221:x1876316231834112:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.951338:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.951378:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316bdbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062b2 expref: 635 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951444:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395157.951460:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.951489:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951507:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951520:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951532:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951540:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951547:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951633:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951642:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.951649:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.951963:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 64 off9024 00010000:00010000:2.0:1789395157.952047:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952057:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952065:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952072:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952079:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952092:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952109:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.952129:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952140:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952147:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952154:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.952159:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952168:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952178:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:2.0:1789395157.952182:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.952186:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952192:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316cabb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952215:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952221:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952227:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952232:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952239:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.952242:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952247:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952255:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.952257:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.952260:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952265:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316caad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.952275:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c3a8787 reply state 00000000882fdb9b transno 4294983997 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952287:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.952293:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7c0bdcd2 (ffff89a4c875dd00) 00010000:00010000:2.0:1789395157.952295:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.952298:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.952426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+636:19221:x1876316231834112:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1169us (1375us total) trans 4294983997 rc 0/0 00000100:00100000:2.0:1789395157.952435:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23725 00010000:00010000:0.0:1789395157.955462:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395157.955481:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.955494:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395157.955501:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.955513:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.955536:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff89a4d99b8600) 00010000:00010000:0.0:1789395157.955540:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395157.955547:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.955554:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cac2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.955589:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395157.955592:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395157.955594:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.957610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.957769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231834368 00000100:00100000:2.0:1789395157.957782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231834368 00000100:00100000:2.0:1789395157.957861:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23726 00000100:00100000:2.0:1789395157.957873:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+636:19221:x1876316231834368:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.957954:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.957987:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316bde1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062b9 expref: 636 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958008:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff89a3ca366400) 00010000:00010000:2.0:1789395157.958019:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.958049:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958067:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958078:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958091:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958099:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958106:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958186:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958195:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958208:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.958554:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2514, 64 off169088 00010000:00010000:2.0:1789395157.958640:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958650:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958658:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958667:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958673:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958680:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958706:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.958729:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958735:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958742:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958754:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.958759:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958779:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958789:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:2.0:1789395157.958792:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.958797:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958803:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316cad7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958823:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958830:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958836:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958842:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958848:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.958851:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958861:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958869:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.958871:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.958875:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958882:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cac9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.958893:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf0565de reply state 000000006dad211a transno 4294983998 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958904:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.958911:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x27156bd2 (ffff89a3ca366900) 00010000:00010000:2.0:1789395157.958913:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.958916:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.959016:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+637:19221:x1876316231834368:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1143us (1416us total) trans 4294983998 rc 0/0 00000100:00100000:2.0:1789395157.959025:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23726 00010000:00010000:1.0:1789395157.959291:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.959299:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.959306:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2c000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.959309:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.959315:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.959324:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff89a4d99b8a00) 00010000:00010000:1.0:1789395157.959326:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.959330:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.959336:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c000/0xff35729af316cade lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.959353:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.959355:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.959357:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.964096:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.964604:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231834624 00000100:00100000:2.0:1789395157.964619:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231834624 00000100:00100000:2.0:1789395157.964699:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23727 00000100:00100000:2.0:1789395157.964714:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+637:19221:x1876316231834624:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.964803:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.964836:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316be04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062c0 expref: 637 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.964871:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff89a3ca363d00) 00010000:00010000:2.0:1789395157.964884:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.964915:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.964930:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.964943:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.964956:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.964963:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.964969:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965047:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965055:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965063:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.965556:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 64 off9088 00010000:00010000:2.0:1789395157.965674:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965686:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965695:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965704:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965711:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965718:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965923:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.965949:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965956:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965963:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965969:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.965975:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965984:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.965997:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395157.966000:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.966004:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966011:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316caf3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966033:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966039:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966044:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966050:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966055:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.966058:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966063:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966071:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.966073:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.966075:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966085:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cae5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.966095:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d40d7ea4 reply state 0000000024ae8ca4 transno 4294983999 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966107:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.966113:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfd213ed2 (ffff89a3ca363e00) 00010000:00010000:2.0:1789395157.966116:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.966120:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.966324:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+638:19221:x1876316231834624:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1609us (2238us total) trans 4294983999 rc 0/0 00000100:00100000:2.0:1789395157.966333:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23727 00010000:00010000:3.0:1789395157.967040:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.967052:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.967060:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.967064:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.967074:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.967087:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:3.0:1789395157.967090:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.967094:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.967099:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cafa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.968854:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.968864:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.968866:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.971554:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.971739:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231834880 00000100:00100000:1.0:1789395157.971753:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231834880 00000100:00100000:1.0:1789395157.971836:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23728 00000100:00100000:1.0:1789395157.971899:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+638:19221:x1876316231834880:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395157.971980:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395157.972014:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316be27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062c7 expref: 638 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972035:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395157.972051:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395157.972079:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972094:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972106:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972119:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972131:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972198:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972350:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972359:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972365:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395157.972742:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2515, 64 off169152 00010000:00010000:1.0:1789395157.972974:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972987:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.972995:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973002:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973008:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973014:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973074:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395157.973098:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973106:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973113:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973121:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.973127:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973136:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973158:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff89a4c3c17200) 00010000:00010000:1.0:1789395157.973161:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395157.973166:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973172:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb0f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973197:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973204:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973215:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973221:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973299:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.973304:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973310:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973319:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.973321:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.973324:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973331:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.973342:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dffe0fd reply state 000000006fa4adcc transno 4294984000 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973355:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.973361:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x81a24dd2 (ffff89a4d3f0bd00) 00010000:00010000:1.0:1789395157.973363:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.973365:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395157.973567:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+639:19221:x1876316231834880:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1716us (2021us total) trans 4294984000 rc 0/0 00000100:00100000:1.0:1789395157.973576:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23728 00010000:00010000:3.0:1789395157.973734:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395157.973743:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.973750:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ae00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395157.973753:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.973769:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.973784:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff89a4c3c17200) 00010000:00010000:3.0:1789395157.973786:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395157.973789:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395157.973795:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb16 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.973926:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.973929:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.973931:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395157.978286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.978504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231835136 00000100:00100000:0.0:1789395157.978517:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231835136 00000100:00100000:0.0:1789395157.978619:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23729 00000100:00100000:0.0:1789395157.978631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+639:19221:x1876316231835136:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.978710:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.978748:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316be4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ce expref: 639 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978782:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff89a3ca366500) 00010000:00010000:0.0:1789395157.978795:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.978824:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978839:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978860:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978871:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978879:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978885:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978957:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.978972:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395157.979447:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 64 off9152 00010000:00010000:0.0:1789395157.979536:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979548:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979557:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979566:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979574:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979579:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979603:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395157.979628:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979634:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979641:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979647:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.979652:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979659:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979668:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff89a4cbc0e700) 00010000:00010000:0.0:1789395157.979671:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395157.979675:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979681:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb2b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979706:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979712:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979717:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979723:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979728:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395157.979731:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979736:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979743:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395157.979746:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395157.979749:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979755:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395157.979774:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000021602ee reply state 00000000db8481b1 transno 4294984001 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979787:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.979793:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6cc088d2 (ffff89a3ca366d00) 00010000:00010000:0.0:1789395157.979796:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395157.979798:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395157.979898:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+640:19221:x1876316231835136:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1266us (1675us total) trans 4294984001 rc 0/0 00000100:00100000:0.0:1789395157.979905:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23729 00010000:00010000:1.0:1789395157.980481:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.980489:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.980498:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.980502:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.980510:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.980521:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff89a4cbc0e700) 00010000:00010000:1.0:1789395157.980524:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.980527:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.980533:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.980553:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.980555:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.980557:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395157.984791:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395157.984884:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231835392 00000100:00100000:2.0:1789395157.984898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231835392 00000100:00100000:2.0:1789395157.984971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23730 00000100:00100000:2.0:1789395157.984983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+640:19221:x1876316231835392:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395157.985060:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395157.985094:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316be6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062d5 expref: 640 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985122:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff89a3ca366e00) 00010000:00010000:2.0:1789395157.985136:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395157.985172:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985188:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985199:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985211:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985219:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985234:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985323:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985331:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395157.985660:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2516, 64 off169216 00010000:00010000:2.0:1789395157.985743:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985754:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985773:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985783:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985790:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985796:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985818:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395157.985839:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985845:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985851:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985858:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.985863:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985872:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985881:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395157.985885:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395157.985888:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985894:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cb47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985914:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985921:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985926:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985932:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985937:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395157.985940:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985946:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985953:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395157.985955:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395157.985958:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985969:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cb39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395157.985978:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041962f7f reply state 00000000b889505b transno 4294984002 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985989:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.985995:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe9ca17d2 (ffff89a3ca366b00) 00010000:00010000:2.0:1789395157.985998:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395157.986001:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395157.986094:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+641:19221:x1876316231835392:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1111us (1314us total) trans 4294984002 rc 0/0 00000100:00100000:2.0:1789395157.986102:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23730 00010000:00010000:1.0:1789395157.986290:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395157.986298:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.986306:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395157.986309:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.986318:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.986329:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395157.986331:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395157.986334:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.986341:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cb4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.986359:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.986361:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395157.986363:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.991695:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395157.992072:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231835648 00000100:00100000:1.0:1789395157.992087:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231835648 00000100:00100000:1.0:1789395157.992171:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23731 00000100:00100000:1.0:1789395157.992183:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+641:19221:x1876316231835648:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395157.992271:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395157.992307:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316be90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062dc expref: 641 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992332:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff89a4c7eb6400) 00010000:00010000:1.0:1789395157.992345:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395157.992376:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992418:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992435:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992449:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992456:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992463:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992546:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992554:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.992561:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395157.993260:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 64 off9216 00010000:00010000:1.0:1789395157.993368:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993424:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993436:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993446:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993455:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993462:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993489:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395157.993515:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993522:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993528:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993534:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.993538:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993547:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993557:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff89a4c3c17f00) 00010000:00010000:1.0:1789395157.993560:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395157.993564:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993569:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cb63 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993595:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993601:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993607:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993612:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993617:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395157.993621:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993626:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993633:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395157.993636:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395157.993640:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993646:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cb55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395157.993656:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b962ddb reply state 00000000826791c0 transno 4294984003 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993668:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395157.993674:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa846083f (ffff89a3ca363700) 00010000:00010000:1.0:1789395157.993676:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395157.993679:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395157.993956:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+642:19221:x1876316231835648:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1769us (2269us total) trans 4294984003 rc 0/0 00000100:00100000:1.0:1789395157.993966:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23731 00010000:00010000:2.0:1789395157.994048:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395157.994057:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.994063:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395157.994067:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.994074:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.994085:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff89a4c3c17f00) 00010000:00010000:2.0:1789395157.994087:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395157.994090:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.994096:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cb6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395157.994114:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.994116:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395157.994118:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395157.999308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395157.999582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231835904 00000100:00100000:0.0:1789395157.999596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231835904 00000100:00100000:0.0:1789395157.999673:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23732 00000100:00100000:0.0:1789395157.999685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+642:19221:x1876316231835904:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395157.999775:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395157.999811:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316beb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062e3 expref: 642 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.999836:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff89a4c7eb6b00) 00010000:00010000:0.0:1789395157.999851:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395157.999880:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.999896:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.999908:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.999920:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.999931:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395157.999938:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000021:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000030:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000037:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.000347:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2517, 64 off169280 00010000:00010000:0.0:1789395158.000497:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000507:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000516:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000524:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000531:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000538:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000568:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.000590:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000597:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000602:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000607:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.000611:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000617:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000624:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff89a4cbc0ea00) 00010000:00010000:0.0:1789395158.000625:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.000629:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000632:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb7f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000649:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000653:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000660:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000663:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000666:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.000667:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000670:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000674:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.000675:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.000678:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000681:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.000686:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dedbb56e reply state 00000000f5971e90 transno 4294984004 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000694:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.000698:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb56f173f (ffff89a4c7eb6e00) 00010000:00010000:0.0:1789395158.000699:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.000701:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.000791:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+643:19221:x1876316231835904:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1106us (1496us total) trans 4294984004 rc 0/0 00000100:00100000:0.0:1789395158.000803:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23732 00010000:00010000:1.0:1789395158.000957:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.000965:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.000972:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.000976:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.000982:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.000992:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff89a4cbc0ea00) 00010000:00010000:1.0:1789395158.000994:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.000997:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.001002:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cb86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.001016:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.001017:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.001019:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.005846:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.006219:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231836160 00000100:00100000:0.0:1789395158.006289:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231836160 00000100:00100000:0.0:1789395158.006428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23733 00000100:00100000:0.0:1789395158.006440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+643:19221:x1876316231836160:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.006521:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.006557:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316bed6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ea expref: 643 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006583:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff89a3ca366c00) 00010000:00010000:0.0:1789395158.006596:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.006623:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006640:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006653:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006664:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006671:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006677:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006772:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006781:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.006788:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.007120:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9280 00010000:00010000:0.0:1789395158.007223:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007247:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007257:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007265:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007273:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007280:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007549:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.007574:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007586:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007593:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007600:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.007605:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007614:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007625:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff89a4cbc0ed00) 00010000:00010000:0.0:1789395158.007628:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.007632:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007639:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cb9b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007660:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007666:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007672:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007677:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007684:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.007687:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007693:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007701:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.007704:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.007707:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007713:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cb8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.007724:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000243315a4 reply state 0000000029ef05b3 transno 4294984005 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007736:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.007743:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5432ea3f (ffff89a3ca366300) 00010000:00010000:0.0:1789395158.007745:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.007748:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.007911:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+644:19221:x1876316231836160:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1470us (2078us total) trans 4294984005 rc 0/0 00000100:00100000:0.0:1789395158.007921:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23733 00010000:00010000:1.0:1789395158.011437:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.011455:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.011469:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.011475:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.011486:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.011514:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff89a4cbc0ed00) 00010000:00010000:1.0:1789395158.011518:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.011524:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.011531:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cba2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.011560:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.011563:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.011565:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.015947:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.016045:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231836416 00000100:00100000:1.0:1789395158.016057:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231836416 00000100:00100000:1.0:1789395158.016134:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23734 00000100:00100000:1.0:1789395158.016146:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+644:19221:x1876316231836416:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.016271:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.016308:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316bef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062f1 expref: 644 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016332:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff89a4c7eb6900) 00010000:00010000:1.0:1789395158.016345:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.016540:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016558:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016571:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016589:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016597:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016605:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016687:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016695:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.016701:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.017042:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2518, 64 off169344 00010000:00010000:1.0:1789395158.017780:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017800:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017812:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017820:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017826:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017834:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017917:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.017945:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017952:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017959:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017966:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.017973:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017982:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.017996:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff89a4c3c17e00) 00010000:00010000:1.0:1789395158.018000:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.018005:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018071:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316cbb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018101:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018329:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018336:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018343:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018349:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.018556:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018567:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018579:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.018582:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.018585:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018593:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cba9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.018606:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa9a8c8 reply state 000000007f51d612 transno 4294984006 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018620:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.018627:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7f3c793f (ffff89a4c7eb6100) 00010000:00010000:1.0:1789395158.018629:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.018633:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.018769:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+645:19221:x1876316231836416:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2611us (2820us total) trans 4294984006 rc 0/0 00000100:00100000:1.0:1789395158.018779:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23734 00010000:00010000:2.0:1789395158.018792:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.018802:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.018808:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.018811:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.018816:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.018826:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff89a4c3c17e00) 00010000:00010000:2.0:1789395158.018829:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.018832:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.018838:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cbbe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.018857:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.018859:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.018861:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395158.027079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.027425:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231836672 00000100:00100000:3.0:1789395158.027441:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231836672 00000100:00100000:3.0:1789395158.027518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23735 00000100:00100000:3.0:1789395158.027531:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+645:19221:x1876316231836672:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.027614:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.027650:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316bf1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062f8 expref: 645 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027674:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff89a3c8b1dc00) 00010000:00010000:3.0:1789395158.027688:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.027721:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027739:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027751:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027773:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027782:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027789:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027878:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027888:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.027895:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.028211:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 64 off9344 00010000:00010000:3.0:1789395158.028315:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028325:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028333:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028340:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028347:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028355:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028410:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.028433:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028439:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028445:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028450:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.028455:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028464:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028473:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff89a3ca308900) 00010000:00010000:3.0:1789395158.028476:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.028481:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028487:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cbd3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028505:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028516:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028522:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028529:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028534:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.028537:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028544:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028552:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.028555:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.028558:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028564:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cbc5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.028573:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045851323 reply state 00000000e0f0cfe8 transno 4294984007 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028586:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.028593:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x98e9a43f (ffff89a3c8b1da00) 00010000:00010000:3.0:1789395158.028596:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.028599:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.028701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+646:19221:x1876316231836672:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1169us (1634us total) trans 4294984007 rc 0/0 00000100:00100000:3.0:1789395158.028710:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23735 00010000:00010000:0.0:1789395158.028937:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.028946:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.028953:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.028957:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.028964:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.028974:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff89a3ca308900) 00010000:00010000:0.0:1789395158.028976:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.028979:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.028984:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cbda lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.029000:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.029002:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.029004:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.033966:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.034214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231836928 00000100:00100000:0.0:1789395158.034228:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231836928 00000100:00100000:0.0:1789395158.034448:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23736 00000100:00100000:0.0:1789395158.034461:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+646:19221:x1876316231836928:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.034549:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.034585:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316bf3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021062ff expref: 646 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034609:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff89a3ca366700) 00010000:00010000:0.0:1789395158.034622:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.034656:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034672:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034684:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034694:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034700:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034706:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034815:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034823:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.034830:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.035213:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2519, 64 off169408 00010000:00010000:0.0:1789395158.035475:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035486:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035497:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035504:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035510:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035515:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035532:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.035554:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035560:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035565:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035571:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.035575:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035583:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035592:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:0.0:1789395158.035595:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.035600:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035605:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cbef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035626:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035632:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035637:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035641:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035645:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.035647:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035653:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035659:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.035661:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.035664:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035669:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cbe1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.035677:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f1c82de reply state 00000000287e52e8 transno 4294984008 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035690:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.035695:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x43f3333f (ffff89a3ca366100) 00010000:00010000:0.0:1789395158.035697:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.035699:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.035827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+647:19221:x1876316231836928:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1364us (1871us total) trans 4294984008 rc 0/0 00000100:00100000:0.0:1789395158.035835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23736 00010000:00010000:1.0:1789395158.035942:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.035950:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.035956:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.035960:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.035967:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.035976:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:1.0:1789395158.035979:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.035981:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.035986:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cbf6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.036003:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.036006:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.036008:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.042724:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.042843:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231837184 00000100:00100000:2.0:1789395158.042866:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231837184 00000100:00100000:2.0:1789395158.042939:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23737 00000100:00100000:2.0:1789395158.042951:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+647:19221:x1876316231837184:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.043170:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.043207:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c400/0xff35729af316bf62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106306 expref: 647 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043246:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff89a4c7eb6d00) 00010000:00010000:2.0:1789395158.043260:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.043301:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043319:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043331:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043344:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043352:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043360:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043480:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043490:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.043498:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.043808:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9408 00010000:00010000:2.0:1789395158.044556:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044573:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044583:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044592:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044599:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044605:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044665:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.044690:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044697:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044705:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044716:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.044721:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044730:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044742:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.044745:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.044750:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044757:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc0b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044793:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044799:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044805:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044811:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044816:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.044819:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044829:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044837:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.044839:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.044842:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044859:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cbfd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.044869:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6050ce6 reply state 00000000d30009ea transno 4294984009 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044880:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.044886:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5ae1063f (ffff89a4c7eb6700) 00010000:00010000:2.0:1789395158.044888:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.044891:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.045008:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+648:19221:x1876316231837184:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2052us (2294us total) trans 4294984009 rc 0/0 00000100:00100000:2.0:1789395158.045086:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23737 00010000:00010000:1.0:1789395158.047092:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.047111:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.047125:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.047131:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.047210:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.047301:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.047305:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.047311:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.047319:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cc12 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.047355:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.047357:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.047359:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395158.050835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.050995:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231837440 00000100:00100000:3.0:1789395158.051009:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231837440 00000100:00100000:3.0:1789395158.051280:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23738 00000100:00100000:3.0:1789395158.051292:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+648:19221:x1876316231837440:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.051376:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.051438:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d400/0xff35729af316bf85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210630d expref: 648 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051465:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff89a4c7eb6a00) 00010000:00010000:3.0:1789395158.051479:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.051507:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051525:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051535:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051547:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051555:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051567:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051644:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051653:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.051660:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.051969:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2520, 64 off169472 00010000:00010000:3.0:1789395158.052414:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052427:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052436:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052445:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052452:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052458:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052478:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.052501:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052508:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052513:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052519:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.052525:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052533:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052543:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff89a3ca308c00) 00010000:00010000:3.0:1789395158.052546:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.052551:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052558:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cc27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052580:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052586:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052592:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052601:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052606:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.052609:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052614:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052620:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.052623:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.052626:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052631:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cc19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.052641:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b98a1ee reply state 000000008171be37 transno 4294984010 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052655:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.052661:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6fe0153f (ffff89a4c7eb6600) 00010000:00010000:3.0:1789395158.052663:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.052666:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.052779:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+649:19221:x1876316231837440:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1485us (1963us total) trans 4294984010 rc 0/0 00000100:00100000:3.0:1789395158.052789:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23738 00010000:00010000:2.0:1789395158.053244:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.053253:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.053261:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.053266:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.053274:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.053290:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff89a3ca308c00) 00010000:00010000:2.0:1789395158.053293:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.053296:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.053302:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cc2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.053320:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.053322:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.053324:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.062891:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.063271:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231837696 00000100:00100000:0.0:1789395158.063286:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231837696 00000100:00100000:0.0:1789395158.063364:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23739 00000100:00100000:0.0:1789395158.063375:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+649:19221:x1876316231837696:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.063796:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.063844:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316bfa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106314 expref: 649 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.063877:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff89a3ca366f00) 00010000:00010000:0.0:1789395158.063889:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.063921:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.063936:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.063948:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.063963:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.063970:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.063976:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064064:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064073:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064080:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.064468:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9472 00010000:00010000:0.0:1789395158.064563:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064575:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064583:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064592:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064598:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064606:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064625:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.064647:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064654:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064661:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064667:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.064673:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064682:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064694:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:0.0:1789395158.064697:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.064701:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064707:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316cc43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064730:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064740:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064745:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064750:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064755:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.064757:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064774:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064781:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.064783:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.064786:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064792:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.064803:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055cd3215 reply state 00000000cf1756e2 transno 4294984011 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064815:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.064822:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa91e503f (ffff89a3ca366a00) 00010000:00010000:0.0:1789395158.064825:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.064828:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.064941:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+650:19221:x1876316231837696:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1563us (2059us total) trans 4294984011 rc 0/0 00000100:00100000:0.0:1789395158.064950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23739 00010000:00010000:1.0:1789395158.065489:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.065499:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.065508:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.065513:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.065525:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.065537:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff89a4cbc0ec00) 00010000:00010000:1.0:1789395158.065540:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.065543:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.065549:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.065572:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.065574:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.065576:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.069664:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.069882:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231837952 00000100:00100000:2.0:1789395158.069896:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231837952 00000100:00100000:2.0:1789395158.069974:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23740 00000100:00100000:2.0:1789395158.069986:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+650:19221:x1876316231837952:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.070221:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.070268:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316bfcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210631b expref: 650 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070291:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff89a3c90d5d00) 00010000:00010000:2.0:1789395158.070304:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.070334:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070349:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070361:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070373:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070380:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070423:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070504:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070513:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.070520:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.070841:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2521, 64 off169536 00010000:00010000:2.0:1789395158.074450:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074481:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074494:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074503:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074510:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074517:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074538:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.074568:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074574:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074580:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074587:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.074592:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074600:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074615:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.074618:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.074624:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074630:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074660:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074667:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074672:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074677:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074683:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.074686:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074691:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074699:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.074701:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.074705:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074710:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.074721:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9dedff4 reply state 000000002f347bd0 transno 4294984012 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074733:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.074740:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfc27df3f (ffff89a3c90d5400) 00010000:00010000:2.0:1789395158.074743:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.074747:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.074877:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+651:19221:x1876316231837952:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 4883us (5220us total) trans 4294984012 rc 0/0 00000100:00100000:2.0:1789395158.074887:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23740 00010000:00010000:1.0:1789395158.075149:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.075158:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.075165:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.075170:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.075179:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.075189:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.075191:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.075197:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.075211:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cc66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.075240:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.075242:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.075244:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.082181:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.082550:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231838208 00000100:00100000:2.0:1789395158.082563:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231838208 00000100:00100000:2.0:1789395158.082676:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23741 00000100:00100000:2.0:1789395158.082689:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+651:19221:x1876316231838208:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.082779:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.082823:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316bfee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106322 expref: 651 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.082846:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff89a3c90d5900) 00010000:00010000:2.0:1789395158.082859:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.082888:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.082913:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.082924:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.082935:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.082947:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.082953:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083034:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083042:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083049:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.083445:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 64 off9536 00010000:00010000:2.0:1789395158.083531:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083542:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083552:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083561:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083569:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083578:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083605:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.083628:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083635:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083643:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083650:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.083656:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083665:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083675:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.083678:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.083682:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083689:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316cc7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083710:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083717:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083727:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083733:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083738:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.083740:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083746:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083754:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.083756:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.083759:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083777:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cc6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.083788:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f8115ac reply state 000000004e616abe transno 4294984013 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083800:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.083806:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a358594 (ffff89a3c90d5100) 00010000:00010000:2.0:1789395158.083809:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.083811:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.083924:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+652:19221:x1876316231838208:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1234us (1753us total) trans 4294984013 rc 0/0 00010000:00010000:1.0:1789395158.083932:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789395158.083937:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23741 00010000:00010000:1.0:1789395158.083944:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.083953:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.083957:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.083964:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.083976:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395158.083979:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.083986:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.083992:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316cc82 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.084012:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.084015:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.084017:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.089811:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.089934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231838464 00000100:00100000:0.0:1789395158.089948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231838464 00000100:00100000:0.0:1789395158.090070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23742 00000100:00100000:0.0:1789395158.090082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+652:19221:x1876316231838464:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.090175:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.090212:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c000/0xff35729af316c011 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106329 expref: 652 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090247:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff89a4c7eb6300) 00010000:00010000:0.0:1789395158.090263:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.090297:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090326:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090337:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090344:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090353:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090478:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090487:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090494:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.090807:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2522, 64 off169600 00010000:00010000:0.0:1789395158.090899:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090909:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090917:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090925:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090932:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090940:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.090970:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.090993:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091000:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091006:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091013:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.091018:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091027:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091037:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff89a4cbc0ed00) 00010000:00010000:0.0:1789395158.091041:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.091045:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091051:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cc97 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091072:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091078:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091083:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091092:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091097:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.091099:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091105:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091113:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.091116:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.091119:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091125:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316cc89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.091137:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f31ee3c9 reply state 00000000fb6f5f98 transno 4294984014 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091149:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.091156:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3f3f1494 (ffff89a4c7eb6800) 00010000:00010000:0.0:1789395158.091158:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.091162:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.091266:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+653:19221:x1876316231838464:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1183us (1466us total) trans 4294984014 rc 0/0 00000100:00100000:0.0:1789395158.091276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23742 00010000:00010000:2.0:1789395158.091353:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.091361:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.091369:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.091373:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.091410:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.091420:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff89a4cbc0ed00) 00010000:00010000:2.0:1789395158.091422:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.091426:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.091431:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316cc9e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.091447:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.091449:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.091451:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.095644:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.095771:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231838720 00000100:00100000:2.0:1789395158.095786:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231838720 00000100:00100000:2.0:1789395158.095868:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23743 00000100:00100000:2.0:1789395158.095880:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+653:19221:x1876316231838720:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.095953:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.095987:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ce00/0xff35729af316c034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106330 expref: 653 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096010:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff89a4c3ab8600) 00010000:00010000:2.0:1789395158.096022:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.096051:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096068:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096078:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096088:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096096:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096102:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096190:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096198:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096206:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.096540:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 64 off9600 00010000:00010000:2.0:1789395158.096623:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096632:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096640:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096648:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096655:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096662:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096678:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.096697:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096702:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096709:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096716:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.096721:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096730:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096739:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.096742:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.096745:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096751:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccb3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096786:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096794:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096799:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096805:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096810:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.096813:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096820:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096827:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.096830:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.096833:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096843:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cca5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.096854:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f6daea7 reply state 00000000f5602388 transno 4294984015 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096867:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.096874:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x584c3f94 (ffff89a4c7eb6000) 00010000:00010000:2.0:1789395158.096876:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.096879:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.096988:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+654:19221:x1876316231838720:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1106us (1353us total) trans 4294984015 rc 0/0 00000100:00100000:2.0:1789395158.096997:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23743 00010000:00010000:1.0:1789395158.097254:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.097265:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.097272:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.097276:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.097282:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.097292:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395158.097295:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.097298:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.097304:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ccba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.097324:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.097326:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.097328:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.101604:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.101684:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231838976 00000100:00100000:2.0:1789395158.101697:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231838976 00000100:00100000:2.0:1789395158.101770:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23744 00000100:00100000:2.0:1789395158.101782:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+654:19221:x1876316231838976:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.101877:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.101915:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316c057 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106337 expref: 654 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.101940:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff89a3c90d5600) 00010000:00010000:2.0:1789395158.101954:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.101990:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102013:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102026:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102040:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102048:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102054:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102162:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102171:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102178:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.102538:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2523, 64 off169664 00010000:00010000:2.0:1789395158.102647:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102658:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102667:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102680:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102688:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102694:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102716:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.102739:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102745:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102753:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102768:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.102774:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102785:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102795:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.102798:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.102802:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102813:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cccf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102838:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102844:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102851:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102857:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102862:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.102865:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102871:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102878:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.102881:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.102884:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102891:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316ccc1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.102901:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a6ea278 reply state 000000006d914784 transno 4294984016 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102914:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.102920:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x55367694 (ffff89a3c90d5300) 00010000:00010000:2.0:1789395158.102923:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.102926:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.103042:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+655:19221:x1876316231838976:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1258us (1449us total) trans 4294984016 rc 0/0 00000100:00100000:2.0:1789395158.103051:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23744 00010000:00010000:1.0:1789395158.103241:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.103250:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.103257:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.103261:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.103269:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.103284:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.103287:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.103290:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.103295:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ccd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.103317:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.103319:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.103321:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.109010:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.109078:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231839232 00000100:00100000:2.0:1789395158.109092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231839232 00000100:00100000:2.0:1789395158.109173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23745 00000100:00100000:2.0:1789395158.109185:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+655:19221:x1876316231839232:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.109277:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.109310:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316c07a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210633e expref: 655 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109328:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff89a3ca35f100) 00010000:00010000:2.0:1789395158.109338:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.109363:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109376:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109445:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109464:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109472:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109479:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109561:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109569:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.109574:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.109831:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 64 off9664 00010000:00010000:2.0:1789395158.110102:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110121:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110129:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110176:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110184:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110192:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110319:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.110345:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110352:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110359:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110364:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.110370:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110378:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110413:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.110416:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.110420:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110426:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cceb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110448:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110459:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110465:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110471:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110476:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.110479:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110485:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110492:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.110495:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.110498:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110504:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316ccdd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.110514:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038f9d5a0 reply state 000000003d0db774 transno 4294984017 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110527:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.110533:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf0e3a194 (ffff89a3ca366600) 00010000:00010000:2.0:1789395158.110536:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.110539:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.110643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+656:19221:x1876316231839232:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1456us (1646us total) trans 4294984017 rc 0/0 00000100:00100000:2.0:1789395158.110653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23745 00010000:00010000:1.0:1789395158.110731:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.110739:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.110745:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.110748:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.110755:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.110775:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395158.110778:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.110781:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.110787:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316ccf2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.110804:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.110807:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.110809:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.115374:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.116199:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231839488 00000100:00100000:2.0:1789395158.116223:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231839488 00000100:00100000:2.0:1789395158.116361:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23746 00000100:00100000:2.0:1789395158.116373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+656:19221:x1876316231839488:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.116480:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.116516:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015800/0xff35729af316c09d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106345 expref: 656 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116543:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff89a3c90d5700) 00010000:00010000:2.0:1789395158.116556:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.116587:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116603:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116614:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116627:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116634:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116645:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116722:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116730:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.116738:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.119514:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2524, 64 off169728 00010000:00010000:2.0:1789395158.119632:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119654:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119667:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119678:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119698:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119706:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119731:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.119770:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119777:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119784:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119791:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.119796:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119805:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119818:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.119821:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.119827:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.119834:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.120070:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.120078:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.120085:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.120088:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.120094:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.120104:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.120106:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.120109:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.120114:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd0e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120514:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120524:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120530:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120540:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120546:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.120549:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120556:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120565:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.120568:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.120571:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.120577:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ccf9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.124288:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048c1a48c reply state 000000000235ddf9 transno 4294984018 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.124321:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.124326:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.124330:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.124334:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.124347:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2fe2b094 (ffff89a3c90d5000) 00010000:00010000:2.0:1789395158.124352:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.124359:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.124530:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+657:19221:x1876316231839488:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 8151us (9165us total) trans 4294984018 rc 0/0 00000100:00100000:2.0:1789395158.124542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23746 00000100:00100000:3.0:1789395158.139663:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.139804:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231839744 00000100:00100000:2.0:1789395158.139818:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231839744 00000100:00100000:2.0:1789395158.139896:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23747 00000100:00100000:2.0:1789395158.139908:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+657:19221:x1876316231839744:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.139992:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.140030:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015c00/0xff35729af316c0c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210634c expref: 657 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140055:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff89a4c8e8dd00) 00010000:00010000:2.0:1789395158.140069:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.140101:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140122:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140134:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140148:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140155:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140161:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140267:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140280:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140286:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.140642:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off9728 00010000:00010000:2.0:1789395158.140727:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140737:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140744:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140752:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140770:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140778:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140811:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.140833:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140839:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140849:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140856:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.140862:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140870:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140880:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.140883:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.140886:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140892:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd23 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140914:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140921:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140927:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140933:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140938:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.140941:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140946:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140953:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.140955:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.140958:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140965:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.140975:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d271523 reply state 0000000040f87629 transno 4294984019 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140986:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.140992:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xc8efdb94 (ffff89a3c90d5500) 00010000:00010000:2.0:1789395158.140994:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.140997:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.141091:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+658:19221:x1876316231839744:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1182us (1441us total) trans 4294984019 rc 0/0 00000100:00100000:2.0:1789395158.141099:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23747 00010000:00010000:3.0:1789395158.141414:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.141424:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.141432:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.141436:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.141444:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.141455:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:3.0:1789395158.141458:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.141462:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.141467:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd2a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.141487:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.141489:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.141490:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.154029:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.154147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231840000 00000100:00100000:2.0:1789395158.154161:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231840000 00000100:00100000:2.0:1789395158.154249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23748 00000100:00100000:2.0:1789395158.154260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+658:19221:x1876316231840000:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.154339:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.154379:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316c0e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106353 expref: 658 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154454:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff89a3ca35fa00) 00010000:00010000:2.0:1789395158.154469:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.154499:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154515:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154527:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154539:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154546:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154553:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154639:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.154661:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.154967:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2525, 64 off169792 00010000:00010000:2.0:1789395158.155053:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155063:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155071:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155079:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155086:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155093:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155119:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.155141:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155148:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155154:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155161:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.155165:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155174:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155184:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.155187:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.155192:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155198:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cd3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155218:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155225:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155231:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155237:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155242:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.155244:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155250:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155256:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.155259:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.155262:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155271:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cd31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.155281:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008973608c reply state 0000000067d73724 transno 4294984020 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155293:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.155298:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x45da1294 (ffff89a3ca35fc00) 00010000:00010000:2.0:1789395158.155300:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.155303:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.155452:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+659:19221:x1876316231840000:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1191us (1436us total) trans 4294984020 rc 0/0 00000100:00100000:2.0:1789395158.155460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23748 00010000:00010000:1.0:1789395158.156131:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.156142:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.156152:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.156157:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.156171:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.156186:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395158.156188:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.156192:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.156198:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cd46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.156234:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.156237:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.156238:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.162974:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.164345:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231840256 00000100:00100000:2.0:1789395158.164364:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231840256 00000100:00100000:3.0:1789395158.164540:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23749 00000100:00100000:3.0:1789395158.164552:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+659:19221:x1876316231840256:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.164633:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.164668:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015000/0xff35729af316c106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210635a expref: 659 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164690:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff89a4c8e8d700) 00010000:00010000:3.0:1789395158.164703:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.164733:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164749:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164768:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164780:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164787:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164793:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164884:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164892:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.164899:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.165197:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 64 off9792 00010000:00010000:3.0:1789395158.165365:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165376:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165421:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165429:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165435:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165443:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165464:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.165487:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165494:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165501:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165507:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.165513:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165523:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165534:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff89a3ca308f00) 00010000:00010000:3.0:1789395158.165538:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.165542:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165549:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165569:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165576:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165583:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165589:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165595:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.165598:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165604:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165611:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.165615:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.165619:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165625:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.165635:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff6e1878 reply state 00000000103697bb transno 4294984021 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165649:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.165655:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd2f04d94 (ffff89a4c8e8d900) 00010000:00010000:3.0:1789395158.165657:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.165661:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.165776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+660:19221:x1876316231840256:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1223us (2814us total) trans 4294984021 rc 0/0 00000100:00100000:3.0:1789395158.165785:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23749 00010000:00010000:1.0:1789395158.167838:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.167857:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.167870:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.167877:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.167888:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.167919:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff89a3ca308f00) 00010000:00010000:1.0:1789395158.167922:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.167928:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.167935:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd62 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.167969:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.167971:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.167973:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.174460:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.174513:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231840512 00000100:00100000:1.0:1789395158.174527:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231840512 00000100:00100000:1.0:1789395158.174596:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23750 00000100:00100000:1.0:1789395158.174608:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+660:19221:x1876316231840512:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.174705:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.174743:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316c129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106361 expref: 660 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174777:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff89a3ca35f800) 00010000:00010000:1.0:1789395158.174793:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.174825:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174842:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174853:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174865:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174872:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174878:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174971:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174980:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.174987:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.175290:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2526, 64 off169856 00010000:00010000:1.0:1789395158.175430:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175441:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175450:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175459:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175465:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175471:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175497:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.175519:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175530:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175535:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.175537:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175542:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175543:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.175548:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.175548:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175552:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175558:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175559:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175575:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff89a4c3c17400) 00010000:00010000:2.0:1789395158.175578:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.175581:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff89a4c3c17400) 00010000:00010000:2.0:1789395158.175582:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175583:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.175586:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175589:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316cd7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175593:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316cd77 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.175606:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.175608:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.175610:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.175612:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175618:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175624:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175630:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175636:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.175639:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175645:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175653:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.175655:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.175659:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175664:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316cd69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.175674:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2a35c99 reply state 0000000029bf7811 transno 4294984022 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175685:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.175691:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7df9dc94 (ffff89a4c8e8d800) 00010000:00010000:1.0:1789395158.175693:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.175696:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.175813:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+661:19221:x1876316231840512:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1202us (1365us total) trans 4294984022 rc 0/0 00000100:00100000:1.0:1789395158.175823:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23750 00000100:00100000:2.0:1789395158.187087:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.187351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231840768 00000100:00100000:3.0:1789395158.187365:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231840768 00000100:00100000:3.0:1789395158.187470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23751 00000100:00100000:3.0:1789395158.187482:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+661:19221:x1876316231840768:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.187560:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.187599:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316c14c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106368 expref: 661 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187622:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff89a3ca35f200) 00010000:00010000:3.0:1789395158.187637:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.187812:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187831:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187844:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187866:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187872:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187879:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187962:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187970:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.187976:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.188966:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 64 off9856 00010000:00010000:3.0:1789395158.189312:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189331:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189349:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189360:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189368:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189376:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189503:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.189532:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189538:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189545:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189551:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.189557:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189566:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189582:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff89a3ca308a00) 00010000:00010000:3.0:1789395158.189585:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.189591:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189598:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cd93 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189625:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189631:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189636:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.189641:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.190289:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.190301:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.190322:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.190327:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.190338:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.190351:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff89a3ca308a00) 00010000:00010000:1.0:1789395158.190354:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.190357:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.190364:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cd9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.190428:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.190430:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.190433:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.192328:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.192340:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.192352:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.192375:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.192378:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.192525:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.192535:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316cd85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.192563:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab521b02 reply state 00000000351bf2fc transno 4294984023 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.192581:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.192590:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xda336479 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395158.192593:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.192598:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.192822:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+662:19221:x1876316231840768:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 5334us (5752us total) trans 4294984023 rc 0/0 00000100:00100000:3.0:1789395158.192833:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23751 00000100:00100000:0.0:1789395158.198357:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.198665:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231841024 00000100:00100000:2.0:1789395158.198678:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231841024 00000100:00100000:2.0:1789395158.198789:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23752 00000100:00100000:2.0:1789395158.198803:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+662:19221:x1876316231841024:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.198891:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.198925:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316c16f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210636f expref: 662 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.198948:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff89a3c8b1dd00) 00010000:00010000:2.0:1789395158.198961:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.198990:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199005:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199017:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199028:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199041:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199048:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199369:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199379:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.199607:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.201962:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2527, 64 off169920 00010000:00010000:2.0:1789395158.202309:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202333:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202347:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202357:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202364:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202371:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202427:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.202456:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202462:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202469:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202475:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.202480:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202489:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202504:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.202507:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.202512:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202518:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cdaf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202547:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202552:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202561:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202566:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202570:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.202573:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202577:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202585:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.202587:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.202590:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202596:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cda1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.202606:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb702a4 reply state 000000005449b381 transno 4294984024 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202618:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.202624:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3abc7379 (ffff89a3c8b1de00) 00010000:00010000:2.0:1789395158.202626:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.202629:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.202757:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+663:19221:x1876316231841024:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 3951us (4410us total) trans 4294984024 rc 0/0 00000100:00100000:2.0:1789395158.202775:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23752 00010000:00010000:1.0:1789395158.203111:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.203119:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.203127:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.203130:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.203147:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.203159:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395158.203162:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.203166:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.203171:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.203196:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.203197:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.203199:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.210138:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.210237:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231841280 00000100:00100000:2.0:1789395158.210251:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231841280 00000100:00100000:2.0:1789395158.210324:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23753 00000100:00100000:2.0:1789395158.210338:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+663:19221:x1876316231841280:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.210456:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.210490:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316c192 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106376 expref: 663 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210514:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:2.0:1789395158.210527:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.210557:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210574:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210585:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210597:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210606:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210612:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210695:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210703:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.210709:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.211604:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 64 off9920 00010000:00010000:2.0:1789395158.211701:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211715:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211723:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211732:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211737:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211744:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211815:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.211840:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211860:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211868:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211875:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.211881:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211890:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211903:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.211907:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.211913:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211919:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316cdcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211946:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211954:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211961:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211967:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211975:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.211978:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211984:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.211992:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.211994:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.211997:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.212002:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cdbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.212013:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085ab7bb1 reply state 00000000d29711e8 transno 4294984025 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.212025:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.212031:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x32204679 (ffff89a3c8b1db00) 00010000:00010000:2.0:1789395158.212033:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.212037:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.212148:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+664:19221:x1876316231841280:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1808us (2021us total) trans 4294984025 rc 0/0 00000100:00100000:2.0:1789395158.212158:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23753 00010000:00010000:1.0:1789395158.217075:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.217096:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.217110:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.217115:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.217127:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.217298:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.217305:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.217315:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.217321:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316cdd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395158.218188:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.218346:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231841536 00000100:00100000:2.0:1789395158.218359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231841536 00000100:00100000:2.0:1789395158.218468:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23754 00000100:00100000:2.0:1789395158.218481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+664:19221:x1876316231841536:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.218561:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.218589:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316c1b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210637d expref: 664 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218609:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff89a3ca35f700) 00010000:00010000:2.0:1789395158.218619:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.218650:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218668:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218679:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218691:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218698:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218704:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218802:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218810:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.218821:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.219840:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2528, 64 off169984 00010000:00010000:2.0:1789395158.219951:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.219965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.219976:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.219985:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.219992:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220000:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220030:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.220060:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.220067:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220074:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.220079:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220093:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220106:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.220109:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.220115:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220122:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220137:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.220139:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.220141:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.220156:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220163:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220169:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220174:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.220179:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220186:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220194:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.220203:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.220206:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220212:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cde7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220252:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220259:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220266:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220272:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220278:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.220281:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220288:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220296:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.220298:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.220302:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220309:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cdd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.220324:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006db422cb reply state 00000000fe9f7267 transno 4294984026 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220337:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.220343:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2f29d579 (ffff89a4c3ab8300) 00010000:00010000:2.0:1789395158.220346:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.220349:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.220478:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+665:19221:x1876316231841536:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1993us (2292us total) trans 4294984026 rc 0/0 00000100:00100000:2.0:1789395158.220488:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23754 00010000:00010000:0.0:1789395158.221412:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.221418:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.221420:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.226629:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.227083:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231841792 00000100:00100000:2.0:1789395158.227097:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231841792 00000100:00100000:2.0:1789395158.227182:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23755 00000100:00100000:2.0:1789395158.227194:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+665:19221:x1876316231841792:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.227296:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.227332:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d200/0xff35729af316c1d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106384 expref: 665 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227354:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff89a4c3ab8700) 00010000:00010000:2.0:1789395158.227368:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.227526:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227545:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227562:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227575:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227583:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227589:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227671:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227680:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.227688:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.228132:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 64 off9984 00010000:00010000:2.0:1789395158.228221:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228720:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228730:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228739:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228747:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228754:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228823:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.228858:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228865:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228873:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228879:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.228885:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228895:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228907:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.228910:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.228915:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228922:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce03 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228949:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228956:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228962:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228968:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228974:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.228976:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228982:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.228990:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.228992:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.228995:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.229001:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316cdf5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.229012:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010207484 reply state 00000000d8b60f09 transno 4294984027 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.229025:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.229032:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xcad70079 (ffff89a3c8b1df00) 00010000:00010000:2.0:1789395158.229034:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.229037:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.229153:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+666:19221:x1876316231841792:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1956us (2533us total) trans 4294984027 rc 0/0 00000100:00100000:2.0:1789395158.229162:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23755 00010000:00010000:1.0:1789395158.230550:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.230565:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.230576:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.230580:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.230592:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.230611:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:1.0:1789395158.230614:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.230618:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.230624:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce0a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.231709:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.231715:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.231718:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.235054:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.235142:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231842048 00000100:00100000:2.0:1789395158.235156:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231842048 00000100:00100000:2.0:1789395158.235243:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23756 00000100:00100000:2.0:1789395158.235257:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+666:19221:x1876316231842048:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.235358:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.235443:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47da00/0xff35729af316c1fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210638b expref: 666 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235468:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff89a4c3ab8000) 00010000:00010000:2.0:1789395158.235480:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.235510:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235528:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235539:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235553:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235560:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235566:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235646:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235655:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.235661:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.235967:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2529, 64 off170048 00010000:00010000:2.0:1789395158.236051:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236061:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236069:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236076:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236082:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236090:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236109:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.236131:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236138:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236146:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236153:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.236158:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236166:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236175:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.236178:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.236182:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236188:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce1f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236208:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236219:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236224:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236230:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236235:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.236238:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236244:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236251:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.236253:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.236257:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236262:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.236271:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000413ef99 reply state 000000006d773734 transno 4294984028 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236282:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.236287:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x71408f79 (ffff89a4c3ab8100) 00010000:00010000:2.0:1789395158.236289:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.236292:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.236417:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+667:19221:x1876316231842048:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1128us (1346us total) trans 4294984028 rc 0/0 00000100:00100000:2.0:1789395158.236427:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23756 00010000:00010000:1.0:1789395158.236999:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.237009:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.237018:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.237022:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.237030:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.237043:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.237046:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.237050:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.237058:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.237082:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.237084:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.237086:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.243077:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.243204:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231842304 00000100:00100000:0.0:1789395158.243219:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231842304 00000100:00100000:0.0:1789395158.243318:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23757 00000100:00100000:0.0:1789395158.243332:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+667:19221:x1876316231842304:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.243455:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.243494:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316c21e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106392 expref: 667 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243518:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff89a3ca35ff00) 00010000:00010000:0.0:1789395158.243534:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.243565:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243580:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243590:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243604:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243610:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243616:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243695:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243703:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.243710:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.244025:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 64 off10048 00010000:00010000:0.0:1789395158.244112:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244122:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244129:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244136:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244143:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244149:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244164:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.244187:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244193:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244199:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244204:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.244209:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244218:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244228:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff89a4cbc0ea00) 00010000:00010000:0.0:1789395158.244231:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.244235:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244240:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ce3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244262:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244269:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244274:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244284:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244289:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.244292:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244297:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244304:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.244307:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.244310:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244316:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316ce2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.244327:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eebcffad reply state 00000000e10c9b4d transno 4294984029 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244339:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.244344:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa2c3e279 (ffff89a3ca35fd00) 00010000:00010000:0.0:1789395158.244346:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.244349:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.244483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+668:19221:x1876316231842304:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1151us (1420us total) trans 4294984029 rc 0/0 00000100:00100000:0.0:1789395158.244491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23757 00010000:00010000:2.0:1789395158.244809:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.244818:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.244825:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.244829:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.244836:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.244846:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff89a4cbc0ea00) 00010000:00010000:2.0:1789395158.244849:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.244852:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.244858:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316ce42 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.244875:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.244877:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.244878:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.254009:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.254256:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231842560 00000100:00100000:2.0:1789395158.254270:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231842560 00000100:00100000:2.0:1789395158.254351:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23758 00000100:00100000:2.0:1789395158.254363:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+668:19221:x1876316231842560:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.254486:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.254523:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316c241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106399 expref: 668 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254549:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff89a3ca35f500) 00010000:00010000:2.0:1789395158.254564:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.254593:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254609:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254620:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254633:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254641:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254650:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254732:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254740:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.254746:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.255084:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2530, 64 off170112 00010000:00010000:2.0:1789395158.255171:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255181:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255189:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255196:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255203:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255210:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255227:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.255251:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255257:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255263:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255269:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.255274:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255284:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255294:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.255296:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.255300:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255305:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316ce57 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255326:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255332:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255338:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255345:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255350:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.255354:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255360:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255368:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.255371:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.255374:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255380:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316ce49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.255555:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.255564:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.255571:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.255574:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.255580:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.255589:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:0.0:1789395158.255592:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.255594:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.255600:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316ce5e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.255618:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.255619:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.255621:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789395158.255712:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002339e2cd reply state 00000000e4efc988 transno 4294984030 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255726:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.255733:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77cd7179 (ffff89a3ca35f600) 00010000:00010000:2.0:1789395158.255736:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.255739:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.256340:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+669:19221:x1876316231842560:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1972us (2341us total) trans 4294984030 rc 0/0 00000100:00100000:3.0:1789395158.256353:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23758 00000100:00100000:3.0:1789395158.261346:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.261520:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231842816 00000100:00100000:2.0:1789395158.261534:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231842816 00000100:00100000:2.0:1789395158.261609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23759 00000100:00100000:2.0:1789395158.261621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+669:19221:x1876316231842816:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.261700:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.261738:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d800/0xff35729af316c264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063a0 expref: 669 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261773:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff89a4c3ab8400) 00010000:00010000:2.0:1789395158.261788:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.261820:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261861:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261874:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261881:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261887:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261968:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261976:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.261983:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.262279:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 64 off10112 00010000:00010000:2.0:1789395158.262366:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262377:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262414:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262423:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262431:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262438:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262466:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.262487:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262494:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262502:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262509:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.262513:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262522:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262531:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.262535:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.262539:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262545:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316ce73 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262570:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262577:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262583:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262589:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262594:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.262596:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262602:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262610:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.262613:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.262616:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262621:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316ce65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.262631:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e6963d8 reply state 000000008feec826 transno 4294984031 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262643:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.262649:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe58bac79 (ffff89a4c3ab8b00) 00010000:00010000:2.0:1789395158.262652:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.262654:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.262749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+670:19221:x1876316231842816:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1128us (1416us total) trans 4294984031 rc 0/0 00000100:00100000:2.0:1789395158.262757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23759 00010000:00010000:3.0:1789395158.263758:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.263778:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.263788:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.263792:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.263802:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.263818:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:3.0:1789395158.263821:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.263827:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.263833:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316ce7a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.263854:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.263856:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.263858:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395158.268743:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.268880:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231843072 00000100:00100000:1.0:1789395158.268894:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231843072 00000100:00100000:1.0:1789395158.268980:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23760 00000100:00100000:1.0:1789395158.268993:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+670:19221:x1876316231843072:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.269077:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.269113:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316c287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063a7 expref: 670 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269136:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:1.0:1789395158.269161:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.269194:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269212:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269233:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269246:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269254:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269260:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269342:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269350:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.269357:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.269933:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2531, 64 off170176 00010000:00010000:1.0:1789395158.270021:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270032:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270040:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270049:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270056:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270062:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270085:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.270108:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270115:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270120:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270126:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.270131:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270139:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270150:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff89a4c3c17800) 00010000:00010000:1.0:1789395158.270152:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.270156:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270162:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316ce8f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270183:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270190:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270196:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270206:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270212:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.270215:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270221:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.270412:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.270421:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.270428:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.270432:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.270439:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.270448:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff89a4c3c17800) 00010000:00010000:3.0:1789395158.270451:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.270454:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.270461:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316ce96 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.270478:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.270480:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.270481:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.270614:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.270617:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.270621:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270627:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316ce81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.270638:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fe56c1f reply state 0000000059f79d3f transno 4294984032 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270651:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.270657:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8bf53b79 (ffff89a3c8b1d700) 00010000:00010000:1.0:1789395158.270659:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.270662:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.270806:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+671:19221:x1876316231843072:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1811us (2076us total) trans 4294984032 rc 0/0 00000100:00100000:1.0:1789395158.270816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23760 00000100:00100000:1.0:1789395158.275914:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.275991:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231843328 00000100:00100000:3.0:1789395158.276007:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231843328 00000100:00100000:3.0:1789395158.276085:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23761 00000100:00100000:3.0:1789395158.276097:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+671:19221:x1876316231843328:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.276185:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.276221:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316c2aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ae expref: 671 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276253:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff89a4c3ab8e00) 00010000:00010000:3.0:1789395158.276266:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.276297:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276314:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276325:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276338:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276344:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276350:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276476:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276486:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276497:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.276813:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 64 off10176 00010000:00010000:3.0:1789395158.276905:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276915:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276922:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276930:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276936:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276942:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276962:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.276984:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276989:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.276995:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277005:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.277010:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277018:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277027:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff89a3ca308100) 00010000:00010000:3.0:1789395158.277029:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.277032:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277038:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316ceab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277057:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277062:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277067:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277072:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277077:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.277079:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277088:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277095:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.277097:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.277100:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277105:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ce9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.277114:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5d2788d reply state 00000000cc912c13 transno 4294984033 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277126:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.277132:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa6a2e1ce (ffff89a4c3ab8f00) 00010000:00010000:3.0:1789395158.277134:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.277136:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.277237:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+672:19221:x1876316231843328:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1140us (1337us total) trans 4294984033 rc 0/0 00000100:00100000:3.0:1789395158.277247:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23761 00010000:00010000:0.0:1789395158.277780:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.277789:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.277797:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.277801:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.277808:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.277820:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff89a3ca308100) 00010000:00010000:0.0:1789395158.277822:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.277825:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.277830:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316ceb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.277851:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.277853:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.277855:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.283172:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.283968:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231843584 00000100:00100000:0.0:1789395158.283984:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231843584 00000100:00100000:0.0:1789395158.284107:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23762 00000100:00100000:0.0:1789395158.284121:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+672:19221:x1876316231843584:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.284329:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.284364:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316c2cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063b5 expref: 672 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284411:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff89a3ca35f400) 00010000:00010000:0.0:1789395158.284426:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.284455:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284470:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284481:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284498:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284506:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284513:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284592:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284601:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.284607:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.285042:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2532, 64 off170240 00010000:00010000:0.0:1789395158.285207:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285220:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285302:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285312:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285319:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285326:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285457:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.285482:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285489:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285496:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285503:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.285509:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285518:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285531:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff89a4cbc0e700) 00010000:00010000:0.0:1789395158.285534:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.285538:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285545:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cec7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285569:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285580:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285586:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285592:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285598:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.285601:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285607:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285616:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.285619:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.285622:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285627:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316ceb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.285639:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e0a830a reply state 000000006834eaa3 transno 4294984034 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285652:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.285658:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4d0c70ce (ffff89a3ca35f900) 00010000:00010000:0.0:1789395158.285662:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.285665:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.285789:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+673:19221:x1876316231843584:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1667us (2628us total) trans 4294984034 rc 0/0 00000100:00100000:0.0:1789395158.285798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23762 00000100:00100000:1.0:1789395158.290129:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.290253:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231843840 00000100:00100000:3.0:1789395158.290268:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231843840 00000100:00100000:3.0:1789395158.290345:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23763 00000100:00100000:3.0:1789395158.290358:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+673:19221:x1876316231843840:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.290497:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.290536:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d000/0xff35729af316c2f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063bc expref: 673 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290561:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff89a3ca35fb00) 00010000:00010000:3.0:1789395158.290576:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.290608:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290625:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290635:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290648:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290655:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290663:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290754:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290774:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.290783:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.291086:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 64 off10240 00010000:00010000:3.0:1789395158.291172:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.291181:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.291190:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.291198:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.291204:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.291211:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291422:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395158.291432:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291440:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.291445:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291455:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291467:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff89a4cbc0e700) 00010000:00010000:2.0:1789395158.291470:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.291474:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291481:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cece lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291502:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.291506:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291516:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.291519:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291525:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291532:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff89a3ca308200) 00010000:00010000:2.0:1789395158.291534:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.291537:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.291543:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.291545:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.291547:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.292099:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789395158.292108:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316ceea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292154:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292161:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292167:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292173:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.292178:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292186:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292197:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff89a3ca308200) 00010000:00010000:3.0:1789395158.292200:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.292203:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292208:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cee3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292413:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292421:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292426:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292432:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292437:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.292440:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292446:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292456:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.292459:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.292463:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292469:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316ced5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.292480:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a99e67b9 reply state 000000003edfa851 transno 4294984035 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292492:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.292500:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe8b99bce (ffff89a3ca35f300) 00010000:00010000:3.0:1789395158.292502:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.292506:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.292619:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+674:19221:x1876316231843840:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2259us (2498us total) trans 4294984035 rc 0/0 00000100:00100000:3.0:1789395158.292630:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23763 00000100:00100000:1.0:1789395158.296979:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.297070:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231844096 00000100:00100000:3.0:1789395158.297084:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231844096 00000100:00100000:3.0:1789395158.297165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23764 00000100:00100000:3.0:1789395158.297178:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+674:19221:x1876316231844096:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.297270:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.297308:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bace00/0xff35729af316c313 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063c3 expref: 674 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297331:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff89a4c3ab8900) 00010000:00010000:3.0:1789395158.297344:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.297378:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297579:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297593:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297609:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297617:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297625:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297708:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297717:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.297725:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.298053:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2533, 64 off170304 00010000:00010000:3.0:1789395158.298335:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298347:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298361:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298369:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298376:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298493:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.298702:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.298711:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.298719:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.298724:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.298733:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.298745:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff89a3ca308700) 00010000:00010000:2.0:1789395158.298748:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.298751:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.298774:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.298776:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.298778:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.298857:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789395158.298864:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8400/0xff35729af316cf06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298898:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298904:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298910:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298915:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.298920:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298926:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298938:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff89a3ca308700) 00010000:00010000:3.0:1789395158.298940:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.298943:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298948:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9600/0xff35729af316ceff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298972:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298979:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298984:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298990:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.298995:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.298998:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.299003:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.299009:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.299012:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.299014:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.299023:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cef1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.299033:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b37f0be reply state 0000000077fa6289 transno 4294984036 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.299044:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.299051:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x91a3d2ce (ffff89a4c3ab8d00) 00010000:00010000:3.0:1789395158.299053:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.299057:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.299180:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+675:19221:x1876316231844096:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2001us (2213us total) trans 4294984036 rc 0/0 00000100:00100000:3.0:1789395158.299190:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23764 00010000:00010000:1.0:1789395158.303005:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.303930:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.304076:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231844352 00000100:00100000:3.0:1789395158.304091:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231844352 00000100:00100000:3.0:1789395158.304216:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23765 00000100:00100000:3.0:1789395158.304238:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+675:19221:x1876316231844352:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.304321:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.304358:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37de00/0xff35729af316c336 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ca expref: 675 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304420:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff89a3ca2fb900) 00010000:00010000:3.0:1789395158.304438:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.304472:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304495:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304504:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304516:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304523:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304530:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304610:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304618:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.304626:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.305663:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 64 off10304 00010000:00010000:3.0:1789395158.305782:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305796:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305806:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305815:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305822:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305828:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305893:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.305920:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305926:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305933:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305940:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.305946:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305955:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305969:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff89a3ca308100) 00010000:00010000:3.0:1789395158.305973:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.305978:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.305988:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf1b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306010:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306017:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306024:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306030:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306035:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.306038:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306044:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306051:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.306054:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.306056:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306062:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.306074:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063b32685 reply state 000000007be4099b transno 4294984037 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306088:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.306094:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0d0fdce (ffff89a3ca35fe00) 00010000:00010000:3.0:1789395158.306096:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.306099:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.306221:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+676:19221:x1876316231844352:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1990us (2297us total) trans 4294984037 rc 0/0 00000100:00100000:3.0:1789395158.306232:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23765 00010000:00010000:2.0:1789395158.308400:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.308487:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.308501:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.308506:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.308517:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.308600:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff89a3ca308100) 00010000:00010000:2.0:1789395158.308604:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.308609:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.308616:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf22 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.308647:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.308650:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.308651:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395158.310832:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.310943:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231844608 00000100:00100000:3.0:1789395158.310962:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231844608 00000100:00100000:3.0:1789395158.311048:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23766 00000100:00100000:3.0:1789395158.311061:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+676:19221:x1876316231844608:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.311456:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.311494:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d400/0xff35729af316c359 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063d1 expref: 676 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.311519:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff89a3ca2fb600) 00010000:00010000:3.0:1789395158.311531:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.311633:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.311651:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.311662:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.311678:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.311686:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.311692:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.312238:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.312249:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.312256:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.312617:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2534, 64 off170368 00010000:00010000:3.0:1789395158.314075:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314100:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314114:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314123:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314130:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314216:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314302:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.314334:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314341:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314348:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314355:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.314360:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314368:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314402:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff89a3ca308200) 00010000:00010000:3.0:1789395158.314405:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.314412:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314419:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cf37 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314450:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314461:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314467:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314473:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314479:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.314483:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314490:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314498:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.314501:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.314504:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314511:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.314522:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049fce920 reply state 00000000e747154e transno 4294984038 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314535:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.314554:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95b00cce (ffff89a3ca2fb500) 00010000:00010000:3.0:1789395158.314557:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.314561:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.314683:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+677:19221:x1876316231844608:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 3620us (3854us total) trans 4294984038 rc 0/0 00000100:00100000:3.0:1789395158.314695:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23766 00010000:00010000:2.0:1789395158.315860:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.315872:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.315883:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.315887:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.315897:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.315914:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff89a3ca308200) 00010000:00010000:2.0:1789395158.315917:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.315922:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.315928:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cf3e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.315951:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.315953:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.315955:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.320159:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.320358:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231844864 00000100:00100000:3.0:1789395158.320373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231844864 00000100:00100000:3.0:1789395158.320485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23767 00000100:00100000:3.0:1789395158.320496:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+677:19221:x1876316231844864:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.320592:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.320627:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac000/0xff35729af316c37c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063d8 expref: 677 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320651:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff89a4c3ab8c00) 00010000:00010000:3.0:1789395158.320664:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.320696:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320712:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320722:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320733:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320740:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320751:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320856:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320865:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.320873:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.321171:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 64 off10368 00010000:00010000:3.0:1789395158.322056:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322073:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322085:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322094:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322100:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322107:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322173:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.322201:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322208:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322214:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322220:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.322235:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322244:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322257:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff89a3ca308700) 00010000:00010000:3.0:1789395158.322261:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.322266:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322272:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322299:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322306:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322311:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322320:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322325:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.322328:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322334:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322341:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.322344:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.322347:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322353:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cf45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.322364:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000542f749d reply state 00000000575c22c7 transno 4294984039 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322377:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.322421:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd0dd37ce (ffff89a4c3ab8200) 00010000:00010000:3.0:1789395158.322424:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.322430:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.324055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+678:19221:x1876316231844864:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2045us (2405us total) trans 4294984039 rc 0/0 00000100:00100000:3.0:1789395158.324070:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23767 00010000:00010000:2.0:1789395158.329721:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.329741:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.329755:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.329768:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.329781:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.329804:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff89a3ca308700) 00010000:00010000:2.0:1789395158.329808:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.329815:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.329826:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.329852:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.329854:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.329856:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.332050:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.332147:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231845120 00000100:00100000:3.0:1789395158.332160:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231845120 00000100:00100000:3.0:1789395158.332247:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23768 00000100:00100000:3.0:1789395158.332258:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+678:19221:x1876316231845120:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.332340:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.332378:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c000/0xff35729af316c39f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063df expref: 678 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.332445:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff89a3ca2fb700) 00010000:00010000:3.0:1789395158.332457:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.332487:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.332503:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.332513:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.332525:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.332531:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.332537:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.332919:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.332929:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.332937:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.333254:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2535, 64 off170432 00010000:00010000:0.0:1789395158.333345:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333356:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333364:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333372:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333379:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333425:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333454:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.333478:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333485:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333490:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333497:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.333501:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333510:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333521:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff89a4cbc0e100) 00010000:00010000:0.0:1789395158.333525:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.333530:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333535:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316cf6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333570:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333576:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333585:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333590:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333595:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.333597:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333604:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333612:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.333614:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.333617:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333625:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.333635:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7df9102 reply state 00000000813e8d50 transno 4294984040 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333646:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.333651:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77c76ece (ffff89a3ca2fba00) 00010000:00010000:0.0:1789395158.333653:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.333656:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.333772:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+679:19221:x1876316231845120:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1504us (1724us total) trans 4294984040 rc 0/0 00000100:00100000:0.0:1789395158.333782:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23768 00010000:00010000:3.0:1789395158.334379:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.334416:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.334428:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.334432:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.334442:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.334455:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff89a4cbc0e100) 00010000:00010000:3.0:1789395158.334457:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.334461:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.334466:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316cf76 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.334488:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.334491:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.334492:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.339776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.339963:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231845376 00000100:00100000:3.0:1789395158.339978:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231845376 00000100:00100000:3.0:1789395158.340066:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23769 00000100:00100000:3.0:1789395158.340079:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+679:19221:x1876316231845376:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.340166:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.340206:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad800/0xff35729af316c3c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063e6 expref: 679 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.340244:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff89a4c3ab8800) 00010000:00010000:3.0:1789395158.340259:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.340291:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.340307:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.340319:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.340331:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.340338:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.340344:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341088:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341103:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341112:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.341641:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 64 off10432 00010000:00010000:1.0:1789395158.341736:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341747:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341756:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341774:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341781:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341792:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341944:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.341975:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341982:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341989:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.341995:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.342001:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342009:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342022:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff89a4c3c17700) 00010000:00010000:1.0:1789395158.342025:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.342030:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342037:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cf8b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342062:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342072:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342077:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342083:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342088:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.342091:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342098:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342105:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.342108:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.342111:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342116:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cf7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.342130:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da755b0f reply state 0000000016b8c602 transno 4294984041 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342154:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.342161:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe585a9ce (ffff89a4c3ab8a00) 00010000:00010000:1.0:1789395158.342164:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.342167:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.342295:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+680:19221:x1876316231845376:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2213us (2538us total) trans 4294984041 rc 0/0 00000100:00100000:1.0:1789395158.342304:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23769 00010000:00010000:2.0:1789395158.342749:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.342772:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.342963:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.342969:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.342978:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.342989:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff89a4c3c17700) 00010000:00010000:2.0:1789395158.342992:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.342995:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.343001:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316cf92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.343023:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.343025:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.343027:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395158.350409:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.350490:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231845632 00000100:00100000:3.0:1789395158.350504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231845632 00000100:00100000:3.0:1789395158.350585:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23770 00000100:00100000:3.0:1789395158.350598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+680:19221:x1876316231845632:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.350686:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.350723:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad000/0xff35729af316c3e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063ed expref: 680 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.350749:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff89a4d0654000) 00010000:00010000:3.0:1789395158.350772:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.350804:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.350825:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.350837:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.351068:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.351080:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.351087:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.351325:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.351336:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.351344:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.351717:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2536, 64 off170496 00010000:00010000:3.0:1789395158.351817:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352025:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352041:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352051:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352058:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352066:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352090:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.352115:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.352120:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.352125:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352129:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.352218:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353212:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.353231:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353246:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353265:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff89a3ca308a00) 00010000:00010000:3.0:1789395158.353270:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.353270:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.353279:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.353279:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.353298:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353303:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316cfa7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353332:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353338:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353344:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353349:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353354:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.353358:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353363:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353370:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.353372:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.353376:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353381:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ae00/0xff35729af316cf99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.353413:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff8d9634 reply state 000000004941c397 transno 4294984042 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353429:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.353436:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4de4b8ce (ffff89a4d0654f00) 00010000:00010000:3.0:1789395158.353438:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.353442:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.353581:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+681:19221:x1876316231845632:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2980us (3208us total) trans 4294984042 rc 0/0 00000100:00100000:3.0:1789395158.353591:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23770 00010000:00010000:2.0:1789395158.354863:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff89a3ca308a00) 00010000:00010000:2.0:1789395158.354867:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.354875:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.354882:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316cfae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.354922:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.354925:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.354928:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.358367:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.358628:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231845888 00000100:00100000:1.0:1789395158.358643:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231845888 00000100:00100000:1.0:1789395158.358787:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23771 00000100:00100000:1.0:1789395158.358800:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+681:19221:x1876316231845888:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.358894:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.358931:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c400/0xff35729af316c408 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063f4 expref: 681 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.358957:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff89a3ca2fbd00) 00010000:00010000:1.0:1789395158.358970:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.359001:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359018:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359031:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359042:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359050:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359061:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359151:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359159:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359166:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.359505:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 64 off10496 00010000:00010000:1.0:1789395158.359601:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359613:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359623:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359632:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359640:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359646:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359673:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.359697:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359704:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359711:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359718:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.359723:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359733:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359743:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff89a4c3c17000) 00010000:00010000:1.0:1789395158.359746:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.359751:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359782:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316cfc3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359809:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359816:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359823:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359834:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359839:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.359842:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359850:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359857:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.359860:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.359863:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359870:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316cfb5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.359880:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bb880b0 reply state 000000008e188e25 transno 4294984043 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359891:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.359897:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5501ae7b (ffff89a3ca2fb400) 00010000:00010000:1.0:1789395158.359900:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.359903:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.360007:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+682:19221:x1876316231845888:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1207us (1650us total) trans 4294984043 rc 0/0 00000100:00100000:1.0:1789395158.360016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23771 00010000:00010000:2.0:1789395158.360093:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.360102:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.360111:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.360115:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.360122:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.360132:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff89a4c3c17000) 00010000:00010000:2.0:1789395158.360136:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.360139:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.360156:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316cfca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.360172:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.360174:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.360176:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.367252:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.367428:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231846144 00000100:00100000:2.0:1789395158.367443:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231846144 00000100:00100000:2.0:1789395158.367524:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23772 00000100:00100000:2.0:1789395158.367537:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+682:19221:x1876316231846144:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.367622:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.367661:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac600/0xff35729af316c42b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021063fb expref: 682 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367684:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff89a4d0654c00) 00010000:00010000:2.0:1789395158.367698:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.367732:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367750:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367775:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367790:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367799:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367805:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367905:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367914:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.367921:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.368515:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2537, 64 off170560 00010000:00010000:3.0:1789395158.368693:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368706:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368715:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368723:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368729:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368735:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368801:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.368826:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368833:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368840:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368855:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.368861:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368870:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368882:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:3.0:1789395158.368885:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.368890:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368897:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316cfdf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368921:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368927:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368933:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368939:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368945:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.368947:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368954:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368963:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.368965:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.368969:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368975:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316cfd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.368985:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a38ecd61 reply state 000000006515f5f0 transno 4294984044 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.368998:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.369004:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3d7b (ffff89a4d0654900) 00010000:00010000:3.0:1789395158.369006:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.369010:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.369121:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+683:19221:x1876316231846144:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1582us (1889us total) trans 4294984044 rc 0/0 00000100:00100000:3.0:1789395158.369130:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23772 00010000:00010000:2.0:1789395158.369778:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.369786:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.369794:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.369798:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.369808:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.369821:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.369824:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.369829:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.369840:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316cfe6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.369875:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.369877:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.369879:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.373896:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.374000:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231846400 00000100:00100000:2.0:1789395158.374017:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231846400 00000100:00100000:2.0:1789395158.374105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23773 00000100:00100000:2.0:1789395158.374118:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+683:19221:x1876316231846400:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.374211:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.374258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad200/0xff35729af316c44e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106402 expref: 683 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374283:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff89a4d0654100) 00010000:00010000:2.0:1789395158.374299:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.374331:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374346:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374357:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374371:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374378:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374444:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374529:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374537:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374545:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.374864:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 64 off10560 00010000:00010000:2.0:1789395158.374958:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374968:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374976:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374985:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.374992:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375000:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375028:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.375053:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375060:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375068:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375074:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.375079:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375089:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375099:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.375102:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.375107:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375113:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316cffb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375135:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375141:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375147:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375156:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375161:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.375164:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375171:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375178:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.375181:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.375184:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375190:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316cfed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.375201:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008158e8a3 reply state 0000000060ac14b2 transno 4294984045 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375212:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.375218:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x170e687b (ffff89a4d0654800) 00010000:00010000:2.0:1789395158.375221:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.375224:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.375315:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+684:19221:x1876316231846400:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1198us (1434us total) trans 4294984045 rc 0/0 00000100:00100000:2.0:1789395158.375323:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23773 00010000:00010000:0.0:1789395158.376106:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.376118:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.376129:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.376134:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.376146:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.376160:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:0.0:1789395158.376162:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.376167:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.376174:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d002 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.376200:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.376211:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.376213:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.380372:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.381063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231846656 00000100:00100000:1.0:1789395158.381078:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231846656 00000100:00100000:1.0:1789395158.381192:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23774 00000100:00100000:1.0:1789395158.381203:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+684:19221:x1876316231846656:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.381283:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.381315:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac800/0xff35729af316c471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106409 expref: 684 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381336:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff89a4d0654700) 00010000:00010000:1.0:1789395158.381348:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.381376:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381424:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381436:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381447:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381454:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381460:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381530:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381538:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381545:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.381820:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2538, 64 off170624 00010000:00010000:1.0:1789395158.381909:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381918:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381926:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381935:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381943:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381949:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381967:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.381985:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.381991:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382002:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382009:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.382014:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382022:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382031:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff89a4c3c17d00) 00010000:00010000:1.0:1789395158.382034:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.382038:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382043:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d017 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382062:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382068:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382075:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382080:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382085:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.382089:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382095:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382101:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.382103:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.382106:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382111:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d009 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.382119:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ffb8eb0 reply state 00000000b5065f8d transno 4294984046 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382129:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.382135:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95f89f7b (ffff89a3ca2fb100) 00010000:00010000:1.0:1789395158.382137:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.382139:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.382231:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+685:19221:x1876316231846656:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1027us (1869us total) trans 4294984046 rc 0/0 00000100:00100000:1.0:1789395158.382239:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23774 00010000:00010000:2.0:1789395158.385918:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.385942:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.385957:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.385963:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.385976:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.385999:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff89a4c3c17d00) 00010000:00010000:2.0:1789395158.386003:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.386009:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.386018:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d01e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.386049:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.386052:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.386055:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.386081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.386217:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231846912 00000100:00100000:0.0:1789395158.386240:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231846912 00000100:00100000:0.0:1789395158.386319:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23775 00000100:00100000:0.0:1789395158.386331:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+685:19221:x1876316231846912:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.386442:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.386466:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47de00/0xff35729af316c494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106410 expref: 685 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386481:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff89a4d0654400) 00010000:00010000:0.0:1789395158.386490:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.386521:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386538:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386550:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386562:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386570:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386576:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386655:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386663:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.386669:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.386976:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 64 off10624 00010000:00010000:0.0:1789395158.387056:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387065:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387073:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387080:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387086:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387093:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387120:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.387139:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387144:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387150:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387155:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.387159:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387165:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387175:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff89a4cbc0e600) 00010000:00010000:0.0:1789395158.387177:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.387180:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387186:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d033 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387204:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387209:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387214:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387220:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387224:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.387226:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387231:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387236:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.387238:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.387240:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387251:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d025 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.387261:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068fc4ad5 reply state 0000000051040c61 transno 4294984047 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387272:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.387278:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd905ca7b (ffff89a4d0654200) 00010000:00010000:0.0:1789395158.387280:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.387283:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.387411:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+686:19221:x1876316231846912:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1051us (1306us total) trans 4294984047 rc 0/0 00000100:00100000:0.0:1789395158.387419:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23775 00010000:00010000:3.0:1789395158.388120:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.388131:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.388141:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.388145:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.388155:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.388169:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff89a4cbc0e600) 00010000:00010000:3.0:1789395158.388172:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.388176:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.388182:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d03a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.388202:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.388204:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.388206:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.391162:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.391215:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231847168 00000100:00100000:3.0:1789395158.391232:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231847168 00000100:00100000:3.0:1789395158.391297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23776 00000100:00100000:3.0:1789395158.391308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+686:19221:x1876316231847168:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.391429:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.391463:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316c4b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106417 expref: 686 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391490:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff89a3ca1c2000) 00010000:00010000:3.0:1789395158.391501:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.391526:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391539:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391547:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391555:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391560:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391564:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391629:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391635:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.391641:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.391936:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2539, 64 off170688 00010000:00010000:3.0:1789395158.392025:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392032:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392037:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392042:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392047:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392051:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392067:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.392082:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392085:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392089:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392093:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.392098:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392104:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392111:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff89a3ca308f00) 00010000:00010000:3.0:1789395158.392113:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.392116:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392120:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d04f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392134:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392139:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392145:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392150:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392155:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.392158:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392164:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.392174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.392177:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392188:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d041 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.392198:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d10bf195 reply state 0000000045e9de0d transno 4294984048 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392215:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.392221:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xee04d97b (ffff89a4d0654e00) 00010000:00010000:3.0:1789395158.392224:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.392227:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395158.392311:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789395158.392328:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+687:19221:x1876316231847168:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1022us (1177us total) trans 4294984048 rc 0/0 00010000:00010000:2.0:1789395158.392328:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.392335:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00000100:00100000:3.0:1789395158.392337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23776 00010000:00010000:2.0:1789395158.392339:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.392345:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.392358:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff89a3ca308f00) 00010000:00010000:2.0:1789395158.392360:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.392364:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.392369:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d056 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.392412:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.392414:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.392416:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.396745:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.396990:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231847424 00000100:00100000:1.0:1789395158.397005:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231847424 00000100:00100000:1.0:1789395158.397112:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23777 00000100:00100000:1.0:1789395158.397126:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+687:19221:x1876316231847424:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.397300:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.397337:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac400/0xff35729af316c4da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210641e expref: 687 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397358:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff89a3ca1c2c00) 00010000:00010000:1.0:1789395158.397371:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.397443:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397460:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397470:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397481:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397488:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397493:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397575:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397584:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.397591:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.397907:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 64 off10688 00010000:00010000:1.0:1789395158.397992:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398003:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398011:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398019:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398026:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398033:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398051:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.398072:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398078:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398085:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398091:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.398096:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398105:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398115:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff89a4c3c17300) 00010000:00010000:1.0:1789395158.398117:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.398121:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398127:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d06b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398157:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398164:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398169:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398175:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398179:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.398182:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398188:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398194:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.398197:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.398200:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398209:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d05d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.398218:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007394e755 reply state 000000000275014c transno 4294984049 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398229:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.398235:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdfb2047b (ffff89a3ca1c2d00) 00010000:00010000:1.0:1789395158.398237:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.398240:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.398338:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+688:19221:x1876316231847424:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1212us (1605us total) trans 4294984049 rc 0/0 00000100:00100000:1.0:1789395158.398346:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23777 00010000:00010000:0.0:1789395158.399062:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.399072:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.399080:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.399084:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.399092:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.399104:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff89a4c3c17300) 00010000:00010000:0.0:1789395158.399107:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.399111:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.399116:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d072 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.399136:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.399138:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.399140:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.407158:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.407265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231847680 00000100:00100000:1.0:1789395158.407280:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231847680 00000100:00100000:1.0:1789395158.407359:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23778 00000100:00100000:1.0:1789395158.407370:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+688:19221:x1876316231847680:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.407624:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.407660:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014c00/0xff35729af316c4fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106425 expref: 688 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.407687:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff89a4c8e8d000) 00010000:00010000:1.0:1789395158.407703:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.407733:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.407754:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.407779:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.407791:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.407799:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.407805:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.410084:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.410116:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.410129:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.410971:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2540, 64 off170752 00010000:00010000:1.0:1789395158.411072:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411085:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411096:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411105:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411112:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411119:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411212:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.411247:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411254:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411261:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411268:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.411273:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411282:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411295:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff89a4c3c17500) 00010000:00010000:1.0:1789395158.411299:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.411304:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411373:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d087 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411469:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.411477:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411480:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411485:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.411487:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411489:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411494:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411496:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411501:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411506:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff89a4c3c17500) 00010000:00010000:1.0:1789395158.411507:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.411508:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.411510:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411511:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411517:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411518:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d08e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411525:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.411527:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.411530:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411536:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.411536:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d079 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.411538:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.411540:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789395158.411546:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d0f7623 reply state 00000000d532ec70 transno 4294984050 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411560:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.411567:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x869c3b7b (ffff89a4c8e8db00) 00010000:00010000:1.0:1789395158.411569:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.411573:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.411782:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+689:19221:x1876316231847680:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 4407us (4633us total) trans 4294984050 rc 0/0 00000100:00100000:1.0:1789395158.411792:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23778 00000100:00100000:3.0:1789395158.416266:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.416594:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231847936 00000100:00100000:0.0:1789395158.416608:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231847936 00000100:00100000:0.0:1789395158.416688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23779 00000100:00100000:0.0:1789395158.416701:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+689:19221:x1876316231847936:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.416789:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.416825:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c600/0xff35729af316c520 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210642c expref: 689 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.416848:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff89a3ca2fb800) 00010000:00010000:0.0:1789395158.416862:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.416903:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.416920:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.416930:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.416941:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.416948:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.416954:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417040:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417049:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417056:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.417607:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 64 off10752 00010000:00010000:0.0:1789395158.417697:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417718:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417726:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417733:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417740:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417766:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.417789:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417796:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417802:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417808:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.417814:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417822:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417832:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff89a4cbc0e800) 00010000:00010000:0.0:1789395158.417835:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.417839:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417844:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417877:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417883:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417892:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417898:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417902:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.417905:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417910:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417917:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.417919:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.417922:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417928:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d095 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.417942:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093a1a3b0 reply state 00000000deae336e transno 4294984051 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417957:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.417965:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9bba767b (ffff89a3ca2fb300) 00010000:00010000:0.0:1789395158.417967:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.417970:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395158.418189:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.418198:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.418204:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.418208:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.418215:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.418234:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff89a4cbc0e800) 00010000:00010000:3.0:1789395158.418237:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.418241:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.418247:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d0aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.418266:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.418268:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.418270:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.418530:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+690:19221:x1876316231847936:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1827us (2275us total) trans 4294984051 rc 0/0 00000100:00100000:0.0:1789395158.418541:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23779 00000100:00100000:0.0:1789395158.423987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.424222:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231848192 00000100:00100000:1.0:1789395158.424236:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231848192 00000100:00100000:1.0:1789395158.424323:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23780 00000100:00100000:1.0:1789395158.424336:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+690:19221:x1876316231848192:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.424516:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.424552:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0ca00/0xff35729af316c543 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106433 expref: 690 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424575:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff89a3ca1c2800) 00010000:00010000:1.0:1789395158.424589:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.424619:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424634:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424645:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424659:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424666:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424671:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424754:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424775:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.424783:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.425080:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2541, 64 off170816 00010000:00010000:1.0:1789395158.425173:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425183:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425190:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425197:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425204:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425210:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425238:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.425258:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425264:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425270:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425276:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.425281:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425289:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425298:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff89a4c3c17500) 00010000:00010000:1.0:1789395158.425301:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.425304:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425310:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d0bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425332:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425343:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425349:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425354:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425360:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.425363:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425369:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425376:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.425379:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.425381:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425411:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d0b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.425421:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096e58642 reply state 00000000b8864441 transno 4294984052 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.425422:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.425429:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425433:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.425436:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.425439:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.425439:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b9857b (ffff89a3ca1c2900) 00010000:00010000:1.0:1789395158.425443:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.425446:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395158.425447:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.425455:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff89a4c3c17500) 00010000:00010000:3.0:1789395158.425457:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.425459:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.425464:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d0c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.425478:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.425480:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.425482:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.425540:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+691:19221:x1876316231848192:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1204us (1565us total) trans 4294984052 rc 0/0 00000100:00100000:1.0:1789395158.425549:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23780 00000100:00100000:1.0:1789395158.432454:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.432554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231848448 00000100:00100000:3.0:1789395158.432568:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231848448 00000100:00100000:3.0:1789395158.432645:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23781 00000100:00100000:3.0:1789395158.432657:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+691:19221:x1876316231848448:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.432741:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.432787:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015e00/0xff35729af316c566 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210643a expref: 691 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.432811:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff89a4c8e8df00) 00010000:00010000:3.0:1789395158.432826:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.433022:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433041:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433053:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433065:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433072:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433078:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433302:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433311:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433323:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.433699:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 64 off10816 00010000:00010000:3.0:1789395158.433800:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433812:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433820:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433828:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433834:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.433841:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434035:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.434062:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434069:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434076:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434087:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.434093:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434103:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434116:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff89a3ca308c00) 00010000:00010000:3.0:1789395158.434119:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.434124:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434130:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d0db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434163:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434169:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434175:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434180:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434185:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.434187:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434197:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434205:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.434208:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.434211:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434218:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d0cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.434239:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018756238 reply state 00000000189d3d96 transno 4294984053 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434253:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.434259:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb4d1abd0 (ffff89a4c8e8d400) 00010000:00010000:3.0:1789395158.434261:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.434265:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395158.434281:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.434290:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.434296:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.434299:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.434305:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.434379:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff89a3ca308c00) 00010000:00010000:0.0:1789395158.434382:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1789395158.434419:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+692:19221:x1876316231848448:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1727us (2015us total) trans 4294984053 rc 0/0 00000100:00100000:3.0:1789395158.434429:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23781 00010000:00010000:0.0:1789395158.434560:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.434566:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d0e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.434583:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.434585:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.434586:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.439505:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.439663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231848704 00000100:00100000:0.0:1789395158.439689:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231848704 00000100:00100000:0.0:1789395158.439776:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23782 00000100:00100000:0.0:1789395158.439790:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+692:19221:x1876316231848704:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.439890:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.439929:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316c589 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106441 expref: 692 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.439953:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff89a3ca2fbe00) 00010000:00010000:0.0:1789395158.439967:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.439998:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440014:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440027:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440038:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440045:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440052:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440139:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440148:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440155:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.440534:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2542, 64 off170880 00010000:00010000:0.0:1789395158.440628:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440638:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440645:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440653:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440660:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440666:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.440976:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.441003:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441011:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441018:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441025:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.441031:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441040:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441054:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395158.441057:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.441062:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441069:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d0f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441094:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441100:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441105:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441110:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441114:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.441117:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441123:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441130:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.441132:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.441135:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441146:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d0e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.441156:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000750b0a62 reply state 0000000093b00fd4 transno 4294984054 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441169:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.441175:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7db3ad0 (ffff89a3ca2fbc00) 00010000:00010000:0.0:1789395158.441178:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.441181:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.441365:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+693:19221:x1876316231848704:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1573us (1871us total) trans 4294984054 rc 0/0 00000100:00100000:0.0:1789395158.441376:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23782 00010000:00010000:2.0:1789395158.441655:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.441716:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.441725:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.441728:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.441736:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.441747:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:2.0:1789395158.441750:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.441753:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.441767:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d0fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.441786:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.441788:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.441789:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.448114:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.448368:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231848960 00000100:00100000:0.0:1789395158.448411:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231848960 00000100:00100000:0.0:1789395158.448487:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23783 00000100:00100000:0.0:1789395158.448499:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+693:19221:x1876316231848960:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.448578:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.448614:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316c5ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106448 expref: 693 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.448640:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff89a3ca1c2500) 00010000:00010000:0.0:1789395158.448654:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.448685:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.448707:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.448720:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.448731:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.448739:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.448745:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.449360:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.449373:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.449381:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.449794:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 64 off10880 00010000:00010000:0.0:1789395158.450000:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450011:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450020:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450028:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450034:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450041:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450068:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.450217:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450567:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450576:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450583:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.450588:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450598:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450611:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:0.0:1789395158.450615:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.450619:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450630:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d113 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450659:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450666:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450671:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450677:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450683:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.450686:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450692:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450700:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.450703:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.450706:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450713:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d105 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.450725:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000736a50f0 reply state 0000000041249eb1 transno 4294984055 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450740:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.450747:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x798865d0 (ffff89a3ca1c2e00) 00010000:00010000:0.0:1789395158.450750:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.450754:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395158.451029:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.451038:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.451045:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.451048:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.451056:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.451065:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff89a4cbc0e300) 00010000:00010000:3.0:1789395158.451067:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.451071:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.451215:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d11a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.451308:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.451311:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.451313:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.451425:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+694:19221:x1876316231848960:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2921us (3321us total) trans 4294984055 rc 0/0 00000100:00100000:0.0:1789395158.451436:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23783 00000100:00100000:1.0:1789395158.456936:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.457098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231849216 00000100:00100000:3.0:1789395158.457113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231849216 00000100:00100000:3.0:1789395158.457205:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23784 00000100:00100000:3.0:1789395158.457217:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+694:19221:x1876316231849216:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.457308:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.457347:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b400/0xff35729af316c5cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210644f expref: 694 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457373:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff89a4e7d25c00) 00010000:00010000:3.0:1789395158.457419:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.457450:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457467:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457483:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457497:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457506:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457513:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457594:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457603:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.457611:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.457930:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2543, 64 off170944 00010000:00010000:3.0:1789395158.458019:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458029:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458038:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458046:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458053:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458059:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458086:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.458107:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458114:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458119:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458125:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.458130:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458138:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458146:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff89a3ca308900) 00010000:00010000:3.0:1789395158.458149:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.458153:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458158:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d12f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458180:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458186:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458191:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458197:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458201:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.458204:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458209:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458216:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.458218:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.458221:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458227:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094600/0xff35729af316d121 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.458237:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f5a557d reply state 00000000dfba3c4d transno 4294984056 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458248:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.458256:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0729cd0 (ffff89a4c8e8dc00) 00010000:00010000:3.0:1789395158.458258:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.458261:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395158.458354:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+695:19221:x1876316231849216:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1137us (1433us total) trans 4294984056 rc 0/0 00000100:00100000:3.0:1789395158.458363:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23784 00010000:00010000:0.0:1789395158.458710:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.458720:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.458728:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.458732:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.458739:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.458749:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff89a3ca308900) 00010000:00010000:0.0:1789395158.458751:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.458754:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.458769:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d136 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.458786:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.458789:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.458791:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.465689:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.465808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231849472 00000100:00100000:0.0:1789395158.465821:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231849472 00000100:00100000:0.0:1789395158.465914:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23785 00000100:00100000:0.0:1789395158.465926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+695:19221:x1876316231849472:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.466008:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.466045:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316c5f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106456 expref: 695 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466067:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff89a4d99b8100) 00010000:00010000:0.0:1789395158.466080:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.466109:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466125:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466145:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466159:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466168:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466174:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466265:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466274:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466281:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.466602:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 64 off10944 00010000:00010000:0.0:1789395158.466687:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466697:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466704:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466711:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466717:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466723:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466744:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.466779:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466785:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466795:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466801:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.466805:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466814:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466822:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:0.0:1789395158.466825:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.466829:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466834:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d14b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466854:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466860:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466865:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466870:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466875:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.466878:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466883:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466890:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.466892:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.466895:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466900:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d13d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.466909:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070313092 reply state 000000000194477d transno 4294984057 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466921:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.466926:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe37fc7d0 (ffff89a3ca2fb000) 00010000:00010000:0.0:1789395158.466928:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.466931:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.467027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+696:19221:x1876316231849472:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1102us (1352us total) trans 4294984057 rc 0/0 00000100:00100000:0.0:1789395158.467036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23785 00010000:00010000:1.0:1789395158.468436:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.468452:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.468464:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.468468:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.468479:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.468498:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:1.0:1789395158.468502:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.468507:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.468513:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d152 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.468540:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.468542:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.468544:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.475786:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.475885:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231849728 00000100:00100000:0.0:1789395158.475901:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231849728 00000100:00100000:0.0:1789395158.475984:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23786 00000100:00100000:0.0:1789395158.475995:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+696:19221:x1876316231849728:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.476094:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.476134:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aa400/0xff35729af316c615 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210645d expref: 696 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476163:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff89a3c8b1d600) 00010000:00010000:0.0:1789395158.476183:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.476499:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476518:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476529:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476543:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476550:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476556:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476648:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476657:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.476664:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.477017:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2544, 64 off171008 00010000:00010000:0.0:1789395158.477697:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477713:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477723:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477732:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477739:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477746:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477773:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.477799:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477805:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477811:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477817:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.477822:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477831:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477844:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395158.477859:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.477869:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477876:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d167 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477902:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477908:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477913:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477919:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477924:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.477927:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477933:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477941:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.477943:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.477946:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477955:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d159 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.477965:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017bde9d8 reply state 00000000916e41fa transno 4294984058 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477977:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.477983:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x507ed6d0 (ffff89a3c8b1d300) 00010000:00010000:0.0:1789395158.477985:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.477989:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.478116:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+697:19221:x1876316231849728:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2117us (2339us total) trans 4294984058 rc 0/0 00000100:00100000:0.0:1789395158.478126:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23786 00010000:00010000:2.0:1789395158.478306:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.478315:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.478322:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.478326:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.478338:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.478349:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:2.0:1789395158.478351:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789395158.478354:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.478360:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d16e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.478379:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.478381:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.478407:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.489834:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.490247:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231849984 00000100:00100000:2.0:1789395158.490259:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231849984 00000100:00100000:2.0:1789395158.490332:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23787 00000100:00100000:2.0:1789395158.490345:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+697:19221:x1876316231849984:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.490459:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.490496:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8600/0xff35729af316c638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106464 expref: 697 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490520:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff89a3ca308e00) 00010000:00010000:2.0:1789395158.490535:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.490565:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490583:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490598:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490612:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490620:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490627:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490704:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490713:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.490721:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.491165:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 64 off11008 00010000:00010000:2.0:1789395158.491267:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491278:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491286:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491294:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491301:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491308:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491325:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.491349:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491357:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491364:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491371:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.491377:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491426:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491438:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.491441:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.491446:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491453:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d183 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491481:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491488:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491495:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491501:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491507:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.491510:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491515:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491522:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.491524:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.491528:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491533:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d175 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.491545:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000934ccfb0 reply state 000000006cd6976b transno 4294984059 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491557:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.491564:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea2c01d0 (ffff89a3ca308300) 00010000:00010000:2.0:1789395158.491567:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.491570:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.491681:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+698:19221:x1876316231849984:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1335us (1861us total) trans 4294984059 rc 0/0 00000100:00100000:2.0:1789395158.491690:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23787 00010000:00010000:3.0:1789395158.493284:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.493302:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.493314:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff5a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.493319:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.493331:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.493355:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:3.0:1789395158.493357:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.493362:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.493369:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff5a00/0xff35729af316d18a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.493421:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.493424:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.493426:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.499881:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.500043:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231850240 00000100:00100000:2.0:1789395158.500057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231850240 00000100:00100000:2.0:1789395158.500145:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23788 00000100:00100000:2.0:1789395158.500156:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+698:19221:x1876316231850240:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.500245:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.500281:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8a00/0xff35729af316c65b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210646b expref: 698 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500305:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff89a3ca308800) 00010000:00010000:2.0:1789395158.500322:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.500352:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500367:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500380:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500432:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500444:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500450:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500539:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500547:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.500552:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.501132:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2545, 64 off171072 00010000:00010000:2.0:1789395158.501254:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501267:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501276:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501284:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501291:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501298:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501406:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.501430:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501436:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501443:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501450:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.501455:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501465:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501478:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.501482:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.501487:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501493:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d19f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501518:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501525:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501537:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501543:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501548:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.501551:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501557:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501566:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.501568:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.501572:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501578:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4400/0xff35729af316d191 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.501588:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007158f273 reply state 00000000fca6366f transno 4294984060 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501602:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.501609:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe91638d0 (ffff89a3ca308d00) 00010000:00010000:2.0:1789395158.501611:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.501614:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.501737:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+699:19221:x1876316231850240:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1578us (1885us total) trans 4294984060 rc 0/0 00000100:00100000:2.0:1789395158.501746:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23788 00010000:00010000:0.0:1789395158.503777:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.503796:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.503810:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.503816:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.503827:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.504723:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:0.0:1789395158.504732:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.504739:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.504749:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d1a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.504793:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.504795:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.504798:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.512221:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.512368:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231850496 00000100:00100000:0.0:1789395158.512420:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231850496 00000100:00100000:0.0:1789395158.512492:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23789 00000100:00100000:0.0:1789395158.512503:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+699:19221:x1876316231850496:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.512580:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.512617:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417200/0xff35729af316c67e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106472 expref: 699 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512641:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff89a3c8b1d900) 00010000:00010000:0.0:1789395158.512655:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.512685:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512702:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512713:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512726:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512734:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512742:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512835:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512843:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.512849:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.513705:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 64 off11072 00010000:00010000:1.0:1789395158.515447:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515476:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515490:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515500:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515506:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515513:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515536:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.515566:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515573:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515578:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515584:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.515590:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515602:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515617:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:1.0:1789395158.515620:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.515626:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515632:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d1bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515658:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515664:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515670:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515676:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515681:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.515684:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515690:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515698:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.515701:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.515704:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515710:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d1ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.515720:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6e5a3a6 reply state 00000000c812a4b8 transno 4294984061 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515732:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.515737:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfe3473d0 (ffff89a3c8b1d500) 00010000:00010000:1.0:1789395158.515739:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.515743:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.515888:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+700:19221:x1876316231850496:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 3377us (3671us total) trans 4294984061 rc 0/0 00000100:00100000:1.0:1789395158.515901:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23789 00010000:00010000:0.0:1789395158.516448:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.516459:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.516468:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.516473:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.516482:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.516494:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395158.516496:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.516499:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.516505:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.516531:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.516534:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.516535:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.523463:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.523559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231850752 00000100:00100000:0.0:1789395158.523572:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231850752 00000100:00100000:0.0:1789395158.523642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23790 00000100:00100000:0.0:1789395158.523652:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+700:19221:x1876316231850752:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.523731:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.523775:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416400/0xff35729af316c6a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106479 expref: 700 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff89a3c8b1d100) 00010000:00010000:0.0:1789395158.523809:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.523839:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523855:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523875:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523888:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523895:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523901:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523976:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523986:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.523995:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.524278:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2546, 64 off171136 00010000:00010000:0.0:1789395158.524369:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524378:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524695:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524704:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524712:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524719:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524743:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.524774:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524785:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524792:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524798:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.524802:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524810:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524822:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:0.0:1789395158.524824:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.524828:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524834:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d1d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524856:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.524862:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525270:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525277:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525283:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.525286:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525294:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525305:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.525308:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.525311:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525318:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376a00/0xff35729af316d1c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.525331:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f5d25fb reply state 0000000071978936 transno 4294984062 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525344:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.525350:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x133382d0 (ffff89a3c8b1d200) 00010000:00010000:0.0:1789395158.525353:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.525356:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.525526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+701:19221:x1876316231850752:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1871us (2074us total) trans 4294984062 rc 0/0 00000100:00100000:0.0:1789395158.525536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23790 00010000:00010000:3.0:1789395158.525741:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.525749:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.525756:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.525769:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.525776:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.525788:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff89a4cbc0e500) 00010000:00010000:3.0:1789395158.525790:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.525793:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.525798:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d1de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.525816:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.525817:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.525819:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.537710:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.537862:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231851008 00000100:00100000:1.0:1789395158.537884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231851008 00000100:00100000:1.0:1789395158.537962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23791 00000100:00100000:1.0:1789395158.537974:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+701:19221:x1876316231851008:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.538052:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.538087:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9800/0xff35729af316c6c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106480 expref: 701 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538112:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff89a3ca308000) 00010000:00010000:1.0:1789395158.538128:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.538167:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538185:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538198:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538210:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538216:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538232:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538321:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538330:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538336:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.538696:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 64 off11136 00010000:00010000:1.0:1789395158.538797:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538807:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538816:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538824:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538829:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538836:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538854:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.538873:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538880:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538887:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538893:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.538899:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538907:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538919:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff89a4c3c17300) 00010000:00010000:1.0:1789395158.538922:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.538927:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538933:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d1f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538954:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538961:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538967:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538973:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538978:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.538981:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538987:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.538995:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.538997:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.539000:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.539007:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d1e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.539018:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ca4005f reply state 000000003e8cdf51 transno 4294984063 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.539030:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.539036:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xeedd9295 (ffff89a3ca308b00) 00010000:00010000:1.0:1789395158.539039:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.539042:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.539139:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+702:19221:x1876316231851008:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1165us (1442us total) trans 4294984063 rc 0/0 00000100:00100000:1.0:1789395158.539148:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23791 00010000:00010000:0.0:1789395158.539493:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.539502:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.539510:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.539514:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.539522:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.539532:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff89a4c3c17300) 00010000:00010000:0.0:1789395158.539535:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.539538:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.539544:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d1fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.539561:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.539563:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.539565:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395158.547359:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.547544:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231851264 00000100:00100000:1.0:1789395158.547558:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231851264 00000100:00100000:1.0:1789395158.547637:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23792 00000100:00100000:1.0:1789395158.547649:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+702:19221:x1876316231851264:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.547733:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.547780:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4800/0xff35729af316c6e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106487 expref: 702 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.547803:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff89a4d99b8b00) 00010000:00010000:1.0:1789395158.547816:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.547849:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.547866:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.547878:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.547901:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.547910:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.547916:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548010:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548019:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548026:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.548352:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2547, 64 off171200 00010000:00010000:1.0:1789395158.548659:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548670:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548679:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548687:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548693:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548700:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548846:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.548873:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548879:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548886:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548893:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.548898:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548907:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548919:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff89a4c3c17d00) 00010000:00010000:1.0:1789395158.548922:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.548926:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548933:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d20f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548958:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548970:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548976:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548983:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548988:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.548990:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.548996:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.549004:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.549007:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.549010:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.549017:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d201 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.549029:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009b468db reply state 00000000fe3ee27d transno 4294984064 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.549041:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.549047:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6be72195 (ffff89a4d99b8900) 00010000:00010000:1.0:1789395158.549050:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.549053:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.549167:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+703:19221:x1876316231851264:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1516us (1820us total) trans 4294984064 rc 0/0 00000100:00100000:1.0:1789395158.549177:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23792 00010000:00010000:0.0:1789395158.551029:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.551047:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.551060:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.551064:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.551086:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.551106:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff89a4c3c17d00) 00010000:00010000:0.0:1789395158.551110:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.551116:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.551122:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d216 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.551157:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.551160:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.551163:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.555472:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.555524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231851520 00000100:00100000:0.0:1789395158.555538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231851520 00000100:00100000:0.0:1789395158.555615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23793 00000100:00100000:0.0:1789395158.555627:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+703:19221:x1876316231851520:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:0.0:1789395158.555707:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395158.555742:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c800/0xff35729af316c70a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210648e expref: 703 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555775:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff89a4df47ab00) 00010000:00010000:0.0:1789395158.555789:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395158.555820:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555838:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555849:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555861:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555870:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555881:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555970:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555978:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.555984:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395158.556493:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 64 off11200 00010000:00010000:0.0:1789395158.557216:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557240:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557251:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557259:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557266:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557272:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557301:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395158.557326:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557332:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557340:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557347:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.557351:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557359:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557370:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395158.557374:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395158.557378:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557416:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535400/0xff35729af316d22b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557441:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557446:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557456:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557461:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557466:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395158.557469:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557474:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557482:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:0.0:1789395158.557484:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395158.557487:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534e00/0xff35729af316d21d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395158.557504:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000006fdd0a reply state 00000000e0c52164 transno 4294984065 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557516:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.557522:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6d724c95 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395158.557525:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395158.557528:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395158.557642:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+704:19221:x1876316231851520:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2014us (2410us total) trans 4294984065 rc 0/0 00000100:00100000:0.0:1789395158.557653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23793 00010000:00010000:1.0:1789395158.558917:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395158.558931:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.558942:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.558946:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.558959:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.558976:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff89a4cbc0e900) 00010000:00010000:1.0:1789395158.558980:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.558984:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.558991:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535e00/0xff35729af316d232 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.559019:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.559021:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.559023:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.568084:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.568475:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231851776 00000100:00100000:2.0:1789395158.568488:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231851776 00000100:00100000:2.0:1789395158.568567:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23794 00000100:00100000:2.0:1789395158.568578:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+704:19221:x1876316231851776:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.568664:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.568698:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37da00/0xff35729af316c72d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106495 expref: 704 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568724:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff89a4d99b8800) 00010000:00010000:2.0:1789395158.568738:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.568780:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568797:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568810:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568822:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568830:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568837:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568934:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568943:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.568950:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.571570:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2548, 64 off171264 00010000:00010000:2.0:1789395158.571734:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.571756:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.571779:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.571790:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.571796:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.571803:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.574272:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.574293:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.574308:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.574313:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.574327:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.574351:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:3.0:1789395158.574354:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.574361:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.574375:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.574377:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.574379:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.582650:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789395158.582675:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d24e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582742:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582751:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582769:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582776:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.582782:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582791:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582810:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.582814:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.582820:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582825:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d247 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582867:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582873:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582878:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582883:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582888:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.582890:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582896:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582903:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.582905:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.582908:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582914:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d239 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.582924:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000483530cb reply state 00000000ce2a7c8a transno 4294984066 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582938:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.582946:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a5c8395 (ffff89a4d99b8500) 00010000:00010000:2.0:1789395158.582948:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.582951:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.583834:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+705:19221:x1876316231851776:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 15241us (15761us total) trans 4294984066 rc 0/0 00000100:00100000:2.0:1789395158.583848:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23794 00000100:00100000:2.0:1789395158.593115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.593614:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231852032 00000100:00100000:1.0:1789395158.593630:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231852032 00000100:00100000:1.0:1789395158.593720:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23795 00000100:00100000:1.0:1789395158.593733:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+705:19221:x1876316231852032:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.593834:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.593871:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2dc00/0xff35729af316c750 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210649c expref: 705 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.593909:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff89a4d99b8700) 00010000:00010000:1.0:1789395158.593925:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.593967:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.593986:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.593999:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.594013:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.594020:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.594026:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.594111:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.594119:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.594126:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.594864:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 64 off11264 00010000:00010000:1.0:1789395158.595575:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595593:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595605:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595614:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595621:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595627:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595914:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.595954:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595962:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595970:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595976:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.595981:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.595991:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596005:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff89a4c3c17000) 00010000:00010000:1.0:1789395158.596008:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.596013:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596019:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d263 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596049:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596055:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596061:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596068:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596073:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.596075:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596082:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596090:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.596093:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.596096:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596102:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d255 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.596113:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a79a2a7 reply state 0000000078382389 transno 4294984067 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596126:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.596133:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x609ae95 (ffff89a4d99b8400) 00010000:00010000:1.0:1789395158.596135:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.596139:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.596516:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+706:19221:x1876316231852032:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 2777us (3411us total) trans 4294984067 rc 0/0 00000100:00100000:1.0:1789395158.596526:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23795 00010000:00010000:3.0:1789395158.598136:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.598154:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.598285:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.598291:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.598624:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.598648:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff89a4c3c17000) 00010000:00010000:3.0:1789395158.598651:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.598658:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.598665:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d26a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.598703:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.598706:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.598708:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.602922:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395158.603324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231852288 00000100:00100000:0.0:1789395158.603341:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231852288 00000100:00100000:1.0:1789395158.603680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23796 00000100:00100000:1.0:1789395158.603694:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+706:19221:x1876316231852288:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.603789:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.603828:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2cc00/0xff35729af316c773 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064a3 expref: 706 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.603854:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff89a4d99b8200) 00010000:00010000:1.0:1789395158.603868:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.603907:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.603927:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.603947:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.603960:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.603967:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.603973:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604057:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604066:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604074:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.604378:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2549, 64 off171328 00010000:00010000:1.0:1789395158.604496:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604506:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604514:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604523:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604529:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604536:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604567:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.604587:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604594:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604601:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604608:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.604613:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604623:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604633:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff89a4c3c17700) 00010000:00010000:1.0:1789395158.604636:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.604640:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604651:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d27f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604675:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604681:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604687:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604693:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604698:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.604701:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604708:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604714:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.604717:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.604720:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604726:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d271 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.604736:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1219a69 reply state 00000000414c1c2e transno 4294984068 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604748:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.604755:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9d08bd95 (ffff89a4d99b8f00) 00010000:00010000:1.0:1789395158.604770:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.604773:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.604887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+707:19221:x1876316231852288:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1193us (1987us total) trans 4294984068 rc 0/0 00000100:00100000:1.0:1789395158.604896:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23796 00010000:00010000:0.0:1789395158.604983:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.604991:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.604998:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.605002:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.605009:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.605020:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff89a4c3c17700) 00010000:00010000:0.0:1789395158.605023:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.605025:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.605032:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d286 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.605049:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.605051:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.605053:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395158.612891:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.613193:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231852544 00000100:00100000:2.0:1789395158.613209:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231852544 00000100:00100000:2.0:1789395158.613430:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23797 00000100:00100000:2.0:1789395158.613444:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+707:19221:x1876316231852544:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.613524:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.613558:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4a00/0xff35729af316c796 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064aa expref: 707 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613581:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff89a4d99b8e00) 00010000:00010000:2.0:1789395158.613594:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.613623:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613640:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613651:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613662:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613669:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613676:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613780:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613789:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.613796:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.614139:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 64 off11328 00010000:00010000:2.0:1789395158.614240:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614250:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614258:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614265:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614273:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614281:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614308:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.614329:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614335:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614346:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614352:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.614356:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614365:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614376:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:1.0:1789395158.614377:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.614379:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.614414:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614423:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614424:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d29b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614444:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395158.614450:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614458:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614459:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614476:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614481:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff89a4d3f0bf00) 00010000:00010000:2.0:1789395158.614484:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614485:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395158.614491:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614495:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614501:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614505:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.614512:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614520:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.614525:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395158.614529:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.614530:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.614532:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.614536:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.614540:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614547:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d28d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.614558:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050a115bc reply state 00000000d5490968 transno 4294984069 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614570:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.614577:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3615e895 (ffff89a4d99b8c00) 00010000:00010000:2.0:1789395158.614580:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.614583:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.614688:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+708:19221:x1876316231852544:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1243us (1809us total) trans 4294984069 rc 0/0 00000100:00100000:2.0:1789395158.614697:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23797 00000100:00100000:2.0:1789395158.621373:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395158.621439:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231852800 00000100:00100000:1.0:1789395158.621453:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231852800 00000100:00100000:1.0:1789395158.621530:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23798 00000100:00100000:1.0:1789395158.621544:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+708:19221:x1876316231852800:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:1.0:1789395158.621625:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395158.621663:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376600/0xff35729af316c7b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064b1 expref: 708 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621685:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff89a4df47a500) 00010000:00010000:1.0:1789395158.621699:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395158.621746:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621772:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621784:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621798:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621806:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621814:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621900:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621909:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.621916:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395158.622220:0:7813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2550, 64 off171392 00010000:00010000:1.0:1789395158.622311:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622321:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622328:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622336:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622342:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622349:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622379:0:7813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789395158.622435:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622442:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622453:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622459:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.622465:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622473:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622484:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff89a4c3c17800) 00010000:00010000:1.0:1789395158.622487:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789395158.622491:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622497:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d2b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622518:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622524:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622529:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622535:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622541:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395158.622544:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622550:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622558:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:1.0:1789395158.622561:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395158.622564:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622570:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215c00/0xff35729af316d2a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395158.622579:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beb37fdd reply state 000000004ffe572a transno 4294984070 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622593:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395158.622600:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3001f95 (ffff89a4df47a200) 00010000:00010000:1.0:1789395158.622602:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395158.622605:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395158.622698:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+709:19221:x1876316231852800:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1154us (1338us total) trans 4294984070 rc 0/0 00000100:00100000:1.0:1789395158.622706:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23798 00010000:00010000:3.0:1789395158.623258:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395158.623266:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.623275:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395158.623280:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.623290:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.623317:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff89a4c3c17800) 00010000:00010000:3.0:1789395158.623320:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789395158.623324:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.623336:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d2be lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.623356:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.623358:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395158.623359:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395158.631380:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395158.631675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853056 00000100:00100000:3.0:1789395158.631691:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853056 00000100:00100000:3.0:1789395158.631783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23799 00000100:00100000:3.0:1789395158.631796:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+709:19221:x1876316231853056:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:3.0:1789395158.631887:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395158.631923:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316c7dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064b8 expref: 709 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632069:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff89a4df47aa00) 00010000:00010000:3.0:1789395158.632085:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395158.632116:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632132:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632144:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632156:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632164:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632171:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632249:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632260:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.632266:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789395158.633916:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 64 off11392 00010000:00010000:3.0:1789395158.634538:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634560:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634586:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634596:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634602:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634610:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634631:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395158.634660:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634667:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634674:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634681:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.634686:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634695:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634711:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff89a3ca308500) 00010000:00010000:3.0:1789395158.634714:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789395158.634719:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634726:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a000/0xff35729af316d2d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634750:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634768:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634775:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634780:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634786:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395158.634789:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634795:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634803:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:3.0:1789395158.634805:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395158.634809:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634820:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b400/0xff35729af316d2c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395158.634831:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004314061d reply state 00000000a2b6b2e3 transno 4294984071 ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634843:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395158.634849:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x35965a95 (ffff89a4df47a300) 00010000:00010000:3.0:1789395158.634852:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395158.634855:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395158.635331:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395158.635342:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.635353:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395158.635357:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.635363:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.635374:0:9511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff89a3ca308500) 00010000:00010000:0.0:1789395158.635376:0:9511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.635379:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.635408:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b200/0xff35729af316d2da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.635430:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.635432:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.635434:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395158.636894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+710:19221:x1876316231853056:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 5083us (5512us total) trans 4294984071 rc 0/0 00000100:00100000:3.0:1789395158.636908:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23799 00000100:00100000:0.0:1789395158.646766:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395158.646857:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853312 00000100:00100000:2.0:1789395158.646871:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853312 00000100:00100000:2.0:1789395158.646952:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23800 00000100:00100000:2.0:1789395158.646965:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+710:19221:x1876316231853312:12345-192.168.203.54@tcp:36:unlinkmany.0 00010000:00010000:2.0:1789395158.647048:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395158.647084:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094a00/0xff35729af316c7ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064bf expref: 710 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647107:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff89a4d99b8300) 00010000:00010000:2.0:1789395158.647119:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395158.647151:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647166:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647178:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647190:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647197:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647204:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647319:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647328:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647336:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395158.647668:0:10512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2551, 64 off171456 00010000:00010000:2.0:1789395158.647777:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647788:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647796:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647805:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647811:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647818:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647844:0:10512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395158.647866:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647873:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647880:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647886:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395158.647887:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.647898:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647898:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647919:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395158.647920:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647925:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647932:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:2.0:1789395158.647936:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395158.647940:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647943:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647947:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d2ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647961:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff89a4d3f0b500) 00010000:00010000:0.0:1789395158.647966:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789395158.647970:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647975:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.647977:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0000/0xff35729af316d2f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.647994:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648001:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648009:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395158.648009:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.648013:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395158.648017:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395158.648018:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395158.648023:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648030:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648038:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff89a4cbd92200) 00010000:00010000:2.0:1789395158.648041:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395158.648044:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648050:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d2e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395158.648060:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a25bbe38 reply state 000000000ee5e176 transno 4294984072 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648072:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395158.648078:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x74956995 (ffff89a4d99b8d00) 00010000:00010000:2.0:1789395158.648081:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395158.648083:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395158.648192:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+711:19221:x1876316231853312:12345-192.168.203.54@tcp:36:unlinkmany.0 Request processed in 1227us (1446us total) trans 4294984072 rc 0/0 00000100:00100000:2.0:1789395158.648201:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23800 00000100:00100000:2.0:1789395158.705752:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395158.705792:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239734272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395158.705885:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395158.706054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734272 00000100:00100000:0.0:1789395158.706065:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734272 00000100:00100000:0.0:1789395158.706131:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532 00000100:00100000:0.0:1789395158.706142:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239734272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395158.706188:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395158.706331:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239734272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395158.706340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532 00000100:00100000:2.0:1789395158.706593:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983572 gen 2 00000004:00080000:2.0:1789395158.706601:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983572 committed transno 4294983572 00000100:00100000:2.0:1789395158.706639:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239734272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789395158.769645:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789395159.621226:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984072 is committed 00000004:00080000:2.0:1789395159.621425:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000004:00080000:2.0:1789395159.621880:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00010000:00010000:3.0:1789395159.626337:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626362:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626372:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626378:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626397:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626408:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626434:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b93e778 (ffff89a3c90d5a00) 00010000:00010000:3.0:1789395159.626438:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626443:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626450:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b800/0xff35729af316ba6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626472:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626479:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626487:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626492:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626495:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626501:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626509:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x53a9537d (ffff89a4c875d100) 00010000:00010000:3.0:1789395159.626512:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626515:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626522:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aae00/0xff35729af316ba92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626534:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626540:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626547:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626552:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626555:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626560:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626567:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x756ed0d2 (ffff89a3c90d5c00) 00010000:00010000:3.0:1789395159.626570:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626572:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626578:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23aa00/0xff35729af316bab5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626590:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626596:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626602:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626608:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626611:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626618:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626626:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd3ce983f (ffff89a4f3d38800) 00010000:00010000:3.0:1789395159.626628:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626631:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626638:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc200/0xff35729af316bad8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626652:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626658:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626665:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626671:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626674:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626680:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626693:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdb9e9594 (ffff89a4cbd92100) 00010000:00010000:3.0:1789395159.626695:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626699:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626705:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1400/0xff35729af316bafb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626718:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626723:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626729:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626734:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626737:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626743:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626763:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe663f479 (ffff89a4f3d38600) 00010000:00010000:3.0:1789395159.626766:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626769:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626775:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd400/0xff35729af316bb1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626788:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626794:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626801:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626805:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626808:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626813:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626820:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf8b3f1ce (ffff89a3c90d5b00) 00010000:00010000:3.0:1789395159.626822:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626824:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626830:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a200/0xff35729af316bb41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626839:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626844:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626849:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626854:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626857:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626862:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626869:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d12be7b (ffff89a4cbd92800) 00010000:00010000:3.0:1789395159.626871:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626874:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626879:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0a00/0xff35729af316bb64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626889:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626894:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626899:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626904:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626907:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626913:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626925:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6e2bbd0 (ffff89a4f3d38e00) 00010000:00010000:3.0:1789395159.626927:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626929:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626934:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cce00/0xff35729af316bb87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626944:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626950:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626955:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626959:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2aaa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.626961:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626967:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626974:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x40eea295 (ffff89a4c875de00) 00010000:00010000:3.0:1789395159.626976:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.626978:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626983:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aaa00/0xff35729af316bbaa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626992:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.626998:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627003:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627006:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627009:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627013:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627020:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea16437d (ffff89a4c875d900) 00010000:00010000:3.0:1789395159.627022:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627024:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627029:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab000/0xff35729af316bbcd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627038:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627044:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627049:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627055:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627058:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627063:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627071:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9897527d (ffff89a4c875d400) 00010000:00010000:3.0:1789395159.627073:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627076:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627082:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab600/0xff35729af316bbf0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627092:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627098:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627104:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627109:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2abc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627112:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627119:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627131:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe423257d (ffff89a4c875d300) 00010000:00010000:3.0:1789395159.627134:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627137:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395159.627138:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239734400:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789395159.627143:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2abc00/0xff35729af316bc13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627153:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627158:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627163:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627168:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627170:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627175:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627182:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x970cb47d (ffff89a3ca363200) 00010000:00010000:3.0:1789395159.627184:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627186:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627191:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0600/0xff35729af316bc36 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627201:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627206:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627211:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395159.627224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789395159.627229:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cda00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627232:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627237:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627244:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5239df7d (ffff89a4f3d38f00) 00010000:00010000:3.0:1789395159.627246:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627249:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627254:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cda00/0xff35729af316bc59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627264:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627270:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627275:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627280:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627283:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627288:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627295:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa5436e7d (ffff89a3ca363900) 00010000:00010000:3.0:1789395159.627297:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627299:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627305:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1a00/0xff35729af316bc7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627315:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627321:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627326:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627330:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627333:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627338:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627348:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xead1417d (ffff89a3ca363600) 00010000:00010000:3.0:1789395159.627350:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627353:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627358:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0800/0xff35729af316bc9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627366:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627372:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627377:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627381:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca2ab200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627404:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627409:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627416:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d30507d (ffff89a4c875d500) 00010000:00010000:3.0:1789395159.627419:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627421:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627427:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2ab200/0xff35729af316bcc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627438:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627444:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627449:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627454:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627456:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627460:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627466:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa468b7d (ffff89a3ca363400) 00010000:00010000:3.0:1789395159.627468:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627471:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395159.627475:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969900 is committed 00010000:00010000:3.0:1789395159.627476:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0c00/0xff35729af316bce5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627485:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627490:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627495:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627500:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627503:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627508:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627516:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdf501a7d (ffff89a3c90d5200) 00010000:00010000:3.0:1789395159.627518:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627521:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627526:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a400/0xff35729af316bd08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627537:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627543:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627549:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627553:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627556:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627562:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627572:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b6840d2 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395159.627575:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627577:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627582:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1800/0xff35729af316bd2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627592:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627598:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627604:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627609:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627611:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.627611:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734400 00010000:00010000:3.0:1789395159.627617:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.627620:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734400 00010000:00010000:3.0:1789395159.627624:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0674fd2 (ffff89a3ca363a00) 00010000:00010000:3.0:1789395159.627627:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627629:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627635:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534c00/0xff35729af316bd4e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627646:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627653:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627658:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627662:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627665:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627670:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627677:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x65f522d2 (ffff89a3c90d5f00) 00010000:00010000:3.0:1789395159.627679:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627682:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627687:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a800/0xff35729af316bd71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.627694:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5243 00010000:00010000:3.0:1789395159.627697:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627703:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.627704:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3638:x1876316239734400:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789395159.627709:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627714:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627716:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627722:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627728:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x38feb1d2 (ffff89a3ca366200) 00010000:00010000:3.0:1789395159.627730:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627733:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627739:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc800/0xff35729af316bd94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789395159.627757:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2510 count 1 00010000:00010000:3.0:1789395159.627758:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627764:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627771:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627775:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627778:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627783:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627794:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7c0bdcd2 (ffff89a4c875dd00) 00002000:00010000:1.0:1789395159.627795:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395159.627796:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627800:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627802:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627805:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316bdb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627816:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627819:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=610s v=(0 0) 00010000:00010000:3.0:1789395159.627820:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627824:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395159.627826:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627830:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627832:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627832:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627838:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627844:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x27156bd2 (ffff89a3ca366900) 00010000:00010000:3.0:1789395159.627846:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627850:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627850:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627856:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc000/0xff35729af316bdda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627859:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627867:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395159.627867:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627874:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627879:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627883:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395159.627885:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789395159.627886:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627891:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627898:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfd213ed2 (ffff89a3ca363e00) 00010000:00010000:3.0:1789395159.627900:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627902:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627907:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535a00/0xff35729af316bdfd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627917:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627923:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627928:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627933:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627935:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627940:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627947:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x81a24dd2 (ffff89a4d3f0bd00) 00010000:00010000:3.0:1789395159.627948:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.627951:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627956:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316be20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627966:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627971:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627976:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627980:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.627983:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627988:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.627998:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6cc088d2 (ffff89a3ca366d00) 00010000:00010000:3.0:1789395159.628000:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628003:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628008:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316be43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628018:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628023:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628028:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628032:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628034:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628040:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628046:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe9ca17d2 (ffff89a3ca366b00) 00010000:00010000:3.0:1789395159.628048:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628051:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628056:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316be66 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628068:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628075:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628080:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628085:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628087:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628093:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628100:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa846083f (ffff89a3ca363700) 00010000:00010000:3.0:1789395159.628103:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628106:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628112:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534600/0xff35729af316be89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628123:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628129:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628135:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628140:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628143:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628149:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628157:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb56f173f (ffff89a4c7eb6e00) 00010000:00010000:3.0:1789395159.628159:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628162:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628168:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1200/0xff35729af316beac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628180:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628186:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628191:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628196:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628198:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628204:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628214:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5432ea3f (ffff89a3ca366300) 00010000:00010000:3.0:1789395159.628217:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628219:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628225:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316becf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628236:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628242:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628248:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628253:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628255:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628262:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628269:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7f3c793f (ffff89a4c7eb6100) 00010000:00010000:3.0:1789395159.628271:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628274:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628279:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535600/0xff35729af316bef2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628291:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628297:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628303:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628308:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628311:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628317:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789395159.628322:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789395159.628324:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x98e9a43f (ffff89a3c8b1da00) 00010000:00010000:3.0:1789395159.628326:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628329:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628335:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316bf15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628346:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628352:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628357:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628363:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cdc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628365:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.628368:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3638:x1876316239734400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 664us (1144us total) trans 4294969902 rc 0/0 00010000:00010000:3.0:1789395159.628372:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.628377:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5243 00010000:00010000:3.0:1789395159.628379:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x43f3333f (ffff89a3ca366100) 00010000:00010000:3.0:1789395159.628381:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628412:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628419:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cdc00/0xff35729af316bf38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628431:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628436:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628441:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628446:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47ca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628449:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628455:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628467:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5ae1063f (ffff89a4c7eb6700) 00010000:00010000:3.0:1789395159.628470:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628473:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628479:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47ca00/0xff35729af316bf5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628490:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628495:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628501:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628505:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628508:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628513:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628520:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6fe0153f (ffff89a4c7eb6600) 00010000:00010000:3.0:1789395159.628522:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628525:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628530:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c600/0xff35729af316bf7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628540:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628546:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628552:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628557:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628559:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628565:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628572:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa91e503f (ffff89a3ca366a00) 00010000:00010000:3.0:1789395159.628574:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628576:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628582:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316bfa1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628591:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628597:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628602:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628607:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628610:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628615:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628621:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfc27df3f (ffff89a3c90d5400) 00010000:00010000:3.0:1789395159.628623:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628625:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628631:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ac00/0xff35729af316bfc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628642:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628647:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628654:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628659:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628662:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628668:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628678:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a358594 (ffff89a3c90d5100) 00010000:00010000:3.0:1789395159.628681:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628684:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628690:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23be00/0xff35729af316bfe7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628703:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628709:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628715:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628721:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628723:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628730:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628738:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3f3f1494 (ffff89a4c7eb6800) 00010000:00010000:3.0:1789395159.628741:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628743:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628760:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47c800/0xff35729af316c00a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628772:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628779:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628784:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628789:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628792:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628798:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628806:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x584c3f94 (ffff89a4c7eb6000) 00010000:00010000:3.0:1789395159.628809:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628812:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628817:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47dc00/0xff35729af316c02d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628828:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628833:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628839:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628844:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628847:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628852:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628858:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x55367694 (ffff89a3c90d5300) 00000004:00080000:1.0:1789395159.628858:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a42680/2, rc 0, transno 4294969902 00010000:00010000:3.0:1789395159.628861:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.628863:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628868:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a600/0xff35729af316c050 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628878:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628885:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628891:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.628896:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.628899:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.628912:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239734400:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1789395159.629219:0:10001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 2502 count 1 00000040:00080000:2.0:1789395159.629262:0:10001:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789395159.629267:0:10001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1789395159.629381:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239734528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395159.629456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395159.629723:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395159.629734:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.629746:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395159.629759:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.629771:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.629790:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.629798:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d2fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.629825:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395159.629827:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395159.629829:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395159.630580:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734528 00000100:00100000:2.0:1789395159.630590:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734528 00000100:00100000:2.0:1789395159.630661:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244 00000100:00100000:2.0:1789395159.630672:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239734528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395159.630702:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2510 count 1 00002000:00010000:2.0:1789395159.630739:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395159.630746:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.630774:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ce:0x0].0x0 since=610s v=(0 0) 00010000:00010000:2.0:1789395159.630779:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395159.630787:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.630805:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.630815:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.630823:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395159.630843:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789395159.631058:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789395159.631142:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631162:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf0e3a194 (ffff89a3ca366600) 00010000:00010000:3.0:1789395159.631166:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631171:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631178:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316c073 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631198:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631205:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631212:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631330:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631334:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631342:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631351:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2fe2b094 (ffff89a3c90d5000) 00010000:00010000:3.0:1789395159.631354:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631357:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631364:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23ba00/0xff35729af316c096 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631379:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631399:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631405:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631410:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631413:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631419:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631426:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xc8efdb94 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395159.631429:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631432:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631438:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014200/0xff35729af316c0b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631449:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631455:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631461:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631467:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631470:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631476:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631483:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x45da1294 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395159.631486:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631489:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631495:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56200/0xff35729af316c0dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631506:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631512:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631518:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631524:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631526:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631533:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631546:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd2f04d94 (ffff89a4c8e8d900) 00010000:00010000:3.0:1789395159.631548:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631551:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631557:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014400/0xff35729af316c0ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631567:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631573:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631579:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631585:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631588:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631594:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631602:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7df9dc94 (ffff89a4c8e8d800) 00010000:00010000:3.0:1789395159.631604:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631607:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631613:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014000/0xff35729af316c122 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631626:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631632:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631638:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631642:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631645:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631651:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631658:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xda336479 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395159.631661:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631663:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631669:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316c145 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631681:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631687:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631694:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631700:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.631703:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631709:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631717:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3abc7379 (ffff89a3c8b1de00) 00010000:00010000:3.0:1789395159.631719:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.631721:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631727:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316c168 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631739:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.631746:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395159.632034:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969901 is committed 00010000:00010000:3.0:1789395159.632375:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632409:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632414:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632422:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632437:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x32204679 (ffff89a3c8b1db00) 00010000:00010000:3.0:1789395159.632439:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632442:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632448:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316c18b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632464:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632471:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632476:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632481:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632484:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632490:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632498:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2f29d579 (ffff89a4c3ab8300) 00010000:00010000:3.0:1789395159.632500:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632503:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632509:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d000/0xff35729af316c1ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632521:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632528:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632534:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632539:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632542:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632549:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632556:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xcad70079 (ffff89a3c8b1df00) 00010000:00010000:3.0:1789395159.632558:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632560:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632566:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316c1d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632576:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632582:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632589:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632595:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632598:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632604:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632611:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x71408f79 (ffff89a4c3ab8100) 00010000:00010000:3.0:1789395159.632614:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632617:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632623:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47d600/0xff35729af316c1f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632634:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632640:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632646:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632651:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632654:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632661:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632672:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa2c3e279 (ffff89a3ca35fd00) 00010000:00010000:3.0:1789395159.632675:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632678:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632684:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316c217 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632694:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632699:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632706:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632711:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632714:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632720:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632727:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77cd7179 (ffff89a3ca35f600) 00010000:00010000:3.0:1789395159.632730:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632732:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632738:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316c23a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632758:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632766:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632772:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632777:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca47cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632779:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632786:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632793:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe58bac79 (ffff89a4c3ab8b00) 00010000:00010000:3.0:1789395159.632795:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632799:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632805:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca47cc00/0xff35729af316c25d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632817:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632823:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632829:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632835:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632838:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632844:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632850:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8bf53b79 (ffff89a3c8b1d700) 00010000:00010000:3.0:1789395159.632852:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632855:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632861:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316c280 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632872:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632878:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632885:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632890:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632893:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632898:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632909:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa6a2e1ce (ffff89a4c3ab8f00) 00010000:00010000:3.0:1789395159.632911:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632914:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632920:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df535200/0xff35729af316c2a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632930:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632935:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632940:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632945:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.632947:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632953:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632960:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4d0c70ce (ffff89a3ca35f900) 00010000:00010000:3.0:1789395159.632962:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.632965:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632971:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316c2c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632982:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632987:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632993:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.632999:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37d800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633002:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633009:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633016:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe8b99bce (ffff89a3ca35f300) 00010000:00010000:3.0:1789395159.633019:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633021:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633027:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d800/0xff35729af316c2e9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633037:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633045:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633050:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633055:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9badc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633058:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633064:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633072:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x91a3d2ce (ffff89a4c3ab8d00) 00010000:00010000:3.0:1789395159.633074:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633077:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633083:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9badc00/0xff35729af316c30c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633094:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633100:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633106:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633113:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37ca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633115:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633122:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633133:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0d0fdce (ffff89a3ca35fe00) 00010000:00010000:3.0:1789395159.633136:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633138:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633144:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ca00/0xff35729af316c32f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633155:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633162:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633167:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633172:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633175:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633181:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633190:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95b00cce (ffff89a3ca2fb500) 00010000:00010000:3.0:1789395159.633192:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633195:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633202:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37ce00/0xff35729af316c352 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633213:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395159.633357:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395159.633367:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395159.633378:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395159.633402:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395159.633412:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395159.633427:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395159.633435:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d304 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395159.633461:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395159.633463:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395159.633465:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395159.633528:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633534:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633539:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bade00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633542:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633549:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633558:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd0dd37ce (ffff89a4c3ab8200) 00010000:00010000:3.0:1789395159.633561:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633564:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633570:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bade00/0xff35729af316c375 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633583:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633589:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633594:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633600:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633603:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633610:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633617:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77c76ece (ffff89a3ca2fba00) 00010000:00010000:3.0:1789395159.633620:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633622:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633628:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37cc00/0xff35729af316c398 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633637:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633643:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633649:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633655:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bad400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633658:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633663:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633676:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe585a9ce (ffff89a4c3ab8a00) 00010000:00010000:3.0:1789395159.633678:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633681:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633687:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad400/0xff35729af316c3bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633699:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633705:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633711:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633717:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bada00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633720:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633726:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633733:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4de4b8ce (ffff89a4d0654f00) 00010000:00010000:3.0:1789395159.633735:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633738:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633744:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bada00/0xff35729af316c3de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633766:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633773:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633779:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633784:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633787:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633793:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633801:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5501ae7b (ffff89a3ca2fb400) 00010000:00010000:3.0:1789395159.633804:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633806:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633812:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d200/0xff35729af316c401 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633823:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633829:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633836:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633841:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bac200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633844:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633850:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633858:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3d7b (ffff89a4d0654900) 00010000:00010000:3.0:1789395159.633860:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633863:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633869:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bac200/0xff35729af316c424 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633880:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633886:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633892:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633898:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bad600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633900:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633906:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633918:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x170e687b (ffff89a4d0654800) 00010000:00010000:3.0:1789395159.633920:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633924:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633930:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bad600/0xff35729af316c447 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633940:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633946:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633951:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633956:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.633959:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633964:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633972:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95f89f7b (ffff89a3ca2fb100) 00010000:00010000:3.0:1789395159.633974:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.633977:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633983:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c200/0xff35729af316c46a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.633995:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634001:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634006:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634011:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9bacc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.634013:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634019:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634026:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd905ca7b (ffff89a4d0654200) 00010000:00010000:3.0:1789395159.634029:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.634032:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634038:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9bacc00/0xff35729af316c48d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634048:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634055:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634060:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634066:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.634070:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634076:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634083:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xee04d97b (ffff89a4d0654e00) 00010000:00010000:3.0:1789395159.634086:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.634088:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634094:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148b200/0xff35729af316c4b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634106:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634114:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634120:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634126:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9baca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.634128:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634134:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634146:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdfb2047b (ffff89a3ca1c2d00) 00010000:00010000:3.0:1789395159.634148:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.634151:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634156:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9baca00/0xff35729af316c4d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634167:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634173:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634179:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634184:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.634187:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634192:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634200:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x869c3b7b (ffff89a4c8e8db00) 00010000:00010000:3.0:1789395159.634202:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.634205:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.634210:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015a00/0xff35729af316c4f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395159.635367:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969902 is committed 00000001:00080000:0.0:1789395159.636424:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969901 is committed 00000100:00100000:2.0:1789395159.637080:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239734528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6401us (7615us total) trans 4294969901 rc 0/0 00000100:00100000:2.0:1789395159.637095:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244 00010000:00010000:3.0:1789395159.637218:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637228:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637237:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637243:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.637248:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637257:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637274:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9bba767b (ffff89a3ca2fb300) 00010000:00010000:3.0:1789395159.637277:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.637283:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637290:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37d600/0xff35729af316c519 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637302:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637308:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637315:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637321:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4fbd0d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.637325:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637330:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637337:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b9857b (ffff89a3ca1c2900) 00010000:00010000:3.0:1789395159.637340:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.637343:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637348:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0d000/0xff35729af316c53c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637358:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637364:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637370:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637375:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.637377:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395159.637644:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969900 gen 2 00000100:00100000:1.0:1789395159.637675:0:3639:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89a4c2a34000 x1876316239734528/t4294969901(4294969901) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789395175 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789395159.637690:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a34000/2, rc 0, transno 4294969901 00000100:00100000:1.0:1789395159.637746:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239734528:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789395159.637825:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637840:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb4d1abd0 (ffff89a4c8e8d400) 00010000:00010000:3.0:1789395159.637843:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.637847:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637863:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014e00/0xff35729af316c55f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637877:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637884:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637891:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637896:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.637899:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637905:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637911:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7db3ad0 (ffff89a3ca2fbc00) 00010000:00010000:3.0:1789395159.637913:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.637916:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637922:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37c800/0xff35729af316c582 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637933:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637940:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637946:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637951:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4fbd0c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.637954:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637959:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637965:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x798865d0 (ffff89a3ca1c2e00) 00010000:00010000:3.0:1789395159.637967:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.637970:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637976:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c000/0xff35729af316c5a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637985:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637990:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.637996:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638002:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca014600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638005:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638011:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638017:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0729cd0 (ffff89a4c8e8dc00) 00010000:00010000:3.0:1789395159.638019:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638022:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638027:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca014600/0xff35729af316c5c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638036:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638040:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638045:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638048:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca37dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638050:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638056:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638067:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe37fc7d0 (ffff89a3ca2fb000) 00010000:00010000:3.0:1789395159.638069:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638072:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638078:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca37dc00/0xff35729af316c5eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638090:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638096:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638102:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638108:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638111:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638117:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638125:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x507ed6d0 (ffff89a3c8b1d300) 00010000:00010000:3.0:1789395159.638127:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638130:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638136:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316c60e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638148:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638154:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638160:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638165:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca015200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638167:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638174:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638181:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea2c01d0 (ffff89a3ca308300) 00010000:00010000:3.0:1789395159.638183:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638186:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638192:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca015200/0xff35729af316c631 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638202:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638208:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638215:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638220:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638223:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638229:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638237:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe91638d0 (ffff89a3ca308d00) 00010000:00010000:3.0:1789395159.638239:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638242:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638248:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8800/0xff35729af316c654 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638258:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638264:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638271:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638274:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca417800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638277:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638283:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638294:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfe3473d0 (ffff89a3c8b1d500) 00010000:00010000:3.0:1789395159.638297:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638299:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638306:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca417800/0xff35729af316c677 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638315:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638321:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638327:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638331:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca416600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638334:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638340:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638347:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x133382d0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395159.638349:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638352:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638358:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca416600/0xff35729af316c69a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638370:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638376:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638410:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638416:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638419:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638426:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638434:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xeedd9295 (ffff89a3ca308b00) 00010000:00010000:3.0:1789395159.638436:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638439:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638445:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9c00/0xff35729af316c6bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638456:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638463:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638469:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638475:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638478:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638483:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638491:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6be72195 (ffff89a4d99b8900) 00010000:00010000:3.0:1789395159.638493:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638496:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638503:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4feff4600/0xff35729af316c6e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638513:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638520:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638527:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638532:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638535:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638540:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638551:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6d724c95 (ffff89a3c8b1d800) 00010000:00010000:3.0:1789395159.638554:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638557:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638563:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316c703 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638574:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638581:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638588:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638593:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638596:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638603:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638610:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a5c8395 (ffff89a4d99b8500) 00010000:00010000:3.0:1789395159.638612:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638615:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638621:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316c726 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638633:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638641:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638647:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638653:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2c800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638656:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638662:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638669:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x609ae95 (ffff89a4d99b8400) 00010000:00010000:3.0:1789395159.638671:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638674:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638681:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c800/0xff35729af316c749 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638692:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638698:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638704:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638710:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638713:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638718:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638725:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9d08bd95 (ffff89a4d99b8f00) 00010000:00010000:3.0:1789395159.638727:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638730:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638735:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2c200/0xff35729af316c76c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638746:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638762:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638769:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638774:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638777:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638784:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638797:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3615e895 (ffff89a4d99b8c00) 00010000:00010000:3.0:1789395159.638799:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638802:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638809:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d600/0xff35729af316c78f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638820:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638826:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638832:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638838:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638840:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638846:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638853:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3001f95 (ffff89a4df47a200) 00010000:00010000:3.0:1789395159.638856:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638858:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638864:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316c7b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638875:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638882:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638888:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638894:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638897:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638903:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638911:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x35965a95 (ffff89a4df47a300) 00010000:00010000:3.0:1789395159.638914:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638917:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638924:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316c7d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638935:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638941:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638948:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638954:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4e7f2d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.638957:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638964:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638971:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x74956995 (ffff89a4d99b8d00) 00010000:00010000:3.0:1789395159.638973:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.638976:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638983:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4e7f2d000/0xff35729af316c7f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638993:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.638999:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639006:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639011:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639014:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639019:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639030:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b93e778 (ffff89a3c90d5a00) 00010000:00010000:3.0:1789395159.639033:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639036:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639042:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376000/0xff35729af316c814 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639061:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639066:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639071:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639076:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639079:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639084:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639092:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x53a9537d (ffff89a4c875d100) 00010000:00010000:3.0:1789395159.639094:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639097:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639103:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376e00/0xff35729af316c830 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639120:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639126:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639132:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639136:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639139:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639146:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639153:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x756ed0d2 (ffff89a3c90d5c00) 00010000:00010000:3.0:1789395159.639155:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639158:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639164:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095600/0xff35729af316c84c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639177:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639184:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639190:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639196:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639198:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639205:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639213:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd3ce983f (ffff89a4f3d38800) 00010000:00010000:3.0:1789395159.639216:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639219:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639225:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377e00/0xff35729af316c868 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639239:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639245:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639251:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639257:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639260:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639266:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639277:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdb9e9594 (ffff89a4cbd92100) 00010000:00010000:3.0:1789395159.639279:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639282:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639288:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376200/0xff35729af316c884 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639299:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639305:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639310:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639316:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4fbd0c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639319:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639325:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639332:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe663f479 (ffff89a4f3d38600) 00010000:00010000:3.0:1789395159.639334:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639337:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639343:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4fbd0c200/0xff35729af316c8a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639359:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639366:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639371:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639377:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639380:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639414:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639422:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf8b3f1ce (ffff89a3c90d5b00) 00010000:00010000:3.0:1789395159.639425:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639428:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639434:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094000/0xff35729af316c8bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639450:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639456:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639462:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639468:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639471:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639477:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639485:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d12be7b (ffff89a4cbd92800) 00010000:00010000:3.0:1789395159.639488:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639490:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639496:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094c00/0xff35729af316c8d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639511:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639517:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639522:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639528:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639530:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639537:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639549:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6e2bbd0 (ffff89a4f3d38e00) 00010000:00010000:3.0:1789395159.639552:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639555:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639561:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095c00/0xff35729af316c8f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639574:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639579:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639585:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639590:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639592:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639598:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639606:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x40eea295 (ffff89a4c875de00) 00010000:00010000:3.0:1789395159.639608:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639611:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639616:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095e00/0xff35729af316c910 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639630:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639636:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639642:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639647:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639649:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639655:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639662:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea16437d (ffff89a4c875d900) 00010000:00010000:3.0:1789395159.639665:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639667:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639898:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095800/0xff35729af316c92c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639920:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639928:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639934:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639940:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.639945:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639951:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639959:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9897527d (ffff89a4c875d400) 00010000:00010000:3.0:1789395159.639962:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.639965:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639971:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9200/0xff35729af316c948 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639986:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639992:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.639997:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640002:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.640005:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640011:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640024:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe423257d (ffff89a4c875d300) 00010000:00010000:3.0:1789395159.640027:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.640030:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640037:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094400/0xff35729af316c964 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640051:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640058:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640064:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640069:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.640072:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640079:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640086:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x970cb47d (ffff89a3ca363200) 00010000:00010000:3.0:1789395159.640088:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.640092:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640097:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9e00/0xff35729af316c980 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640111:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640118:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640125:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640130:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.640132:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640139:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640146:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5239df7d (ffff89a4f3d38f00) 00010000:00010000:3.0:1789395159.640149:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.640152:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640158:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095000/0xff35729af316c99c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640173:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640180:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640186:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640192:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.640196:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640203:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640210:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa5436e7d (ffff89a3ca363900) 00010000:00010000:3.0:1789395159.640213:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.640216:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640223:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094800/0xff35729af316c9b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640237:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640244:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640250:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640256:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.640259:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640266:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640278:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xead1417d (ffff89a3ca363600) 00010000:00010000:3.0:1789395159.640281:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.640284:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640291:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8000/0xff35729af316c9d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640307:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640314:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640320:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640326:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.640329:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640336:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640344:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7d30507d (ffff89a4c875d500) 00010000:00010000:3.0:1789395159.640346:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.640350:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640356:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd000/0xff35729af316c9f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640372:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.640379:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644471:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644482:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.644488:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644500:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644522:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa468b7d (ffff89a3ca363400) 00010000:00010000:3.0:1789395159.644525:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.644531:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644538:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377400/0xff35729af316ca0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644583:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644591:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644598:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644605:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.644609:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644615:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644624:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdf501a7d (ffff89a3c90d5200) 00010000:00010000:3.0:1789395159.644626:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.644629:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644636:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376800/0xff35729af316ca28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644654:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644659:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644665:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644670:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.644673:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644678:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644690:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b6840d2 (ffff89a3ca363f00) 00010000:00010000:3.0:1789395159.644692:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.644695:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644700:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd800/0xff35729af316ca44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644714:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644720:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644725:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644729:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.644732:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644738:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644745:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0674fd2 (ffff89a3ca363a00) 00010000:00010000:3.0:1789395159.644758:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.644762:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644768:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316ca60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644785:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644791:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644797:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644801:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.644804:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644810:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644817:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x65f522d2 (ffff89a3c90d5f00) 00010000:00010000:3.0:1789395159.644819:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.644821:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644827:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc400/0xff35729af316ca7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644839:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.644844:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645243:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645254:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645258:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645265:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645274:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x38feb1d2 (ffff89a3ca366200) 00010000:00010000:3.0:1789395159.645277:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645280:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645286:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8200/0xff35729af316ca98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645305:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645311:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645317:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645321:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cca00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645329:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645335:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645347:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7c0bdcd2 (ffff89a4c875dd00) 00010000:00010000:3.0:1789395159.645350:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645353:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645358:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cca00/0xff35729af316cab4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645374:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645379:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645417:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645423:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645427:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645663:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645676:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x27156bd2 (ffff89a3ca366900) 00010000:00010000:3.0:1789395159.645678:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645682:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645687:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9344400/0xff35729af316cad0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645706:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645712:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645717:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645722:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645726:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645731:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645738:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfd213ed2 (ffff89a3ca363e00) 00010000:00010000:3.0:1789395159.645740:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645743:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645760:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd200/0xff35729af316caec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645776:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645783:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645790:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645796:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645800:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645807:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645815:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x81a24dd2 (ffff89a4d3f0bd00) 00010000:00010000:3.0:1789395159.645818:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645822:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645828:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316cb08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645845:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645852:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645858:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645863:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645867:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645874:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645885:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6cc088d2 (ffff89a3ca366d00) 00010000:00010000:3.0:1789395159.645887:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645890:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645896:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1e00/0xff35729af316cb24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645909:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645915:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645921:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645927:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645929:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645936:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645945:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe9ca17d2 (ffff89a3ca366b00) 00010000:00010000:3.0:1789395159.645947:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.645951:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645958:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214c00/0xff35729af316cb40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645974:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645981:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645987:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.645993:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.645997:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646003:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646009:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa846083f (ffff89a3ca363700) 00010000:00010000:3.0:1789395159.646013:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646016:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646021:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316cb5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646037:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646043:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646049:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646055:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646058:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646131:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646139:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb56f173f (ffff89a4c7eb6e00) 00010000:00010000:3.0:1789395159.646142:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646145:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646152:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0400/0xff35729af316cb78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646169:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646176:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646182:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646188:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646191:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646198:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646211:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5432ea3f (ffff89a3ca366300) 00010000:00010000:3.0:1789395159.646214:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646216:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646222:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1000/0xff35729af316cb94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646234:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646240:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646246:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646252:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646255:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646261:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646269:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7f3c793f (ffff89a4c7eb6100) 00010000:00010000:3.0:1789395159.646271:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646274:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646280:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316cbb0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646293:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646299:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646305:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646311:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646314:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646320:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646328:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x98e9a43f (ffff89a3c8b1da00) 00010000:00010000:3.0:1789395159.646331:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646334:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646341:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9a00/0xff35729af316cbcc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646355:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646362:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646369:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646375:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646379:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646419:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646427:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x43f3333f (ffff89a3ca366100) 00010000:00010000:3.0:1789395159.646429:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646533:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646609:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0e00/0xff35729af316cbe8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646629:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646635:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646641:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646647:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646650:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646657:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646670:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5ae1063f (ffff89a4c7eb6700) 00010000:00010000:3.0:1789395159.646673:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646676:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646683:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214e00/0xff35729af316cc04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646696:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646703:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646709:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646715:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646717:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646723:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646731:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6fe0153f (ffff89a4c7eb6600) 00010000:00010000:3.0:1789395159.646733:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646736:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646742:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9000/0xff35729af316cc20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646766:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646773:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646779:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646784:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646788:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646794:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646802:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa91e503f (ffff89a3ca366a00) 00010000:00010000:3.0:1789395159.646804:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646807:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646813:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e1c00/0xff35729af316cc3c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646825:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646831:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646836:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646841:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646844:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646854:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646861:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfc27df3f (ffff89a3c90d5400) 00010000:00010000:3.0:1789395159.646864:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646867:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646872:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215800/0xff35729af316cc58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646887:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646893:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646898:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646903:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646906:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646911:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646922:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a358594 (ffff89a3c90d5100) 00010000:00010000:3.0:1789395159.646924:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646927:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646933:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214600/0xff35729af316cc74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646946:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646953:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646958:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646963:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.646965:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646970:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646977:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3f3f1494 (ffff89a4c7eb6800) 00010000:00010000:3.0:1789395159.646979:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.646982:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.646987:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376c00/0xff35729af316cc90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647002:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647007:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647013:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647017:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647019:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647024:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647031:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x584c3f94 (ffff89a4c7eb6000) 00010000:00010000:3.0:1789395159.647033:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647035:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647040:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215e00/0xff35729af316ccac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647051:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647056:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647197:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647205:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647208:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647214:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647223:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x55367694 (ffff89a3c90d5300) 00010000:00010000:3.0:1789395159.647226:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647229:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647235:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215600/0xff35729af316ccc8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647252:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647258:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647266:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647271:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647274:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647280:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647292:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xf0e3a194 (ffff89a3ca366600) 00010000:00010000:3.0:1789395159.647295:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647297:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647303:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214800/0xff35729af316cce4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647315:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647321:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647326:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647331:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647334:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647341:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647348:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2fe2b094 (ffff89a3c90d5000) 00010000:00010000:3.0:1789395159.647350:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647352:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647358:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214200/0xff35729af316cd00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647369:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647375:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647380:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647406:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647410:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647416:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647423:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xc8efdb94 (ffff89a3c90d5500) 00010000:00010000:3.0:1789395159.647426:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647428:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647605:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215400/0xff35729af316cd1c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647624:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647631:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647637:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647642:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647645:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647651:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647660:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x45da1294 (ffff89a3ca35fc00) 00010000:00010000:3.0:1789395159.647662:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647665:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647671:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214400/0xff35729af316cd38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647685:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647691:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647697:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647702:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac9400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647705:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647711:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647721:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd2f04d94 (ffff89a4c8e8d900) 00010000:00010000:3.0:1789395159.647723:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647725:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647730:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac9400/0xff35729af316cd54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647740:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647745:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647761:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647766:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647768:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647774:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647782:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7df9dc94 (ffff89a4c8e8d800) 00010000:00010000:3.0:1789395159.647784:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647787:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647792:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316cd70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647807:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647813:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647819:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647824:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647827:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647833:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647841:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xda336479 (ffff89a3ca35f000) 00010000:00010000:3.0:1789395159.647843:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647847:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647853:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8c00/0xff35729af316cd8c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647868:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647875:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647881:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647886:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647889:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647895:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647902:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3abc7379 (ffff89a3c8b1de00) 00010000:00010000:3.0:1789395159.647905:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647908:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647914:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214000/0xff35729af316cda8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647929:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647935:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647941:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647946:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.647949:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647955:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647967:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x32204679 (ffff89a3c8b1db00) 00010000:00010000:3.0:1789395159.647969:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.647972:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647978:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215a00/0xff35729af316cdc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647991:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.647998:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648004:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648009:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648012:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648019:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648026:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x2f29d579 (ffff89a4c3ab8300) 00010000:00010000:3.0:1789395159.648029:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648031:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648037:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316cde0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648050:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648057:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648132:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648137:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648140:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648147:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648155:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xcad70079 (ffff89a3c8b1df00) 00010000:00010000:3.0:1789395159.648157:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648160:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648165:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9214a00/0xff35729af316cdfc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648180:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648185:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648191:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648197:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648199:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648204:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648210:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x71408f79 (ffff89a4c3ab8100) 00010000:00010000:3.0:1789395159.648213:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648215:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648221:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316ce18 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648232:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648238:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648243:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648248:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648251:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648257:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648268:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa2c3e279 (ffff89a3ca35fd00) 00010000:00010000:3.0:1789395159.648271:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648274:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648280:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca0e0200/0xff35729af316ce34 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648292:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648297:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648302:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648305:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648308:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648313:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648318:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77cd7179 (ffff89a3ca35f600) 00010000:00010000:3.0:1789395159.648320:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648323:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648328:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316ce50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648339:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648345:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648350:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648354:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648356:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648361:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648365:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe58bac79 (ffff89a4c3ab8b00) 00010000:00010000:3.0:1789395159.648367:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648369:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648374:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215000/0xff35729af316ce6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648406:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648413:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648418:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648424:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648428:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648662:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648673:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8bf53b79 (ffff89a3c8b1d700) 00010000:00010000:3.0:1789395159.648675:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648678:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648684:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316ce88 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648704:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648710:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648716:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648721:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9ac8e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648724:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648731:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648743:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa6a2e1ce (ffff89a4c3ab8f00) 00010000:00010000:3.0:1789395159.648746:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648759:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648767:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9ac8e00/0xff35729af316cea4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648781:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648788:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648794:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648799:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648803:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648809:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648817:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4d0c70ce (ffff89a3ca35f900) 00010000:00010000:3.0:1789395159.648819:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648822:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648827:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377a00/0xff35729af316cec0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648843:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648850:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648856:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648862:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648864:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648870:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648877:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe8b99bce (ffff89a3ca35f300) 00010000:00010000:3.0:1789395159.648880:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648883:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648889:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095a00/0xff35729af316cedc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648903:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648909:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648914:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648919:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648922:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648929:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648936:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x91a3d2ce (ffff89a4c3ab8d00) 00010000:00010000:3.0:1789395159.648939:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.648941:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648946:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094200/0xff35729af316cef8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648958:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648964:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648969:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648974:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.648977:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648984:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.648996:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0d0fdce (ffff89a3ca35fe00) 00010000:00010000:3.0:1789395159.648998:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649000:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649005:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b000/0xff35729af316cf14 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649020:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649025:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649030:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649036:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649039:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649045:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649051:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95b00cce (ffff89a3ca2fb500) 00010000:00010000:3.0:1789395159.649053:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649056:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649130:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23bc00/0xff35729af316cf30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649149:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649155:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649161:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649167:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9094e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649170:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649176:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649183:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd0dd37ce (ffff89a4c3ab8200) 00010000:00010000:3.0:1789395159.649186:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649189:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649194:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9094e00/0xff35729af316cf4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649205:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649211:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649217:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649223:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649226:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649231:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649238:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x77c76ece (ffff89a3ca2fba00) 00010000:00010000:3.0:1789395159.649240:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649243:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649249:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b200/0xff35729af316cf68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649262:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649268:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649274:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649279:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23a000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649282:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649288:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649299:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe585a9ce (ffff89a4c3ab8a00) 00010000:00010000:3.0:1789395159.649302:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649305:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649310:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23a000/0xff35729af316cf84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649325:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649330:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649335:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649340:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca23b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649343:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649349:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649356:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x4de4b8ce (ffff89a4d0654f00) 00010000:00010000:3.0:1789395159.649359:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649361:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649366:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca23b600/0xff35729af316cfa0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649381:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649418:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649424:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649430:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649770:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649782:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649791:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x5501ae7b (ffff89a3ca2fb400) 00010000:00010000:3.0:1789395159.649794:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649797:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649803:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316cfbc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649823:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649829:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649835:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649841:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cde00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649845:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649850:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649857:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3d7b (ffff89a4d0654900) 00010000:00010000:3.0:1789395159.649859:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649862:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649868:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cde00/0xff35729af316cfd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649882:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649887:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649894:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649899:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649902:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649907:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649918:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x170e687b (ffff89a4d0654800) 00010000:00010000:3.0:1789395159.649921:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649923:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649929:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316cff4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649943:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649948:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649954:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649959:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.649961:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649968:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649974:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x95f89f7b (ffff89a3ca2fb100) 00010000:00010000:3.0:1789395159.649976:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.649978:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649984:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d010 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.649996:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650002:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650008:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650012:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650015:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650020:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650165:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xd905ca7b (ffff89a4d0654200) 00010000:00010000:3.0:1789395159.650167:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650171:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650177:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9215200/0xff35729af316d02c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650193:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650199:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650205:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650212:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650215:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650220:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650227:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xee04d97b (ffff89a4d0654e00) 00010000:00010000:3.0:1789395159.650229:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650232:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650237:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095200/0xff35729af316d048 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650249:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650255:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650261:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650266:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650268:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650274:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650284:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xdfb2047b (ffff89a3ca1c2d00) 00010000:00010000:3.0:1789395159.650286:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650289:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650295:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ba00/0xff35729af316d064 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650306:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650311:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650316:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650321:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650324:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650331:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650337:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x869c3b7b (ffff89a4c8e8db00) 00010000:00010000:3.0:1789395159.650339:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650341:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650347:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d080 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650361:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650368:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650374:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650378:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650381:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650409:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650416:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9bba767b (ffff89a3ca2fb300) 00010000:00010000:3.0:1789395159.650418:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650420:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650426:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d09c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650450:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650457:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650463:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650469:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650472:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650478:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650484:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x8b9857b (ffff89a3ca1c2900) 00010000:00010000:3.0:1789395159.650486:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650488:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650494:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d0b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650506:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650512:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650519:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650523:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cc600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650526:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650531:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650548:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb4d1abd0 (ffff89a4c8e8d400) 00010000:00010000:3.0:1789395159.650551:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650554:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650560:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cc600/0xff35729af316d0d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650573:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650578:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650584:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650590:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650593:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650598:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650604:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x7db3ad0 (ffff89a3ca2fbc00) 00010000:00010000:3.0:1789395159.650606:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650609:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650614:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d0f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650628:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650635:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650641:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650646:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650648:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650653:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650659:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x798865d0 (ffff89a3ca1c2e00) 00010000:00010000:3.0:1789395159.650661:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650664:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650669:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d10c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650679:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650684:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650690:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650695:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9095400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650699:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650704:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650710:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xa0729cd0 (ffff89a4c8e8dc00) 00010000:00010000:3.0:1789395159.650712:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650715:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650720:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9095400/0xff35729af316d128 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650731:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650736:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650742:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650746:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650756:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650763:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650774:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe37fc7d0 (ffff89a3ca2fb000) 00010000:00010000:3.0:1789395159.650776:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650778:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650783:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d144 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650795:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650802:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650808:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650813:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650815:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650820:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650827:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x507ed6d0 (ffff89a3c8b1d300) 00010000:00010000:3.0:1789395159.650829:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650831:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650837:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57800/0xff35729af316d160 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650850:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650857:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650862:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650867:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650869:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650875:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650881:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xea2c01d0 (ffff89a3ca308300) 00010000:00010000:3.0:1789395159.650883:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650885:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650891:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d17c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650904:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650909:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650915:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650921:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650924:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650929:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650935:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xe91638d0 (ffff89a3ca308d00) 00010000:00010000:3.0:1789395159.650937:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650940:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650945:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d198 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650956:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650962:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650968:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650972:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3cd600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.650975:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650981:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.650993:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xfe3473d0 (ffff89a3c8b1d500) 00010000:00010000:3.0:1789395159.650995:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.650997:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651003:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3cd600/0xff35729af316d1b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651014:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651020:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651025:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651030:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651033:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651039:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651045:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x133382d0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395159.651047:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651050:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651055:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534400/0xff35729af316d1d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651076:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651083:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651089:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651094:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651096:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651102:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651108:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xeedd9295 (ffff89a3ca308b00) 00010000:00010000:3.0:1789395159.651110:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651112:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651118:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d1ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651129:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651135:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651141:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651147:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651150:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651156:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651162:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6be72195 (ffff89a4d99b8900) 00010000:00010000:3.0:1789395159.651164:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651166:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651172:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d208 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651183:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651188:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651193:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651198:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651200:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651206:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651217:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6d724c95 (ffff89a3c8b1d800) 00010000:00010000:3.0:1789395159.651219:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651222:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651227:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4df534a00/0xff35729af316d224 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651239:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651244:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651250:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651254:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651257:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651263:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651270:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x6a5c8395 (ffff89a4d99b8500) 00010000:00010000:3.0:1789395159.651272:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651274:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651279:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d240 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651291:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651297:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651303:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651307:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3ccc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651310:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651315:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651321:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x609ae95 (ffff89a4d99b8400) 00010000:00010000:3.0:1789395159.651323:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651326:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651331:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3ccc00/0xff35729af316d25c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651342:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651348:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651354:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651360:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651363:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651369:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651375:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x9d08bd95 (ffff89a4d99b8f00) 00010000:00010000:3.0:1789395159.651377:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651379:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651407:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d278 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651420:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651425:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651431:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651436:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651438:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651444:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651455:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x3615e895 (ffff89a4d99b8c00) 00010000:00010000:3.0:1789395159.651458:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651460:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651467:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d294 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651477:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651483:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651489:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651494:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651497:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651502:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651508:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xb3001f95 (ffff89a4df47a200) 00010000:00010000:3.0:1789395159.651510:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651513:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651519:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d2b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651532:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651539:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651545:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651549:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651551:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651557:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651563:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x35965a95 (ffff89a4df47a300) 00010000:00010000:3.0:1789395159.651565:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651567:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651573:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a4c148bc00/0xff35729af316d2cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651583:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651589:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651594:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651600:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395159.651603:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651608:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651615:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x74956995 (ffff89a4d99b8d00) 00010000:00010000:3.0:1789395159.651617:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395159.651619:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395159.651625:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d2e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395159.731972:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239734656:0@lo:400:kworker.0 00000100:00100000:2.0:1789395159.732067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395159.732309:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734656 00000100:00100000:0.0:1789395159.732319:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734656 00000100:00100000:0.0:1789395159.732420:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789395159.732432:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.734900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239734784:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735142:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239735296:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735166:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735187:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239735808:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735209:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735234:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789395159.735239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239735168:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735407:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735432:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239735680:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735486:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239734912:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735513:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239735424:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239735936:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735616:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789395159.735621:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239735040:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735654:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239735552:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.735673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395159.735712:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734784 00000100:00100000:3.0:1789395159.735722:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734784 00000100:00100000:3.0:1789395159.735787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735296 00000100:00100000:3.0:1789395159.735790:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735296 00000100:00100000:3.0:1789395159.735819:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735808 00000100:00100000:3.0:1789395159.735822:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735808 00000100:00100000:3.0:1789395159.735836:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735680 00000100:00100000:3.0:1789395159.735838:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735680 00000100:00100000:3.0:1789395159.735851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735424 00000100:00100000:3.0:1789395159.735854:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735424 00000100:00100000:3.0:1789395159.735865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735040 00000100:00100000:3.0:1789395159.735868:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735040 00000100:00100000:3.0:1789395159.735883:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1789395159.735892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239734784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395159.736175:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1789395159.736187:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395159.736488:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239734656:0@lo:400:kworker.0 00000100:00100000:2.0:1789395159.736527:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1789395159.736536:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239735808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395159.741093:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239734656:12345-0@lo:400:kworker.0 Request processed in 8648us (9010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395159.741114:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789395159.741147:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239734784:12345-0@lo:400:kworker.0 Request processed in 5252us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395159.741159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1789395159.741211:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1789395159.741229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395159.741340:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1789395159.741351:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1789395159.741602:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735936 00000100:00100000:0.0:1789395159.741614:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735936 00000100:00100000:3.0:1789395159.741628:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239735680:12345-0@lo:400:kworker.0 Request processed in 406us (6168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395159.741637:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1789395159.741656:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1789395159.741665:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239735424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395159.741672:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735552 00000100:00100000:0.0:1789395159.741677:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735552 00000100:00100000:0.0:1789395159.741713:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789395159.741715:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239735424:12345-0@lo:400:kworker.0 Request processed in 51us (6160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395159.741724:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239735936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.741726:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1789395159.741781:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239735936:12345-0@lo:400:kworker.0 Request processed in 60us (6185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395159.741788:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789395159.741804:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789395159.741811:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239735552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395159.741840:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239735552:12345-0@lo:400:kworker.0 Request processed in 31us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395159.741865:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1789395159.741874:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.741919:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239735040:12345-0@lo:400:kworker.0 Request processed in 47us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395159.741926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00080000:3.0:1789395159.742421:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395159.742427:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395159.742429:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789395159.742432:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395159.742501:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239735040:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.742520:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239735552:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.742535:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239735424:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.742549:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239735936:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.742598:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239735680:0@lo:400:kworker.0 00000100:00100000:3.0:1789395159.742615:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239734784:0@lo:400:kworker.0 00000100:00100000:1.0:1789395159.743530:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239735296:12345-0@lo:400:kworker.0 Request processed in 7340us (8355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395159.743543:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1789395159.743688:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239735296:0@lo:400:kworker.0 00000100:00100000:2.0:1789395159.744474:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239735808:12345-0@lo:400:kworker.0 Request processed in 7936us (9259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395159.744486:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1789395159.744964:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789395159.745010:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239735168 00000100:00100000:0.0:1789395159.745019:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239735168 00000100:00100000:3.0:1789395159.745041:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239735808:0@lo:400:kworker.0 00000100:00100000:0.0:1789395159.745076:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533 00000100:00100000:0.0:1789395159.745088:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239735168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395159.745103:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239734912 00000100:00100000:2.0:1789395159.745110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239734912 00000100:00100000:2.0:1789395159.745141:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:2.0:1789395159.745148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395159.745200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239734912:12345-0@lo:400:kworker.0 Request processed in 52us (9685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395159.745208:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00100000:3.0:1789395159.745509:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239734912:0@lo:400:kworker.0 00000100:00100000:0.0:1789395159.746025:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239735168:12345-0@lo:400:kworker.0 Request processed in 937us (10639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395159.746036:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533 00000100:00100000:1.0:1789395159.747528:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239735168:0@lo:400:kworker.0 00010000:00010000:0.0:1789395159.801483:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395160.242724:0:8904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 611296334082ns, next at 612296330362ns, rc = 0 00000100:00100000:2.0:1789395160.242785:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239736064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395160.242885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395160.243084:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736064 00000100:00100000:0.0:1789395160.243100:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736064 00000100:00100000:0.0:1789395160.243167:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789395160.243179:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239736064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395160.243220:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395160.243282:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239736064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395160.243299:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789395160.243326:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395160.243338:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239736192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395160.243373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395160.243471:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736192 00000100:00100000:0.0:1789395160.243474:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736192 00000100:00100000:0.0:1789395160.243496:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789395160.243503:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239736192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395160.243517:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59098816 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789395160.243547:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239736192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395160.243553:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789395160.243571:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239736320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395160.243601:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395160.243645:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239736192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395160.243671:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736320 00000100:00100000:0.0:1789395160.243675:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736320 00000100:00100000:0.0:1789395160.243691:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789395160.243696:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a500bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239736320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395160.243706:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395160.243733:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a500bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239736320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395160.243739:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789395160.243998:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239736320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395160.244216:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969902 gen 2 00000004:00080000:2.0:1789395160.244234:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a42680, transno 4294969902 00000100:00100000:2.0:1789395160.244258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239736064:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789395160.244763:0:10002:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 611298377592ns, next at 612298374556ns, rc = 0 00000100:00100000:0.0:1789395160.244824:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395160.244838:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395160.244883:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395160.245499:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239736576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395160.245538:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395160.245583:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736448 00000100:00100000:1.0:1789395160.245591:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736448 00000100:00100000:1.0:1789395160.246070:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789395160.246082:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239736448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395160.246107:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59098816 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789395160.246160:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239736448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395160.246167:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789395160.252490:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969901 gen 2 00000004:00080000:0.0:1789395160.252507:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a34000, transno 4294969901 00000100:00100000:0.0:1789395160.252546:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395160.253710:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736576 00000100:00100000:3.0:1789395160.253725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736576 00000100:00100000:3.0:1789395160.253812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535 00000100:00100000:3.0:1789395160.253824:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239736576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789395160.253871:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1789395160.254309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239736576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 485us (8768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395160.254319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535 00000100:00100000:1.0:1789395160.254422:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239736576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789395160.818606:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395161.841611:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789395162.283251:0:21827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60j path oi.1/0x1:0xc:0x0 is not in 'O/1/d/' format 00000100:00100000:2.0:1789395162.679341:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395162.680271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395162.680312:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395162.680349:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395162.680410:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395162.680451:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853952 00000100:00100000:2.0:1789395162.680463:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853952 00000100:00100000:3.0:1789395162.680708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853696 00000100:00100000:3.0:1789395162.680713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853696 00000100:00100000:3.0:1789395162.680802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853568 00000100:00100000:3.0:1789395162.680806:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853568 00000100:00100000:3.0:1789395162.680836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 635 00000100:00100000:3.0:1789395162.680849:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231853696:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395162.680952:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231853696:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 106us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395162.680960:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 635 00000100:00100000:3.0:1789395162.680983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 636 00000100:00100000:3.0:1789395162.680990:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231853568:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395162.681021:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231853568:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395162.681028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 636 00000100:00080000:3.0:1789395162.681046:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395162.681051:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395162.681132:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853824 00000100:00100000:2.0:1789395162.681136:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853824 00000100:00100000:2.0:1789395162.681158:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 427 00000100:00100000:2.0:1789395162.681166:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231853952:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395162.681196:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231853952:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 32us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395162.681202:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 427 00000100:00100000:2.0:1789395162.681216:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 428 00000100:00100000:2.0:1789395162.681223:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231853824:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395162.681247:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231853824:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395162.681253:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 428 00000100:00080000:3.0:1789395162.681319:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395162.681323:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789395162.684847:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231853440 00000100:00100000:0.0:1789395162.684866:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231853440 00000100:00100000:0.0:1789395162.684947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 447 00000100:00100000:0.0:1789395162.684959:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231853440:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395162.685064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231853440:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 107us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395162.685074:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 447 00010000:00010000:0.0:1789395162.866571:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395163.837942:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395163.837974:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395163.838066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395163.838165:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736704 00000100:00100000:2.0:1789395163.838182:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736704 00000100:00100000:2.0:1789395163.838250:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:2.0:1789395163.838262:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239736704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789395163.838307:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:2.0:1789395163.838370:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239736704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395163.838377:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:3.0:1789395163.838577:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4cbfe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239736704:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789395163.891673:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789395164.275326:0:21923:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789395164.275337:0:21923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1789395164.275372:0:21923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789395164.275381:0:21923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1789395164.390546:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395164.390653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854080 00000100:00100000:0.0:1789395164.390667:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854080 00000100:00100000:0.0:1789395164.390776:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23801 00000100:00100000:0.0:1789395164.390789:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:19415:x1876316231854080:12345-192.168.203.54@tcp:46:lfs.0 00000004:00000080:0.0:1789395164.390864:0:6511:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff89a4d0065428 uarg=0000000000000000 00000004:00000080:0.0:1789395164.390927:0:6511:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff89a4d0065428 00000004:00000080:0.0:1789395164.390936:0:6511:0:(mdd_device.c:2174:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:0.0:1789395164.390988:0:6511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789395164.390994:0:6511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1789395164.391016:0:6511:0:(mdd_device.c:2146:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:0.0:1789395164.391093:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789395164.391101:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1789395164.391105:0:6511:0:(mdd_device.c:2223:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1789395164.391658:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1789395164.391806:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:19415:x1876316231854080:12345-192.168.203.54@tcp:46:lfs.0 Request processed in 1017us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395164.391817:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23801 00000100:00080000:3.0:1789395164.393483:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395164.851755:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239736832:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.851860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.851917:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239737344:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.851946:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.851972:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239737856:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.851996:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852013:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239738368:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852033:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852059:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789395164.852065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239737216:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852108:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239737728:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852127:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852140:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239738240:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852158:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852204:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239736960:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852249:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239737472:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852272:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852286:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239737984:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852322:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789395164.852327:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239737088:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852376:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852419:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239737600:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239738112:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852476:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395164.852513:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736832 00000100:00100000:3.0:1789395164.852522:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736832 00000100:00100000:3.0:1789395164.852577:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789395164.852588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239736832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852644:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3d63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239736832:12345-0@lo:400:kworker.0 Request processed in 57us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.852653:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789395164.852689:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737856 00000100:00100000:3.0:1789395164.852693:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737856 00000100:00100000:3.0:1789395164.852737:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738368 00000100:00100000:3.0:1789395164.852741:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738368 00000100:00100000:3.0:1789395164.852762:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737728 00000100:00100000:3.0:1789395164.852765:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737728 00000100:00100000:3.0:1789395164.852783:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738240 00000100:00100000:3.0:1789395164.852785:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738240 00000100:00100000:3.0:1789395164.852803:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789395164.852810:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852841:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239737856:12345-0@lo:400:kworker.0 Request processed in 32us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.852848:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789395164.852861:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1789395164.852867:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239738368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852892:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239738368:12345-0@lo:400:kworker.0 Request processed in 26us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.852898:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1789395164.852909:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1789395164.852914:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239737728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852939:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239737728:12345-0@lo:400:kworker.0 Request processed in 25us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.852945:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1789395164.852955:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789395164.852960:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239738240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.852985:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239738240:12345-0@lo:400:kworker.0 Request processed in 25us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.852991:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789395164.853013:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737216 00000100:00100000:3.0:1789395164.853017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737216 00000100:00100000:3.0:1789395164.853035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239736960 00000100:00100000:3.0:1789395164.853038:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239736960 00000100:00100000:3.0:1789395164.853047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737472 00000100:00100000:3.0:1789395164.853050:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737472 00000100:00100000:3.0:1789395164.853060:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737984 00000100:00100000:3.0:1789395164.853063:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737984 00000100:00100000:3.0:1789395164.853073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737600 00000100:00100000:3.0:1789395164.853075:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737600 00000100:00100000:3.0:1789395164.853089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738112 00000100:00100000:3.0:1789395164.853092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738112 00000100:00100000:3.0:1789395164.853104:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1789395164.853110:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239737216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239737216:12345-0@lo:400:kworker.0 Request processed in 30us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853147:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1789395164.853158:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1789395164.853163:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239736960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853195:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239736960:12345-0@lo:400:kworker.0 Request processed in 31us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853201:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1789395164.853212:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1789395164.853217:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239737472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853243:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239737472:12345-0@lo:400:kworker.0 Request processed in 26us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853248:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1789395164.853259:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1789395164.853264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853288:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239737984:12345-0@lo:400:kworker.0 Request processed in 24us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853294:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1789395164.853304:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1789395164.853310:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239737600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853333:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239737600:12345-0@lo:400:kworker.0 Request processed in 24us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1789395164.853350:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1789395164.853356:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239738112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853379:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239738112:12345-0@lo:400:kworker.0 Request processed in 24us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853419:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1789395164.853455:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737344 00000100:00100000:3.0:1789395164.853459:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737344 00000100:00100000:3.0:1789395164.853481:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239737088 00000100:00100000:3.0:1789395164.853485:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239737088 00000100:00100000:3.0:1789395164.853505:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3537 00000100:00100000:3.0:1789395164.853512:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239737344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853542:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239737344:12345-0@lo:400:kworker.0 Request processed in 31us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3537 00000100:00100000:3.0:1789395164.853560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3538 00000100:00100000:3.0:1789395164.853566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239737088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853592:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239737088:12345-0@lo:400:kworker.0 Request processed in 26us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395164.853598:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3538 00000100:00080000:3.0:1789395164.853625:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789395164.853630:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395164.853633:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395164.853636:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395164.853906:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239737088:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853921:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239737600:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853932:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239738112:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239736960:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853954:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239737472:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.853964:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239737984:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854091:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239737216:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854103:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239737728:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854114:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239738240:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854143:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239736832:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854155:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239737344:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854168:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239737856:0@lo:400:kworker.0 00000100:00100000:3.0:1789395164.854179:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239738368:0@lo:400:kworker.0 00010000:00010000:0.0:1789395164.919757:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789395165.365176:0:8904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 616418787351ns, next at 617418783683ns, rc = 0 00000100:00100000:0.0:1789395165.365292:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239738624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395165.365419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.365487:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395165.365494:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395165.365517:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.365558:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738624 00000100:00100000:0.0:1789395165.365566:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738624 00000100:00100000:0.0:1789395165.365617:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738496 00000100:00100000:0.0:1789395165.365620:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738496 00000100:00100000:0.0:1789395165.365636:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789395165.365646:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239738624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395165.365686:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395165.365749:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239738624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395165.365758:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789395165.365780:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789395165.365786:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239738496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395165.365796:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395165.365819:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239738496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395165.365825:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789395165.365880:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395165.365895:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239738624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395165.365933:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239738752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395165.365959:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.365985:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738752 00000100:00100000:0.0:1789395165.365989:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738752 00000100:00100000:0.0:1789395165.366009:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789395165.366014:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239738752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395165.366031:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59098816 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789395165.366063:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239738752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395165.366070:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789395165.366097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239738752:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1789395165.366304:0:10002:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 616419918118ns, next at 617419915825ns, rc = 0 00000100:00100000:2.0:1789395165.367090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239738880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395165.367200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.367378:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239738880 00000100:00100000:2.0:1789395165.367402:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239738880 00000100:00100000:2.0:1789395165.367447:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789395165.367456:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239738880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395165.367476:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59098816 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789395165.367517:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239738880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395165.367525:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789395165.367574:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239738880:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789395165.371122:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000004:00080000:0.0:1789395165.371153:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000004:00080000:0.0:1789395165.371165:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00000004:00080000:0.0:1789395165.371227:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00000100:00100000:0.0:1789395165.371372:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.371473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.371519:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.371541:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.371566:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789395165.371572:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.371592:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.371608:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.371627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.371665:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739008 00000100:00100000:0.0:1789395165.371673:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739008 00000020:00000080:1.0:1789395165.371698:0:21972:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffdba0eb740 00000004:00000080:1.0:1789395165.371734:0:21972:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b2 len=576 karg=ffff89a501debc00 uarg=0000000000000000 00000100:00100000:0.0:1789395165.371734:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739520 00000100:00100000:0.0:1789395165.371742:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739520 00000100:00100000:0.0:1789395165.371768:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739136 00000100:00100000:0.0:1789395165.371771:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739136 00000100:00100000:0.0:1789395165.371792:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739648 00000100:00100000:0.0:1789395165.371794:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739648 00000004:00000080:1.0:1789395165.371809:0:21972:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=424066b2 len=576 karg=ffff89a501debc00 00000004:00000080:1.0:1789395165.371820:0:21972:0:(mdd_device.c:2174:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000100:00100000:0.0:1789395165.371827:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245 00000100:00100000:0.0:1789395165.371838:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3638:x1876316239739008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.371867:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2511 count 1 00002000:00010000:0.0:1789395165.371907:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.371915:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395165.371922:0:21972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00010000:00010000:0.0:1789395165.371937:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.371942:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.371949:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.371966:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.371976:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.371985:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.372002:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395165.372153:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239739008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 316us (680us total) trans 4294969903 rc 0/0 00000100:00100000:0.0:1789395165.372160:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245 00000100:00100000:2.0:1789395165.372358:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246 00000100:00100000:2.0:1789395165.372367:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239739520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.372381:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2515 count 1 00002000:00010000:2.0:1789395165.372417:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.372423:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372432:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.372436:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.372440:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372450:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372459:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372467:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372482:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.372559:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239739520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 194us (1017us total) trans 4294969904 rc 0/0 00000100:00100000:2.0:1789395165.372566:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246 00000100:00100000:2.0:1789395165.372582:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247 00000100:00100000:2.0:1789395165.372588:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239739136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.372600:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2512 count 1 00002000:00010000:2.0:1789395165.372614:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.372619:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372627:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.372630:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.372634:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372644:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372652:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372659:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372674:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1789395165.372746:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239739136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (1152us total) trans 4294969905 rc 0/0 00000100:00100000:2.0:1789395165.372753:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247 00000100:00100000:2.0:1789395165.372767:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5248 00000100:00100000:2.0:1789395165.372773:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239739648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.372785:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2516 count 1 00002000:00010000:2.0:1789395165.372799:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.372804:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372812:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.372815:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.372819:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372829:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372837:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372845:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.372858:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000040:00080000:1.0:1789395165.372909:0:21972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000100:00100000:2.0:1789395165.372924:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3638:x1876316239739648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 150us (1294us total) trans 4294969906 rc 0/0 00000100:00100000:2.0:1789395165.372932:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5248 00010000:00010000:2.0:1789395165.372951:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.372957:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1789395165.372960:0:21972:0:(mdd_device.c:2146:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00010000:00010000:2.0:1789395165.372989:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.372995:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373007:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395165.373017:0:21972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00010000:00010000:2.0:1789395165.373027:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395165.373028:0:21972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1789395165.373045:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d30b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373075:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.373079:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373085:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.373089:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373097:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373108:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373117:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6eb6fc/0xff35729af316d312 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373130:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.373133:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373140:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.373143:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373151:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373161:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.373169:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb7171cd/0xff35729af316d319 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1789395165.373300:0:21972:0:(mdd_device.c:2223:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00010000:00010000:0.0:1789395165.373786:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395165.373794:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.373805:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.373809:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.373820:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.373834:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.373843:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df56a600/0xff35729af316d320 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789395165.373847:0:21972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00010000:0.0:1789395165.373882:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.373887:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.373891:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1789395165.373906:0:21972:0:(mdd_device.c:2027:mdd_changelog_user_purge()) lustre-MDD0001: Purge request: id=1 00000100:00100000:0.0:1789395165.373911:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.373976:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789395165.373982:0:21972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789395165.373988:0:21972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000100:00100000:0.0:1789395165.374021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.374048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789395165.374062:0:21972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1789395165.374071:0:21972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1789395165.374073:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.374103:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:1.0:1789395165.374118:0:21972:0:(mdd_device.c:2049:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1789395165.374122:0:21972:0:(mdd_device.c:493:mdd_changelog_off()) lustre-MDD0001: changelog off 00000100:00100000:0.0:1789395165.374131:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.374161:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.374296:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.374298:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.374300:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.374307:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.374312:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.374324:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739264 00000100:00100000:2.0:1789395165.374331:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739264 00000100:00100000:2.0:1789395165.374364:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739776 00000100:00100000:2.0:1789395165.374367:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739776 00000100:00100000:2.0:1789395165.374381:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740288 00000100:00100000:2.0:1789395165.374397:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740288 00000100:00100000:2.0:1789395165.374409:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740800 00000100:00100000:2.0:1789395165.374412:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740800 00000100:00100000:2.0:1789395165.374423:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5249 00000100:00100000:2.0:1789395165.374431:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3636:x1876316239739264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.374452:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2513 count 1 00002000:00010000:2.0:1789395165.374474:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.374480:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374491:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.374495:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.374501:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374513:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374521:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374528:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374549:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.374658:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239739264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 227us (683us total) trans 4294969907 rc 0/0 00000100:00100000:2.0:1789395165.374667:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5249 00000100:00100000:2.0:1789395165.374683:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250 00000100:00100000:2.0:1789395165.374689:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3636:x1876316239739776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.374702:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2517 count 1 00002000:00010000:2.0:1789395165.374727:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.374733:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374741:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.374744:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.374748:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374758:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374765:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374772:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374791:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.374853:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3636:x1876316239739776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 164us (804us total) trans 4294969908 rc 0/0 00000100:00100000:2.0:1789395165.374860:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250 00000100:00100000:2.0:1789395165.374873:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251 00000100:00100000:2.0:1789395165.374879:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239740288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.374892:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2513 count 1 00002000:00010000:2.0:1789395165.374910:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.374915:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374924:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d1:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.374927:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.374931:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374942:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374950:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374957:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.374977:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1789395165.375055:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3636:x1876316239740288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 176us (952us total) trans 4294969902 rc 0/0 00000100:00100000:2.0:1789395165.375061:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251 00000100:00100000:2.0:1789395165.375074:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252 00000100:00100000:2.0:1789395165.375080:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239740800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.375093:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2517 count 1 00002000:00010000:2.0:1789395165.375107:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.375112:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.375120:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d5:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.375123:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.375126:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.375135:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.375143:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.375151:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.375169:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000004:00080000:0.0:1789395165.375304:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a43b80/2, rc 0, transno 4294969907 00000100:00100000:0.0:1789395165.375317:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739264:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.375328:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a36300/2, rc 0, transno 4294969908 00000100:00100000:0.0:1789395165.375331:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739776:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.375340:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c98f0a80/2, rc 0, transno 4294969902 00000100:00100000:0.0:1789395165.375350:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375356:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789395165.375365:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.375408:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375421:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.375443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375453:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375484:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375576:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375611:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375638:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239741056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.375655:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789395165.375672:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a43800/2, rc 0, transno 4294969905 00000100:00100000:0.0:1789395165.375681:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739136:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.375690:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a34000/2, rc 0, transno 4294969906 00000100:00100000:0.0:1789395165.375694:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739648:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.375703:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a41c00/2, rc 0, transno 4294969903 00000100:00100000:0.0:1789395165.375716:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739008:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.375725:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a41880/2, rc 0, transno 4294969904 00000100:00100000:0.0:1789395165.375728:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239739520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.375736:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789395165.375741:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375775:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.375793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375802:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239741184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.375818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375895:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239741312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.375927:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.375945:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395165.375953:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239741440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.375961:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739392 00000100:00100000:3.0:1789395165.375976:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739392 00000100:00100000:0.0:1789395165.375981:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.376027:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239741696:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.376029:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239739904 00000100:00100000:3.0:1789395165.376035:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239739904 00000100:00100000:0.0:1789395165.376059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.376070:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740416 00000100:00100000:3.0:1789395165.376077:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740416 00000100:00100000:0.0:1789395165.376084:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395165.376092:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239741568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.376109:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740928 00000100:00100000:3.0:1789395165.376116:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740928 00000100:00100000:0.0:1789395165.376129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.376141:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740032 00000100:00100000:3.0:1789395165.376148:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740032 00000100:00100000:3.0:1789395165.376173:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740544 00000100:00100000:3.0:1789395165.376176:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740544 00000100:00100000:3.0:1789395165.376186:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741056 00000100:00100000:3.0:1789395165.376188:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741056 00000100:00100000:3.0:1789395165.376211:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740160 00000100:00100000:3.0:1789395165.376216:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740160 00000100:00100000:0.0:1789395165.376227:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239741824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395165.376235:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239740672 00000100:00100000:3.0:1789395165.376242:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239740672 00000100:00100000:3.0:1789395165.376261:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741184 00000100:00100000:3.0:1789395165.376264:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741184 00000100:00100000:0.0:1789395165.376271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.376283:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741312 00000100:00100000:3.0:1789395165.376288:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741312 00000100:00100000:3.0:1789395165.376314:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741440 00000100:00100000:3.0:1789395165.376318:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741440 00000100:00100000:3.0:1789395165.376330:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741696 00000100:00100000:3.0:1789395165.376333:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741696 00000100:00100000:3.0:1789395165.376343:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741568 00000100:00100000:3.0:1789395165.376345:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741568 00010000:00010000:0.0:1789395165.376361:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1789395165.376370:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253 00010000:00010000:0.0:1789395165.376371:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376426:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.376431:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.376439:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3636:x1876316239739392:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789395165.376447:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376469:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789395165.376476:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2514 count 1 00010000:00010000:0.0:1789395165.376478:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316d327 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376509:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789395165.376513:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395165.376520:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.376520:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.376528:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376534:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376540:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376580:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.376585:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376588:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.376604:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376608:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822597c5/0xff35729af316d32e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376644:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376648:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395165.376658:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376670:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.376673:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.376681:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376700:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.376729:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1789395165.376939:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3636:x1876316239739392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 554us (1530us total) trans 4294969909 rc 0/0 00000100:00100000:3.0:1789395165.376948:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253 00000100:00100000:3.0:1789395165.376974:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254 00000100:00100000:3.0:1789395165.376981:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3636:x1876316239739904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.376994:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2518 count 1 00002000:00010000:3.0:1789395165.377012:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.377017:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377027:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.377030:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.377034:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377043:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377057:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377064:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377073:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1789395165.377138:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3636:x1876316239739904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 157us (1693us total) trans 4294969910 rc 0/0 00000100:00100000:3.0:1789395165.377145:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254 00000100:00100000:3.0:1789395165.377158:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5255 00000100:00100000:3.0:1789395165.377164:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3636:x1876316239740416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.377178:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2514 count 1 00002000:00010000:3.0:1789395165.377197:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.377202:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377211:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d2:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.377214:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.377218:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377228:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377242:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377249:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377258:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1789395165.377342:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3636:x1876316239740416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 177us (1866us total) trans 4294969903 rc 0/0 00000100:00100000:3.0:1789395165.377349:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5255 00000100:00100000:3.0:1789395165.377361:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256 00000100:00100000:3.0:1789395165.377368:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3636:x1876316239740928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.377380:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2518 count 1 00002000:00010000:3.0:1789395165.377418:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.377424:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377433:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d6:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.377436:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.377441:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377451:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377466:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377474:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377482:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1789395165.377543:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3636:x1876316239740928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175us (2039us total) trans 4294969904 rc 0/0 00000100:00100000:3.0:1789395165.377549:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256 00000100:00100000:3.0:1789395165.377561:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257 00000100:00100000:3.0:1789395165.377567:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239740032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.377581:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2511 count 1 00002000:00010000:3.0:1789395165.377596:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.377601:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377610:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cf:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.377614:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.377618:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377627:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377642:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377649:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377658:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1789395165.377743:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3638:x1876316239740032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175us (2140us total) trans 4294969905 rc 0/0 00000100:00100000:3.0:1789395165.377750:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257 00000100:00100000:3.0:1789395165.377762:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00000100:00100000:3.0:1789395165.377769:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239740544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.377781:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2515 count 1 00002000:00010000:3.0:1789395165.377795:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.377800:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377809:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d3:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.377812:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.377816:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377825:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377838:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377845:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377853:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1789395165.377916:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3638:x1876316239740544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 147us (2285us total) trans 4294969906 rc 0/0 00000100:00100000:3.0:1789395165.377923:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00000100:00100000:3.0:1789395165.377935:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:3.0:1789395165.377942:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3638:x1876316239741056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.377954:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2519 count 1 00002000:00010000:3.0:1789395165.377970:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.377975:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.377984:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.377987:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.377992:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378002:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378017:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378024:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378033:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1789395165.378099:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3638:x1876316239741056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 157us (2443us total) trans 4294969911 rc 0/0 00000100:00100000:3.0:1789395165.378105:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00100000:3.0:1789395165.378119:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00000100:00100000:3.0:1789395165.378125:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239740160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.378138:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2512 count 1 00002000:00010000:3.0:1789395165.378154:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.378159:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378167:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d0:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.378170:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.378174:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378183:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378197:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378203:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378212:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:3.0:1789395165.378272:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3638:x1876316239740160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 146us (2507us total) trans 4294969907 rc 0/0 00000100:00100000:3.0:1789395165.378278:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00000100:00100000:3.0:1789395165.378292:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00000100:00100000:3.0:1789395165.378298:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3638:x1876316239740672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.378309:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2516 count 1 00002000:00010000:3.0:1789395165.378324:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.378330:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378338:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d4:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.378341:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.378346:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378355:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378367:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378374:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378382:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:3.0:1789395165.378466:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3638:x1876316239740672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 167us (2671us total) trans 4294969908 rc 0/0 00000100:00100000:3.0:1789395165.378473:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00000100:00100000:3.0:1789395165.378486:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1789395165.378492:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3638:x1876316239741184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.378504:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2520 count 1 00002000:00010000:3.0:1789395165.378517:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.378522:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378530:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.378533:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.378537:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378546:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378560:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378567:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378576:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000100:00100000:3.0:1789395165.378633:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3638:x1876316239741184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 140us (2813us total) trans 4294969912 rc 0/0 00000100:00100000:3.0:1789395165.378639:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1789395165.378652:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:3.0:1789395165.378658:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3636:x1876316239741312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.378669:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2521 count 1 00002000:00010000:3.0:1789395165.378684:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.378688:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.378696:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.378698:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.378703:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379318:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379338:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379346:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d335 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379370:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1789395165.379375:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.379377:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3636:x1876316239740800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4294us (5213us total) trans 4294969909 rc 0/0 00010000:00010000:0.0:1789395165.379396:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.379400:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.379401:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252 00010000:00010000:0.0:1789395165.379408:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379417:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379424:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d33c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.379431:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264 00010000:00010000:0.0:1789395165.379440:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00000100:00100000:2.0:1789395165.379441:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3636:x1876316239741440:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789395165.379444:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379450:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.379453:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379459:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789395165.379467:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2522 count 1 00010000:00010000:0.0:1789395165.379468:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379474:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dc85be4/0xff35729af316d343 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379486:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1789395165.379490:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395165.379491:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.379496:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379507:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.379511:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.379517:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379531:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379539:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379545:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379559:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1789395165.379638:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3636:x1876316239741440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 199us (3657us total) trans 4294969913 rc 0/0 00000100:00100000:2.0:1789395165.379644:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264 00000100:00100000:2.0:1789395165.379660:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265 00000100:00100000:2.0:1789395165.379666:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3639:x1876316239741696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.379679:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2524 count 1 00002000:00010000:2.0:1789395165.379692:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.379698:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379717:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.379721:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.379725:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379734:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379743:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379750:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379764:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1789395165.379764:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.379768:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379781:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379791:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379798:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4de5298/0xff35729af316d34a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379812:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1789395165.379816:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379822:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.379824:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379831:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.379837:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3639:x1876316239741696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 172us (3781us total) trans 4294969914 rc 0/0 00010000:00010000:0.0:1789395165.379841:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.379844:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265 00010000:00010000:0.0:1789395165.379849:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e80a21a/0xff35729af316d351 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.379857:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:2.0:1789395165.379864:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3639:x1876316239741568:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789395165.379865:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1789395165.379869:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789395165.379876:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2523 count 1 00010000:00010000:0.0:1789395165.379876:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.379879:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379886:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395165.379888:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.379892:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.379897:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379900:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.379904:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.379905:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379908:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379916:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379924:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379930:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.379943:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1789395165.379987:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00000100:00100000:2.0:1789395165.380001:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3639:x1876316239741568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 138us (3873us total) trans 4294969915 rc 0/0 00000100:00100000:2.0:1789395165.380008:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00010000:00010000:2.0:1789395165.380041:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789395165.380047:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380054:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ba00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380057:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380065:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380076:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380084:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f45109d9/0xff35729af316d366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380098:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789395165.380102:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380114:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380117:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380124:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380132:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380139:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd50e3a/0xff35729af316d36d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380151:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789395165.380155:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380162:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380165:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380172:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380182:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380190:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4bf0c35/0xff35729af316d374 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380202:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789395165.380206:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380213:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380216:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380223:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380229:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380233:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380237:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380242:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bbca16c/0xff35729af316d37b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380242:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380253:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789395165.380255:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380256:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380263:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.380265:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380266:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380273:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d35f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380275:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380283:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380285:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789395165.380288:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380290:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e1e086b/0xff35729af316d382 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380295:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.380298:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380299:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.380303:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380306:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380309:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380313:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380315:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380320:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380322:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ab8cb8/0xff35729af316d390 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380328:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380335:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30a2410/0xff35729af316d397 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380339:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395165.380342:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380347:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.380348:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.380348:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.380350:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.380351:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.380358:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.380459:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4ff86ed80/2, rc 0, transno 4294969915 00000100:00100000:2.0:1789395165.380475:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239741568:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.380488:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4ff86fb80/2, rc 0, transno 4294969914 00000100:00100000:2.0:1789395165.380491:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239741696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.380546:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239742208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.380582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.380605:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395165.380610:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239742080:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789395165.380628:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.380631:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395165.380640:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380648:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fe33e9a/0xff35729af316d39e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.380649:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742208 00000100:00100000:2.0:1789395165.380655:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742208 00010000:00010000:0.0:1789395165.380661:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.380662:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.380665:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.380671:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.380678:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742080 00000100:00100000:2.0:1789395165.380680:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742080 00000100:00100000:0.0:1789395165.380682:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:2.0:1789395165.380692:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268 00000100:00100000:2.0:1789395165.380697:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239742080:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.380701:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239742208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.380722:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2526 count 1 00002000:00010000:0.0:1789395165.380742:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.380747:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380756:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.380760:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.380764:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380773:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380781:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380788:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.380802:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395165.380879:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3639:x1876316239742208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 190us (296us total) trans 4294969916 rc 0/0 00000100:00100000:0.0:1789395165.380888:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1789395165.380930:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239741952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.380958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.380982:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741952 00000100:00100000:0.0:1789395165.380986:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741952 00000100:00100000:0.0:1789395165.381018:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:0.0:1789395165.381025:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3637:x1876316239741952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.381224:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2519 count 1 00002000:00010000:0.0:1789395165.381242:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.381248:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.381256:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d7:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.381259:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.381263:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.381272:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.381280:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.381286:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.381299:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789395165.381379:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3637:x1876316239741952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 354us (419us total) trans 4294969910 rc 0/0 00000100:00100000:0.0:1789395165.381404:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00000004:00080000:0.0:1789395165.381443:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a6ed80/2, rc 0, transno 4294969910 00000100:00100000:0.0:1789395165.381453:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239741952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.381815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239741824 00000100:00100000:0.0:1789395165.381822:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239741824 00000100:00100000:0.0:1789395165.381856:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3539 00000100:00100000:0.0:1789395165.381863:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239741824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395165.381891:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395165.381941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239741824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (5675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395165.381948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3539 00010000:00010000:0.0:1789395165.381992:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789395165.381999:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.382008:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.382012:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.382021:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.382492:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383236:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9dae3f/0xff35729af316d3a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383261:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395165.383266:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383279:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.383283:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383292:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383306:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383313:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d3ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.383325:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.383328:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.383330:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.383344:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395165.383440:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395165.383456:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239742336:0@lo:6:osp-syn-1-0.0 00000004:00000080:1.0:1789395165.383892:0:21972:0:(mdd_device.c:2059:mdd_changelog_user_purge()) lustre-MDD0001: Purge changelog entries for user cl1 record=18446744073709551615 00000100:00100000:0.0:1789395165.384216:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.384287:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742336 00000100:00100000:0.0:1789395165.384293:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742336 00000100:00100000:0.0:1789395165.384331:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00000100:00100000:0.0:1789395165.384338:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3637:x1876316239742336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.384365:0:10007:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2520 count 1 00002000:00010000:0.0:1789395165.384421:0:10007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.384427:0:10007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.384439:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d8:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.384443:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.384449:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.384460:0:10007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.384468:0:10007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.384475:0:10007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.384488:0:10007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395165.385154:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3637:x1876316239742336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 813us (1645us total) trans 4294969911 rc 0/0 00000100:00100000:0.0:1789395165.385162:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00000004:00080000:0.0:1789395165.385230:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a6fb80/2, rc 0, transno 4294969916 00000100:00100000:0.0:1789395165.385250:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239742208:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.385273:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c5cc4700/2, rc 0, transno 4294969911 00000100:00100000:0.0:1789395165.385280:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239742336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.385337:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239742464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.385369:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.386523:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789395165.387114:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387142:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387151:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.387180:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742464 00010000:00010000:3.0:1789395165.387190:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789395165.387192:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742464 00000100:00100000:0.0:1789395165.387250:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00000100:00100000:0.0:1789395165.387261:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3637:x1876316239742464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.387285:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239742592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.387359:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.387435:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742592 00000100:00100000:2.0:1789395165.387440:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742592 00000100:00100000:3.0:1789395165.387472:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3636:x1876316239741312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8807us (11536us total) trans 4294969917 rc 0/0 00000100:00100000:2.0:1789395165.387483:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5272 00000100:00100000:3.0:1789395165.387493:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:2.0:1789395165.387500:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3639:x1876316239742592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.387522:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2527 count 1 00002000:00080000:0.0:1789395165.387523:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2521 count 1 00002000:00010000:0.0:1789395165.387562:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1789395165.387564:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.387577:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.387578:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.387596:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d9:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.387601:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.387608:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.387624:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.387634:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.387643:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.387663:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789395165.387690:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789395165.387701:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387724:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.387730:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387743:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387767:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387777:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a301dcc3/0xff35729af316d3b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387803:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789395165.387809:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387817:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ae00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.387820:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387828:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387840:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387848:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ee4ee07/0xff35729af316d389 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387862:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395165.387866:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387873:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.387877:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387891:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387901:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387909:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316d3c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.387920:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.387922:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.387924:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395165.387986:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239741824:0@lo:41:osp-pre-1-0.0 00000004:00080000:3.0:1789395165.388008:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4ff86ca80/2, rc 0, transno 4294969913 00000100:00100000:3.0:1789395165.388025:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239741440:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789395165.388041:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4ff86e300/2, rc 0, transno 4294969917 00000100:00100000:3.0:1789395165.388048:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239741312:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789395165.388065:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a43480/2, rc 0, transno 4294969909 00000100:00100000:3.0:1789395165.388069:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739392:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789395165.388087:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4ffb6ea00/2, rc 0, transno 4294969910 00000100:00100000:3.0:1789395165.388094:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239739904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.388113:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3637:x1876316239742464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 850us (2739us total) trans 4294969912 rc 0/0 00000004:00080000:3.0:1789395165.388117:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c98f1180/2, rc 0, transno 4294969903 00000100:00100000:0.0:1789395165.388133:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00000100:00100000:3.0:1789395165.388142:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740416:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789395165.388162:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a6f480/2, rc 0, transno 4294969904 00010000:00010000:0.0:1789395165.388165:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395165.388167:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740928:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789395165.388190:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c98f3b80/2, rc 0, transno 4294969909 00000100:00100000:3.0:1789395165.388196:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239740800:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789395165.388210:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c5cc4380/2, rc 0, transno 4294969912 00000100:00100000:0.0:1789395165.388220:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c5cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239742464:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789395165.388245:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395165.388326:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239742848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.388370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.388436:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395165.388443:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239742976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.388465:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.388500:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742848 00000100:00100000:3.0:1789395165.388507:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742848 00000100:00100000:0.0:1789395165.388527:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742976 00000100:00100000:0.0:1789395165.388536:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742976 00000100:00100000:3.0:1789395165.388558:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5273 00000100:00100000:3.0:1789395165.388569:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3636:x1876316239742848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.388595:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2529 count 1 00002000:00010000:3.0:1789395165.388628:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.388634:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.388648:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.388653:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.388659:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.388672:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.388689:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.388697:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.388725:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395165.388736:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.388743:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.388750:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.388765:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.388775:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.388784:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.388806:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789395165.388814:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00000100:00100000:0.0:1789395165.388839:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3636:x1876316239742976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.388863:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2530 count 1 00000100:00100000:3.0:1789395165.388873:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3636:x1876316239742848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 300us (498us total) trans 4294969918 rc 0/0 00000100:00100000:3.0:1789395165.388883:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5273 00010000:00010000:3.0:1789395165.388946:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789395165.388955:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3639:x1876316239742592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1457us (1589us total) trans 4294969919 rc 0/0 00010000:00010000:3.0:1789395165.388958:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.388976:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5272 00010000:00010000:3.0:1789395165.388980:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.388987:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.388998:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.389017:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.389020:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395165.389033:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d3c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.389054:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.389056:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.389058:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789395165.389084:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c825a680/2, rc 0, transno 4294969918 00010000:00010000:2.0:1789395165.389087:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.389098:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239742848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.389144:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239743104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789395165.389172:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.389178:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.389184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.389202:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.389223:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395165.389230:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3cac40380/2, rc 0, transno 4294969907 00010000:00010000:2.0:1789395165.389232:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3adb4b5/0xff35729af316d3ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.389240:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740160:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789395165.389264:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c98f2300/2, rc 0, transno 4294969908 00000100:00100000:3.0:1789395165.389271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740672:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789395165.389283:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4f6407800/2, rc 0, transno 4294969912 00000100:00100000:3.0:1789395165.389292:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239741184:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789395165.389300:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.389305:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.389310:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789395165.389313:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a49880/2, rc 0, transno 4294969905 00000100:00100000:3.0:1789395165.389323:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.389329:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743104 00000004:00080000:3.0:1789395165.389337:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c98f3100/2, rc 0, transno 4294969906 00000100:00100000:2.0:1789395165.389338:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743104 00000100:00100000:3.0:1789395165.389351:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239740544:0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1789395165.389365:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1789395165.389372:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4f6404e00/2, rc 0, transno 4294969911 00010000:00010000:0.0:1789395165.389376:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.389382:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239741056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.389422:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00000100:00100000:2.0:1789395165.389431:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3638:x1876316239743104:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.389453:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00002000:00080000:2.0:1789395165.389455:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2531 count 1 00000100:00100000:3.0:1789395165.389465:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239742720:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1789395165.389475:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.389485:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.389497:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.389503:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1789395165.389511:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.389512:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.389532:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.389541:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.389550:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.389560:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239743232:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789395165.389569:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395165.389583:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.389588:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.389594:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.389609:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789395165.389616:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.389627:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.389636:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.389655:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.389730:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3638:x1876316239743104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 297us (547us total) trans 4294969920 rc 0/0 00000100:00100000:3.0:1789395165.389733:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239743360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.389761:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00000100:00100000:3.0:1789395165.389782:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.389783:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239742720 00000100:00100000:2.0:1789395165.389792:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239742720 00000100:00100000:3.0:1789395165.389816:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789395165.389828:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743232 00000100:00100000:3.0:1789395165.389829:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239743488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.389836:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743232 00000100:00100000:3.0:1789395165.389867:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.389869:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743360 00000100:00100000:2.0:1789395165.389875:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743360 00000100:00100000:2.0:1789395165.389896:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743488 00000100:00100000:2.0:1789395165.389901:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743488 00000100:00100000:3.0:1789395165.389910:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276 00000100:00100000:3.0:1789395165.389926:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3638:x1876316239742720:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.389934:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277 00000100:00100000:2.0:1789395165.389947:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3638:x1876316239743232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.389952:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2528 count 1 00002000:00080000:2.0:1789395165.389965:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2532 count 1 00002000:00010000:3.0:1789395165.389979:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.389989:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395165.389992:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.390013:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390016:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.390032:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.390039:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390051:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390060:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390068:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390086:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1789395165.390186:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3638:x1876316239742720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 266us (683us total) trans 4294969922 rc 0/0 00000100:00100000:3.0:1789395165.390194:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276 00000100:00100000:3.0:1789395165.390213:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5278 00000100:00100000:3.0:1789395165.390220:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3636:x1876316239743360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.390234:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2533 count 1 00002000:00010000:3.0:1789395165.390250:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.390256:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390265:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.390269:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.390273:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390282:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390289:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390296:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390317:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1789395165.390380:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3636:x1876316239743360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (599us total) trans 4294969923 rc 0/0 00000100:00100000:3.0:1789395165.390407:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5278 00000100:00100000:3.0:1789395165.390419:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5279 00000100:00100000:3.0:1789395165.390426:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3636:x1876316239743488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.390437:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2534 count 1 00002000:00010000:3.0:1789395165.390451:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.390455:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390462:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.390465:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.390469:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390478:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390487:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390495:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390509:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1789395165.390565:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3636:x1876316239743488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 140us (699us total) trans 4294969924 rc 0/0 00000100:00100000:3.0:1789395165.390571:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5279 00010000:00010000:3.0:1789395165.390587:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789395165.390593:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390601:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.390606:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390617:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390633:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390640:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003026cf1b/0xff35729af316d3d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390659:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789395165.390663:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390674:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.390678:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390685:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390694:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.390702:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b047e7d7/0xff35729af316d3cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.390740:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.390745:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.390752:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.390766:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.390776:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.390783:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.390796:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1789395165.390919:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3638:x1876316239743232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 974us (1315us total) trans 4294969925 rc 0/0 00000100:00100000:2.0:1789395165.390926:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277 00010000:00010000:2.0:1789395165.390959:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.390966:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.390974:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.390979:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391157:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391178:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391187:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045883b00/0xff35729af316d3dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391212:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789395165.391216:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3636:x1876316239742976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2381us (2747us total) trans 4294969921 rc 0/0 00010000:00010000:2.0:1789395165.391218:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.391232:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00010000:00010000:2.0:1789395165.391235:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.391240:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391248:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391259:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391263:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.391274:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000595de8e6/0xff35729af316d3eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391274:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391300:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.391306:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391308:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.391315:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391320:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391326:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.391333:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391339:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391343:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391355:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a2fecb/0xff35729af316d3f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391362:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391372:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316d3e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.391372:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.391376:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.391379:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.391417:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.391420:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.391422:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.391433:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789395165.391450:0:14651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2525 count 1 00002000:00010000:2.0:1789395165.391472:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.391479:0:14651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391493:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.391497:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.391502:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391511:0:14651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391518:0:14651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391525:0:14651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.391540:0:14651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.391617:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3639:x1876316239742080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10919us (10983us total) trans 4294969926 rc 0/0 00000100:00100000:2.0:1789395165.391624:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268 00010000:00010000:0.0:1789395165.392526:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395165.392535:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.392544:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395165.392548:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.392558:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.392573:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.392581:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cf5d139/0xff35729af316d3f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.392600:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.392603:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395165.392604:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.393359:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239743744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.393435:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.393475:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239744256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.393496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789395165.393535:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9126d80/2, rc 0, transno 4294969919 00000100:00100000:2.0:1789395165.393548:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239742592:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.393564:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a6d880/2, rc 0, transno 4294969926 00000100:00100000:2.0:1789395165.393568:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239742080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.393582:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789395165.393587:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239743616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.393611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.393628:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239744128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.393647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.393678:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743744 00000100:00100000:2.0:1789395165.393684:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743744 00000100:00100000:2.0:1789395165.393731:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744256 00000100:00100000:2.0:1789395165.393735:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744256 00000100:00100000:2.0:1789395165.393749:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743616 00000100:00100000:2.0:1789395165.393752:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743616 00000100:00100000:2.0:1789395165.393766:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744128 00000100:00100000:2.0:1789395165.393769:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744128 00000100:00100000:2.0:1789395165.393786:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5280 00000100:00100000:2.0:1789395165.393795:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3639:x1876316239743744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.393821:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2523 count 1 00002000:00010000:2.0:1789395165.393852:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.393859:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.393875:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9db:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.393880:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.393887:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.393901:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.393911:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.393920:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.393936:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395165.394380:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5281 00000100:00100000:0.0:1789395165.394488:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239744256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.394509:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5282 00000100:00100000:0.0:1789395165.394516:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239743616:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.394529:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5283 00000100:00100000:0.0:1789395165.394535:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239744128:12345-0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1789395165.394822:0:21972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789395165.395026:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239744000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.395338:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.395440:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3639:x1876316239743744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1639us (1999us total) trans 4294969913 rc 0/0 00000100:00100000:2.0:1789395165.395452:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5280 00000100:00100000:1.0:1789395165.395469:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239744512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.395478:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744000 00000100:00100000:2.0:1789395165.395486:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744000 00000100:00100000:1.0:1789395165.395507:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.395610:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789395165.395618:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239743872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.395644:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789395165.396275:0:21972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789395165.396282:0:21972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000100:00100000:2.0:1789395165.397322:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744512 00000100:00100000:2.0:1789395165.397334:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744512 00000100:00100000:2.0:1789395165.397404:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5284 00000100:00100000:2.0:1789395165.397415:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3637:x1876316239744000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.397450:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2525 count 1 00002000:00010000:2.0:1789395165.397484:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.397492:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397510:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dd:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.397515:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.397521:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397540:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397550:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397559:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397586:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.397774:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3637:x1876316239744000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 360us (2437us total) trans 4294969914 rc 0/0 00000100:00100000:2.0:1789395165.397782:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5284 00000100:00100000:2.0:1789395165.397801:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5285 00000100:00100000:2.0:1789395165.397808:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3637:x1876316239744512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.397822:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2529 count 1 00002000:00010000:2.0:1789395165.397836:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.397841:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397849:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e1:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.397853:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.397857:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397872:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397880:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397887:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.397906:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1789395165.397971:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3637:x1876316239744512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 163us (2465us total) trans 4294969915 rc 0/0 00000100:00100000:2.0:1789395165.397978:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5285 00010000:00010000:2.0:1789395165.398003:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.398010:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.398018:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.398023:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.398034:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.398051:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.398060:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000906458bd/0xff35729af316d400 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.398083:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.398086:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.398092:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.398165:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395165.398184:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.398196:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.398201:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.398213:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.398237:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.398253:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d40e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.398278:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.398280:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.398283:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789395165.398543:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c825b480/2, rc 0, transno 4294969924 00000100:00100000:3.0:1789395165.398571:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239743488:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789395165.398592:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c8258380/2, rc 0, transno 4294969923 00000100:00100000:3.0:1789395165.398599:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239743360:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789395165.398619:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c825ad80/2, rc 0, transno 4294969921 00000100:00100000:3.0:1789395165.398624:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239742976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.398735:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239744896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.398827:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239744640:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.399606:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2527 count 1 00002000:00010000:3.0:1789395165.399647:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.399656:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.399673:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9df:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.399677:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.399685:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.399714:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.399725:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.399734:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.399751:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1789395165.400031:0:21972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1789395165.400050:0:21972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1789395165.400583:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3639:x1876316239744256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6093us (7080us total) trans 4294969916 rc 0/0 00000100:00100000:3.0:1789395165.400595:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5281 00002000:00080000:3.0:1789395165.400658:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2522 count 1 00010000:00010000:2.0:1789395165.401940:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.401976:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402005:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402013:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fe33e9a/0xff35729af316d407 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402037:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.402043:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402051:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ae00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.402056:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402063:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402073:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402080:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ee4ee07/0xff35729af316d415 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402094:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.402096:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.402099:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.402108:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.402135:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239744768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.402225:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239743872 00000100:00100000:2.0:1789395165.402233:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239743872 00000100:00100000:2.0:1789395165.402301:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286 00000100:00100000:2.0:1789395165.402313:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3637:x1876316239743872:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.402321:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239744384:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.402352:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2524 count 1 00002000:00010000:2.0:1789395165.402414:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.402421:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.402423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.402440:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dc:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.402446:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.402454:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402468:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402478:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395165.402490:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9125500/2, rc 0, transno 4294969914 00010000:00010000:2.0:1789395165.402491:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.402514:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239744000:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789395165.402518:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789395165.402536:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d8356a00/2, rc 0, transno 4294969915 00000100:00100000:1.0:1789395165.402543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239744512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.402568:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239745024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.402601:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.402660:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744384 00000100:00100000:1.0:1789395165.402667:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744384 00000100:00100000:2.0:1789395165.402717:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3637:x1876316239743872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 392us (7057us total) trans 4294969917 rc 0/0 00000100:00100000:2.0:1789395165.402728:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286 00000100:00100000:1.0:1789395165.402732:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745024 00000100:00100000:1.0:1789395165.402739:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745024 00000100:00100000:2.0:1789395165.402761:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5287 00000100:00100000:2.0:1789395165.402773:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3637:x1876316239744384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.402794:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5288 00002000:00080000:2.0:1789395165.402795:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2528 count 1 00000100:00100000:1.0:1789395165.402813:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3637:x1876316239745024:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1789395165.402820:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.402830:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789395165.402840:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2538 count 1 00010000:00010000:2.0:1789395165.402841:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e0:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.402851:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.402856:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402867:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402876:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395165.402879:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.402897:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402899:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.402944:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789395165.402947:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.402956:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.402963:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.402982:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.402994:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.403004:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.403019:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1789395165.403030:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3637:x1876316239744384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 258us (606us total) trans 4294969918 rc 0/0 00002000:00010000:3.0:1789395165.403490:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.403505:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.403517:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9da:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.403521:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.403526:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.403538:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.403553:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.403562:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.403573:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1789395165.403824:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3639:x1876316239743616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9305us (10209us total) trans 4294969919 rc 0/0 00000100:00100000:3.0:1789395165.403832:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5282 00002000:00080000:3.0:1789395165.403897:0:10007:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2526 count 1 00002000:00010000:3.0:1789395165.403922:0:10007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1789395165.404325:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5287 00010000:00010000:2.0:1789395165.404361:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.404368:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404379:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.404395:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404406:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404424:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404432:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30a2410/0xff35729af316d423 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404452:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.404456:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404462:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.404465:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404472:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404481:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404487:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb7171cd/0xff35729af316d42a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404500:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.404505:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404513:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.404519:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.404520:0:10007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404550:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.404558:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9de:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.404566:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.404566:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.404574:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404585:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024c35777/0xff35729af316d431 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.404598:0:10007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404610:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395165.404612:0:10007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404618:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404662:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.404665:0:10007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404669:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.404700:0:10007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395165.404701:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404728:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404735:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e17c4a/0xff35729af316d41c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404754:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.404758:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404766:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.404769:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404776:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404787:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404794:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077fdd47/0xff35729af316d438 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.404808:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.404810:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.404812:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395165.404864:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3639:x1876316239744128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10324us (11210us total) trans 4294969920 rc 0/0 00000100:00100000:3.0:1789395165.404878:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5283 00000100:00100000:2.0:1789395165.404911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.405120:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3637:x1876316239745024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2310us (2515us total) trans 4294969927 rc 0/0 00000100:00100000:1.0:1789395165.405129:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5288 00000100:00100000:1.0:1789395165.405152:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744768 00000100:00100000:1.0:1789395165.405160:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744768 00000100:00100000:3.0:1789395165.405512:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5289 00000100:00100000:3.0:1789395165.405526:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3639:x1876316239744768:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.405530:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9127100/2, rc 0, transno 4294969919 00000100:00100000:2.0:1789395165.405546:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239743616:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.405555:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2536 count 1 00000004:00080000:2.0:1789395165.405561:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d8354700/2, rc 0, transno 4294969920 00000100:00100000:2.0:1789395165.405568:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239744128:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.405581:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9125180/2, rc 0, transno 4294969913 00000100:00100000:2.0:1789395165.405584:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239743744:0@lo:6:osp-syn-1-0.0 00002000:00010000:3.0:1789395165.405593:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1789395165.405596:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d8355180/2, rc 0, transno 4294969916 00010000:00010000:3.0:1789395165.405603:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.405604:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239744256:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789395165.405629:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=616s v=(0 0) 00000100:00100000:2.0:1789395165.405634:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239745280:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789395165.405637:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.405646:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.405661:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.405672:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.405686:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.405713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.405799:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745280 00000100:00100000:2.0:1789395165.405804:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745280 00000100:00100000:2.0:1789395165.405837:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5290 00000100:00100000:2.0:1789395165.405844:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d99d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3639:x1876316239745280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.405864:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2530 count 1 00002000:00010000:2.0:1789395165.405890:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.405896:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.405910:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e2:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.405915:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.405921:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.405932:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.405940:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.405954:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.405978:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.406183:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3639:x1876316239745280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 338us (488us total) trans 4294969921 rc 0/0 00000100:00100000:2.0:1789395165.406190:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5290 00010000:00010000:2.0:1789395165.406211:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.406216:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406223:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.406227:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406236:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406249:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406257:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316d446 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406273:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.406275:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.406277:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.406287:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239745792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.406310:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789395165.406334:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d8355880/2, rc 0, transno 4294969921 00000100:00100000:2.0:1789395165.406340:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239745280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.406348:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395165.406352:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239745664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.406368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.406425:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.406433:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745792 00000100:00100000:2.0:1789395165.406436:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745792 00000100:00100000:2.0:1789395165.406454:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745664 00000100:00100000:2.0:1789395165.406456:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745664 00000100:00100000:2.0:1789395165.406472:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5291 00000100:00100000:2.0:1789395165.406478:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3639:x1876316239745792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.406494:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2534 count 1 00002000:00010000:2.0:1789395165.406511:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.406516:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406525:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e6:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.406528:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.406532:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406542:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406554:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406560:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406573:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.406647:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3639:x1876316239745792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 169us (335us total) trans 4294969922 rc 0/0 00000100:00100000:2.0:1789395165.406654:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5291 00000100:00100000:2.0:1789395165.406667:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5292 00000100:00100000:2.0:1789395165.406673:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3639:x1876316239745664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.406685:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2533 count 1 00002000:00010000:2.0:1789395165.406698:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.406702:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406721:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e5:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.406725:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.406729:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406738:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406750:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406757:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406769:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.406827:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3639:x1876316239745664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 154us (457us total) trans 4294969923 rc 0/0 00000100:00100000:2.0:1789395165.406834:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5292 00010000:00010000:2.0:1789395165.406848:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.406852:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406860:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.406863:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406872:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406882:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406889:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316d44d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406902:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.406905:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406911:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.406914:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406921:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406928:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406935:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001458002/0xff35729af316d454 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.406944:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.406945:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.406946:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.406966:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d99d5880/2, rc 0, transno 4294969923 00000100:00100000:2.0:1789395165.406990:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239745664:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.407004:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d99d6a00/2, rc 0, transno 4294969922 00010000:00010000:3.0:1789395165.407005:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.407011:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239745792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.407070:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789395165.407412:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d99d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3639:x1876316239744768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1887us (2498us total) trans 4294969928 rc 0/0 00000100:00100000:3.0:1789395165.407423:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5289 00010000:00010000:3.0:1789395165.407480:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789395165.407486:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.407498:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:3.0:1789395165.407503:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.407516:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.407537:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.407537:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789395165.407552:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d43f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.407588:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.407591:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789395165.407595:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.407603:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d9c00/2, rc 0, transno 4294969928 00010000:00010000:3.0:1789395165.407607:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.407627:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239744768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.407643:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395165.407651:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.407688:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.407735:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746304 00000100:00100000:2.0:1789395165.407740:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746304 00000100:00100000:2.0:1789395165.407775:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746176 00000100:00100000:2.0:1789395165.407779:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746176 00000100:00100000:2.0:1789395165.407795:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5293 00000100:00100000:2.0:1789395165.407802:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3639:x1876316239746304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.407822:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2538 count 1 00002000:00010000:2.0:1789395165.407845:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.407851:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.407863:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ea:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.407867:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.407872:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.407883:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.407891:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.407905:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.407917:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.408455:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3639:x1876316239746304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 650us (1355us total) trans 4294969924 rc 0/0 00000100:00100000:2.0:1789395165.408463:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5293 00000100:00100000:2.0:1789395165.408482:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5294 00000100:00100000:2.0:1789395165.408489:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3639:x1876316239746176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.408503:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2537 count 1 00002000:00010000:2.0:1789395165.408521:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.408526:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408535:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e9:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.408538:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.408543:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408553:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408561:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408574:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408588:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.408650:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3639:x1876316239746176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 161us (964us total) trans 4294969925 rc 0/0 00000100:00100000:2.0:1789395165.408656:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5294 00010000:00010000:2.0:1789395165.408675:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.408681:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408690:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.408694:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408704:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408768:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408775:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000741fb3ff/0xff35729af316d45b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408795:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.408799:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408806:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.408809:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408818:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408827:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408834:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822597c5/0xff35729af316d462 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.408846:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.408848:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.408850:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.408877:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4e7f61180/2, rc 0, transno 4294969925 00000100:00100000:2.0:1789395165.408887:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746176:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.408897:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4e7f63800/2, rc 0, transno 4294969924 00000100:00100000:2.0:1789395165.408901:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.408958:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395165.408966:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.409063:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.409184:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746688 00000100:00100000:2.0:1789395165.409190:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746688 00000100:00100000:2.0:1789395165.409220:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5295 00000100:00100000:2.0:1789395165.409226:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3639:x1876316239746688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.409241:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2540 count 1 00002000:00010000:2.0:1789395165.409258:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.409263:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409273:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ec:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.409277:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.409281:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409291:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409299:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409309:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409325:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.409425:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3639:x1876316239746688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 199us (362us total) trans 4294969926 rc 0/0 00000100:00100000:2.0:1789395165.409432:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5295 00010000:00010000:2.0:1789395165.409448:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.409453:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409461:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.409464:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409472:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409485:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409493:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066e09617/0xff35729af316d469 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.409507:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.409509:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.409511:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.409530:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c93e6300/2, rc 0, transno 4294969926 00000100:00100000:2.0:1789395165.409539:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.409578:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.409602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.409629:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.410458:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746816 00000100:00100000:2.0:1789395165.410466:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746816 00000100:00100000:2.0:1789395165.410503:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5296 00000100:00100000:2.0:1789395165.410510:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3639:x1876316239746816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.410528:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2541 count 1 00002000:00010000:2.0:1789395165.410549:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.410555:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410566:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ed:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.410570:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.410574:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410585:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410593:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410600:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410615:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.410740:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3639:x1876316239746816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 229us (1136us total) trans 4294969927 rc 0/0 00000100:00100000:2.0:1789395165.410746:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5296 00010000:00010000:2.0:1789395165.410769:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.410774:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410784:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.410788:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410798:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410812:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410819:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df56a600/0xff35729af316d470 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.410836:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.410838:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.410839:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.410848:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.410872:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20f100/2, rc 0, transno 4294969927 00000100:00100000:2.0:1789395165.410882:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239746816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411490:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239745408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411538:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239745920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411556:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411571:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.411589:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411601:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411634:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789395165.411639:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239745536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411657:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411666:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411683:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.411692:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.411730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.411758:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744896 00000100:00100000:0.0:1789395165.411769:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.411773:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744896 00000100:00100000:0.0:1789395165.411786:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239745152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.411822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.411832:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745408 00000100:00100000:3.0:1789395165.411838:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745408 00000004:00080000:0.0:1789395165.411859:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c8259c00/2, rc 0, transno 4294969922 00000100:00100000:3.0:1789395165.411863:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745920 00000100:00100000:3.0:1789395165.411868:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745920 00000100:00100000:0.0:1789395165.411877:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239742720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.411880:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746432 00000100:00100000:3.0:1789395165.411885:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746432 00000100:00100000:3.0:1789395165.411901:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746944 00000004:00080000:0.0:1789395165.411901:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c8259880/2, rc 0, transno 4294969925 00000100:00100000:3.0:1789395165.411907:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746944 00000100:00100000:0.0:1789395165.411916:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239743232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.411926:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745536 00000004:00080000:0.0:1789395165.411935:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c8259180/2, rc 0, transno 4294969920 00000100:00100000:0.0:1789395165.411940:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239743104:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.411960:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746048 00000100:00100000:0.0:1789395165.411965:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746048 00000100:00100000:3.0:1789395165.412030:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745536 00000100:00100000:2.0:1789395165.412093:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239746560 00000100:00100000:3.0:1789395165.412160:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239744640 00000100:00100000:2.0:1789395165.412162:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239746560 00000100:00100000:3.0:1789395165.412167:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239744640 00000100:00100000:2.0:1789395165.412203:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239745152 00000100:00100000:3.0:1789395165.412210:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5297 00000100:00100000:2.0:1789395165.412210:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239745152 00000100:00100000:3.0:1789395165.412231:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3636:x1876316239744896:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.412249:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5298 00000100:00100000:2.0:1789395165.412261:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3636:x1876316239745408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.412271:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2537 count 1 00002000:00080000:2.0:1789395165.412287:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2531 count 1 00002000:00010000:3.0:1789395165.412314:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1789395165.412318:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.412328:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412342:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e3:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.412346:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.412352:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412364:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412372:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412380:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412425:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.412549:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3636:x1876316239745408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (1025us total) trans 4294969928 rc 0/0 00000100:00100000:2.0:1789395165.412558:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5298 00000100:00100000:2.0:1789395165.412579:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5299 00000100:00100000:2.0:1789395165.412587:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3636:x1876316239745920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.412600:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2535 count 1 00002000:00010000:2.0:1789395165.412617:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.412623:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412632:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e7:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.412636:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.412641:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412652:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412660:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412668:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412681:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789395165.412762:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3636:x1876316239745920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175us (1203us total) trans 4294969929 rc 0/0 00000100:00100000:2.0:1789395165.412769:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5299 00000100:00100000:2.0:1789395165.412840:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5300 00000100:00100000:2.0:1789395165.412852:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3636:x1876316239746432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.412865:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2540 count 1 00002000:00010000:2.0:1789395165.412886:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.412892:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412902:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.412906:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.412911:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412921:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412930:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412939:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.412953:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789395165.413025:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413156:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.413161:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.413168:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413184:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413202:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413210:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413225:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1789395165.413259:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5301 00000100:00100000:0.0:1789395165.413272:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3636:x1876316239746944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.413287:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2542 count 1 00002000:00010000:0.0:1789395165.413309:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.413315:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413326:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ee:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.413329:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.413334:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413346:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413356:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413364:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413381:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1789395165.413479:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3636:x1876316239746944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 211us (1858us total) trans 4294969930 rc 0/0 00000100:00100000:0.0:1789395165.413487:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5301 00000100:00100000:0.0:1789395165.413510:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5302 00000100:00100000:0.0:1789395165.413518:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3636:x1876316239746048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.413531:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2536 count 1 00002000:00010000:0.0:1789395165.413549:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.413555:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413565:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e8:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.413569:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.413574:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.413586:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c5cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3636:x1876316239744896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1357us (2136us total) trans 4294969929 rc 0/0 00010000:00010000:0.0:1789395165.413591:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.413601:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5297 00010000:00010000:0.0:1789395165.413616:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413626:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.413638:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5303 00010000:00010000:0.0:1789395165.413657:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1789395165.413662:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3636:x1876316239745536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789395165.413686:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2532 count 1 00002000:00010000:3.0:1789395165.413726:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.413733:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413744:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e4:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.413748:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.413754:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.413757:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3636:x1876316239746048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 238us (2069us total) trans 4294969931 rc 0/0 00000100:00100000:0.0:1789395165.413791:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5302 00010000:00010000:3.0:1789395165.413792:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.413812:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.413819:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5304 00010000:00010000:3.0:1789395165.413835:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.413836:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3636:x1876316239746560:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789395165.413863:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:0.0:1789395165.413866:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2539 count 1 00002000:00010000:0.0:1789395165.413889:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.413896:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413908:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9eb:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.413912:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.413916:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413928:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413938:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413946:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.413963:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1789395165.414356:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3636:x1876316239746432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1506us (2763us total) trans 4294969930 rc 0/0 00000100:00100000:2.0:1789395165.414365:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5300 00000100:00100000:2.0:1789395165.414381:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5305 00000100:00100000:2.0:1789395165.414404:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3638:x1876316239744640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.414418:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2535 count 1 00002000:00010000:2.0:1789395165.414438:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.414443:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414458:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.414462:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.414466:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414477:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414485:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414493:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414502:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1789395165.414580:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3638:x1876316239744640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 178us (2815us total) trans 4294969931 rc 0/0 00000100:00100000:2.0:1789395165.414586:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5305 00000100:00100000:2.0:1789395165.414677:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5306 00000100:00100000:2.0:1789395165.414684:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3638:x1876316239745152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.414696:0:14478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2539 count 1 00002000:00010000:2.0:1789395165.414721:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.414727:0:14478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414741:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.414744:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.414748:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414757:0:14478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414765:0:14478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414772:0:14478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.414781:0:14478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:2.0:1789395165.415287:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3638:x1876316239745152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 601us (3466us total) trans 4294969932 rc 0/0 00000100:00100000:2.0:1789395165.415295:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5306 00010000:00010000:2.0:1789395165.415347:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1789395165.415354:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415365:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.415369:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415423:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415441:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415449:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ab8cb8/0xff35729af316d47e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415467:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789395165.415471:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415478:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.415481:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415488:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415498:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415505:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003026cf1b/0xff35729af316d485 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415520:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789395165.415524:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415530:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.415533:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415541:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415551:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415558:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033b9fcd7/0xff35729af316d48c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415573:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789395165.415578:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415585:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.415588:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415601:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415612:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415620:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e80a21a/0xff35729af316d477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415633:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789395165.415638:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415646:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.415651:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415660:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415672:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415679:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004724f4de/0xff35729af316d493 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415703:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789395165.415719:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415726:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.415730:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.415738:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416018:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416029:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce9dae3f/0xff35729af316d49a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416048:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.416052:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416058:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.416061:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416072:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416083:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416090:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4de5298/0xff35729af316d4a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416169:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.416174:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416181:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.416184:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416191:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416201:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416207:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3bef3c/0xff35729af316d4a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416223:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.416226:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416232:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dee00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.416235:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416243:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416251:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416258:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090fc5006/0xff35729af316d4af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416269:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.416272:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416277:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.416280:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416292:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416302:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416309:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da759c25/0xff35729af316d4b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.416319:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.416321:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.416323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.416337:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.416344:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.416500:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789395165.416781:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009db480/2, rc 0, transno 4294969927 00000100:00100000:1.0:1789395165.416797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239745024:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789395165.416825:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9124380/2, rc 0, transno 4294969917 00000100:00100000:0.0:1789395165.416840:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3636:x1876316239746560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3001us (5106us total) trans 4294969933 rc 0/0 00000100:00100000:1.0:1789395165.416846:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239743872:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789395165.416862:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d8357480/2, rc 0, transno 4294969918 00000100:00100000:1.0:1789395165.416865:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d8357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239744384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.416953:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395165.417054:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239747072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.417689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239747200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.417783:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5304 00000004:00080000:0.0:1789395165.419571:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c98f3480/2, rc 0, transno 4294969931 00000100:00100000:0.0:1789395165.419584:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239744640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.419598:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d8700/2, rc 0, transno 4294969932 00000100:00100000:0.0:1789395165.419601:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239745152:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.419632:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4e7f62d80/2, rc 0, transno 4294969931 00000100:00100000:0.0:1789395165.419649:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746048:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789395165.419658:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4e7f63480/2, rc 0, transno 4294969933 00000100:00100000:0.0:1789395165.419661:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746560:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789395165.419669:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d99d4700/2, rc 0, transno 4294969928 00000100:00100000:0.0:1789395165.419672:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239745408:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789395165.419679:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4e7f60e00/2, rc 0, transno 4294969929 00000100:00100000:0.0:1789395165.419690:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239745920:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789395165.419699:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d8000/2, rc 0, transno 4294969930 00000100:00100000:0.0:1789395165.419703:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746432:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789395165.419721:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20d180/2, rc 0, transno 4294969930 00000100:00100000:0.0:1789395165.419724:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239746944:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789395165.419732:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009daa00/2, rc 0, transno 4294969929 00000100:00100000:0.0:1789395165.419735:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239744896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.419838:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239747712:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789395165.424043:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3636:x1876316239745536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10144us (12138us total) trans 4294969932 rc 0/0 00000100:00100000:3.0:1789395165.424065:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5303 00000100:00100000:1.0:1789395165.424441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.424530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.424608:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239747328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.424662:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.424663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239747584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.424689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239747840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.424748:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.424824:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239747456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.435171:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747072 00000100:00100000:0.0:1789395165.435186:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747072 00000100:00100000:0.0:1789395165.435251:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747200 00000100:00100000:0.0:1789395165.435255:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747200 00000100:00100000:0.0:1789395165.435272:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747328 00000100:00100000:0.0:1789395165.435274:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747328 00000100:00100000:0.0:1789395165.435294:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307 00000100:00100000:2.0:1789395165.435349:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.435430:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.435462:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.435483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.435501:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789395165.435507:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.435528:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.435539:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.435557:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.435589:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747840 00000100:00100000:2.0:1789395165.435593:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747840 00000100:00100000:0.0:1789395165.435648:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3637:x1876316239747072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.435678:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2543 count 1 00002000:00010000:0.0:1789395165.435722:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.435729:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.435745:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ef:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.435749:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.435755:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.435769:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.435779:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.435787:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.435806:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789395165.435932:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3637:x1876316239747072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 287us (11494us total) trans 4294969934 rc 0/0 00000100:00100000:2.0:1789395165.436923:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748352 00000100:00100000:2.0:1789395165.436932:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748352 00000100:00100000:2.0:1789395165.436956:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748864 00000100:00100000:2.0:1789395165.436958:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748864 00000100:00100000:0.0:1789395165.437343:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307 00000100:00100000:0.0:1789395165.437366:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748224 00000100:00100000:0.0:1789395165.437369:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748224 00000100:00100000:0.0:1789395165.437381:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748736 00000100:00100000:0.0:1789395165.437395:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748736 00000100:00100000:0.0:1789395165.437411:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5308 00000100:00100000:0.0:1789395165.437419:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239747200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.437442:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2544 count 1 00002000:00010000:0.0:1789395165.437472:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.437478:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437492:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f0:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.437496:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.437502:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437515:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437523:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437536:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437562:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1789395165.437702:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3639:x1876316239747200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 283us (13180us total) trans 4294969935 rc 0/0 00000100:00100000:0.0:1789395165.437719:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5308 00000100:00100000:0.0:1789395165.437734:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5309 00000100:00100000:0.0:1789395165.437740:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239747328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.437755:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2545 count 1 00002000:00010000:0.0:1789395165.437772:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.437778:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437786:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f1:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.437790:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.437795:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437805:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.437813:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.437825:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5310 00010000:00010000:0.0:1789395165.437838:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.437856:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239747840:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789395165.437859:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1789395165.437898:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2549 count 1 00002000:00010000:1.0:1789395165.437936:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.437945:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.437947:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3639:x1876316239747328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 204us (13286us total) trans 4294969936 rc 0/0 00010000:00010000:1.0:1789395165.437978:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f5:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.437983:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.437989:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438005:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438015:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438024:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438050:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1789395165.438216:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3639:x1876316239747840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 374us (13470us total) trans 4294969937 rc 0/0 00000100:00100000:1.0:1789395165.438227:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5310 00000100:00100000:1.0:1789395165.438250:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5311 00000100:00100000:1.0:1789395165.438259:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3639:x1876316239748352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.438423:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2544 count 1 00002000:00010000:1.0:1789395165.438445:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.438451:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438462:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.438466:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.438471:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438482:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438491:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438499:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.438508:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1789395165.439192:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5309 00000100:00100000:0.0:1789395165.439228:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5312 00000100:00100000:0.0:1789395165.439242:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3639:x1876316239748864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.439268:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2548 count 1 00002000:00010000:0.0:1789395165.439298:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.439305:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.439319:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.439324:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.439330:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.439342:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.439351:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395165.439362:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5313 00010000:00010000:0.0:1789395165.439364:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.439376:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1789395165.439577:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239748224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789395165.439592:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2543 count 1 00002000:00010000:2.0:1789395165.439609:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.439614:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.439623:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.439626:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.439630:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.439639:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.439647:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.439654:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.439663:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1789395165.439913:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3639:x1876316239748864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 677us (4427us total) trans 4294969934 rc 0/0 00000100:00100000:0.0:1789395165.439921:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5312 00000100:00100000:0.0:1789395165.439938:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5314 00000100:00100000:0.0:1789395165.439946:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239748736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.439958:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2547 count 1 00000100:00100000:1.0:1789395165.440025:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239748352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1761us (4587us total) trans 4294969933 rc 0/0 00000100:00100000:1.0:1789395165.440037:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5311 00000100:00100000:1.0:1789395165.440095:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1789395165.440099:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.440108:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.440118:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.440121:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.440125:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.440135:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.440143:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.440156:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.440165:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1789395165.440210:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3639:x1876316239748224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 637us (4679us total) trans 4294969935 rc 0/0 00000100:00100000:2.0:1789395165.440221:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5313 00000100:00100000:2.0:1789395165.440247:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747584 00000100:00100000:2.0:1789395165.440253:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747584 00000100:00100000:0.0:1789395165.440254:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3639:x1876316239748736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 310us (4695us total) trans 4294969936 rc 0/0 00000100:00100000:0.0:1789395165.440262:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5314 00000100:00100000:2.0:1789395165.440306:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5315 00000100:00100000:2.0:1789395165.440313:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3637:x1876316239747584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.440325:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2547 count 1 00002000:00010000:2.0:1789395165.440343:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.440348:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.440357:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f3:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.440360:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.440364:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.440374:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.440381:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.440411:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.440422:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000004:00080000:1.0:1789395165.440437:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20f800/2, rc 0, transno 4294969934 00000100:00100000:1.0:1789395165.440457:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239747072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.440485:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239748096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.440626:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3637:x1876316239747584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 193us (411us total) trans 4294969938 rc 0/0 00000100:00100000:2.0:1789395165.440635:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5315 00000100:00100000:1.0:1789395165.440910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.440958:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239748608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.440987:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789395165.441012:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a41180/2, rc 0, transno 4294969938 00000100:00100000:1.0:1789395165.441017:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239747584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.441029:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789395165.441036:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239747968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.441058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.441072:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239748480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.441094:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.441126:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748096 00000100:00100000:1.0:1789395165.441133:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748096 00000100:00100000:0.0:1789395165.441150:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748608 00000100:00100000:0.0:1789395165.441158:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748608 00000100:00100000:1.0:1789395165.441173:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747968 00000100:00100000:1.0:1789395165.441179:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747968 00000100:00100000:0.0:1789395165.441193:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748480 00000100:00100000:0.0:1789395165.441199:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748480 00000100:00100000:1.0:1789395165.441211:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5316 00000100:00100000:1.0:1789395165.441223:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3637:x1876316239748096:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.441232:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5317 00000100:00100000:0.0:1789395165.441244:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3637:x1876316239748608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.441256:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2542 count 1 00002000:00080000:0.0:1789395165.441264:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2546 count 1 00002000:00010000:0.0:1789395165.441286:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.441292:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441302:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.441305:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.441310:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441320:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441333:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441340:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441351:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:0.0:1789395165.441475:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3637:x1876316239748608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 233us (485us total) trans 4294969937 rc 0/0 00000100:00100000:0.0:1789395165.441483:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5317 00000100:00100000:0.0:1789395165.441504:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5318 00002000:00010000:1.0:1789395165.441512:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1789395165.441514:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3637:x1876316239747968:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789395165.441524:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789395165.441531:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2541 count 1 00002000:00010000:0.0:1789395165.441556:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.441562:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441570:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.441573:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.441576:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441586:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441598:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441605:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441613:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000100:00100000:0.0:1789395165.441678:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3637:x1876316239747968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 166us (617us total) trans 4294969938 rc 0/0 00000100:00100000:0.0:1789395165.441684:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5318 00000100:00100000:0.0:1789395165.441697:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5319 00000100:00100000:0.0:1789395165.441703:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3637:x1876316239748480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.441732:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2545 count 1 00002000:00010000:0.0:1789395165.441745:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.441758:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.441762:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.441779:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.441781:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.441788:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.441789:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441794:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.441830:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441831:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.441868:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441872:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.441900:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.441904:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.441930:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:0.0:1789395165.441932:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00000100:00100000:0.0:1789395165.442017:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3637:x1876316239748480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 312us (920us total) trans 4294969939 rc 0/0 00000100:00100000:0.0:1789395165.442025:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5319 00000100:00100000:1.0:1789395165.442082:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3637:x1876316239748096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 859us (1543us total) trans 4294969940 rc 0/0 00000100:00100000:1.0:1789395165.442091:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5316 00000004:00080000:1.0:1789395165.442147:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d9500/2, rc 0, transno 4294969938 00000100:00100000:1.0:1789395165.442176:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239747968:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789395165.442194:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d8380/2, rc 0, transno 4294969939 00000100:00100000:1.0:1789395165.442198:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239748480:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789395165.442216:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009dad80/2, rc 0, transno 4294969940 00000100:00100000:1.0:1789395165.442220:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239748096:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789395165.442230:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009dbb80/2, rc 0, transno 4294969937 00000100:00100000:1.0:1789395165.442233:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239748608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.442466:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789395165.442527:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4d99d7800/2, rc 0, transno 4294969932 00000100:00100000:1.0:1789395165.442533:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4d99d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239745536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.442727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.442785:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747456 00000100:00100000:1.0:1789395165.442792:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747456 00000100:00100000:0.0:1789395165.442799:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239747712 00000100:00100000:0.0:1789395165.442808:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239747712 00000100:00100000:1.0:1789395165.442842:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5320 00000100:00100000:1.0:1789395165.442855:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3636:x1876316239747456:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.442858:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5321 00000100:00100000:0.0:1789395165.442878:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3638:x1876316239747712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789395165.442888:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2546 count 1 00002000:00080000:0.0:1789395165.442901:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2548 count 1 00002000:00010000:1.0:1789395165.442922:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.442931:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395165.442932:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.442953:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.442958:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f2:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.442970:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.442976:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.442990:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.443000:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.443009:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.443026:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00000100:00100000:1.0:1789395165.443135:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3636:x1876316239747456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 283us (669us total) trans 4294969939 rc 0/0 00000100:00100000:1.0:1789395165.443144:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5320 00000004:00080000:1.0:1789395165.443175:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a42d80/2, rc 0, transno 4294969939 00000100:00100000:1.0:1789395165.443180:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239747456:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789395165.443278:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f4:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.443283:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.443289:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.443304:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.443315:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.443323:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.443334:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00000100:00100000:1.0:1789395165.443486:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239748992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395165.443498:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3638:x1876316239747712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 624us (768us total) trans 4294969940 rc 0/0 00000100:00100000:0.0:1789395165.443508:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5321 00010000:00010000:2.0:1789395165.443557:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1789395165.443566:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443575:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.443579:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443588:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443605:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443612:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8faf8ff/0xff35729af316d4bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443629:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1789395165.443634:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443640:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.443643:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443651:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443659:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443666:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b46fabd/0xff35729af316d4c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.443678:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1789395165.443683:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.443712:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.443757:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239749504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.443785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.443856:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239748992 00000100:00100000:0.0:1789395165.443864:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239748992 00000100:00100000:0.0:1789395165.443896:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749504 00000100:00100000:0.0:1789395165.443900:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749504 00000100:00100000:0.0:1789395165.443920:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1789395165.443927:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3636:x1876316239748992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.443943:0:14655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2550 count 1 00002000:00010000:0.0:1789395165.443963:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.443982:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.443999:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f6:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.444003:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.444008:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.444022:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.444030:0:14655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.444047:0:14655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.444057:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:2.0:1789395165.446157:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446165:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446179:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446208:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446215:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b047e7d7/0xff35729af316d4cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446246:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1789395165.446253:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446260:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446263:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446270:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446279:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446286:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000110ce1c9/0xff35729af316d4d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446299:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1789395165.446304:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446311:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446314:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446322:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446332:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446339:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bb42ec1/0xff35729af316d4d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446352:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1789395165.446356:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446363:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446367:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446375:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446397:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446405:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073214b0d/0xff35729af316d4e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446418:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1789395165.446422:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446429:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446432:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446440:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446450:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446457:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051abe21c/0xff35729af316d4e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446469:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789395165.446472:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446478:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446482:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446489:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446498:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446514:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e9ef06/0xff35729af316d4ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446528:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789395165.446532:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446539:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446542:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446549:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446558:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446566:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566acef2/0xff35729af316d4f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446578:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789395165.446582:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446588:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446591:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446599:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446608:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446616:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d79f9274/0xff35729af316d4fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446627:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789395165.446631:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446638:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446641:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446654:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446663:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446671:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a301dcc3/0xff35729af316d50a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446681:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789395165.446684:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446884:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446888:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446897:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446954:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446964:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a9e36a/0xff35729af316d503 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446984:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.446988:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.446994:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.446997:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447004:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447013:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447020:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9d0f/0xff35729af316d511 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447033:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.447037:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447116:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.447120:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447133:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447144:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447152:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e5371a1/0xff35729af316d518 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447165:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.447169:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447175:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.447177:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447185:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447195:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447203:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f1b813/0xff35729af316d51f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447219:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.447223:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447230:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10da00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.447233:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447241:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447249:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447256:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316d526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447266:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.447268:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.447271:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395165.447313:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5323 00000100:00100000:2.0:1789395165.447331:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3636:x1876316239749504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.447368:0:10007:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2553 count 1 00002000:00010000:2.0:1789395165.447419:0:10007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.447424:0:10007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447436:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f9:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.447440:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.447446:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447457:0:10007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447465:0:10007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447472:0:10007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.447493:0:10007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789395165.452907:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.453019:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789395165.453140:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a43100/2, rc 0, transno 4294969940 00000100:00100000:2.0:1789395165.453153:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3636:x1876316239749504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5817us (9353us total) trans 4294969942 rc 0/0 00000100:00100000:1.0:1789395165.453161:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239747712:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.453183:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5323 00000100:00100000:1.0:1789395165.453183:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395165.453197:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cac41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.453226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.453269:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749248 00000100:00100000:2.0:1789395165.453279:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749248 00000100:00100000:2.0:1789395165.453330:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749376 00000100:00100000:2.0:1789395165.453334:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749376 00000100:00100000:2.0:1789395165.453353:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5324 00000100:00100000:2.0:1789395165.453361:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3638:x1876316239749248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.453406:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2551 count 1 00002000:00010000:2.0:1789395165.453442:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.453451:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.453467:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f7:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.453472:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.453480:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.453494:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5325 00010000:00010000:2.0:1789395165.453497:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.453511:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3638:x1876316239749376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789395165.453527:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789395165.453535:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2552 count 1 00010000:00010000:2.0:1789395165.453536:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.453557:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789395165.453572:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.453583:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.453604:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f8:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.453609:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.453617:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.453631:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.453641:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.453651:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.453663:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1789395165.453883:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3638:x1876316239749376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 378us (656us total) trans 4294969944 rc 0/0 00000100:00100000:1.0:1789395165.453890:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5325 00000004:00080000:1.0:1789395165.453928:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3cac41880/2, rc 0, transno 4294969944 00000100:00100000:1.0:1789395165.453936:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cac41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.453973:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.453997:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.454025:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749760 00000100:00100000:1.0:1789395165.454031:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749760 00000100:00100000:1.0:1789395165.454051:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5326 00000100:00100000:1.0:1789395165.454057:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3638:x1876316239749760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789395165.454068:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2555 count 1 00002000:00010000:1.0:1789395165.454085:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.454090:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454100:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fb:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.454103:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.454108:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454130:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454138:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454146:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454154:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1789395165.454223:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3638:x1876316239749760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 166us (225us total) trans 4294969945 rc 0/0 00000100:00100000:1.0:1789395165.454229:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5326 00000004:00080000:1.0:1789395165.454250:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c8851c00/2, rc 0, transno 4294969945 00000100:00100000:1.0:1789395165.454256:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.454300:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395165.454306:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.454500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789395165.454533:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c77d5c00/2, rc 0, transno 4294969943 00000100:00100000:1.0:1789395165.454540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.454570:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749888 00000100:00100000:1.0:1789395165.454572:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749888 00000100:00100000:1.0:1789395165.454587:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5327 00000100:00100000:1.0:1789395165.454592:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3638:x1876316239749888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789395165.454603:0:14652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2556 count 1 00002000:00010000:1.0:1789395165.454620:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.454625:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454636:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fc:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.454640:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.454645:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454654:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454662:0:14652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454670:0:14652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.454679:0:14652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1789395165.454828:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3638:x1876316239749888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 234us (327us total) trans 4294969946 rc 0/0 00000100:00100000:1.0:1789395165.454835:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5327 00000004:00080000:1.0:1789395165.454860:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c8ba8700/2, rc 0, transno 4294969946 00000100:00100000:1.0:1789395165.454868:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239749888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.455806:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3638:x1876316239749248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2436us (2777us total) trans 4294969943 rc 0/0 00000100:00100000:2.0:1789395165.455821:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5324 00010000:00010000:2.0:1789395165.455863:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789395165.455872:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455883:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.455888:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455900:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455929:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455939:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d52d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455963:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.455967:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455973:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.455976:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455983:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455992:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.455999:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000913ca45a/0xff35729af316d534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456016:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.456020:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456026:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.456029:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456036:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456065:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456071:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d53b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456088:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.456092:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456098:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.456101:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456113:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456122:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456129:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2dea6eb/0xff35729af316d542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456142:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395165.456145:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456151:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.456154:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456161:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456171:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456178:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c35777/0xff35729af316d549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.456194:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.456196:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.456197:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.456206:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.456213:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.456220:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789395165.456267:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d9880/2, rc 0, transno 4294969935 00000100:00100000:2.0:1789395165.456274:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748224:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.456286:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009da300/2, rc 0, transno 4294969936 00000100:00100000:2.0:1789395165.456290:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748736:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.456300:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d9180/2, rc 0, transno 4294969933 00000100:00100000:2.0:1789395165.456307:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748352:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.456317:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d9f80/2, rc 0, transno 4294969934 00000100:00100000:2.0:1789395165.456320:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239748864:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.456335:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a41880/2, rc 0, transno 4294969936 00000100:00100000:2.0:1789395165.456364:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239747328:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.456377:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c9a41c00/2, rc 0, transno 4294969937 00000100:00100000:2.0:1789395165.456380:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239747840:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.456418:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20ce00/2, rc 0, transno 4294969935 00000100:00100000:2.0:1789395165.456423:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239747200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789395165.458658:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239749120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.458770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.458809:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.458871:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239749632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789395165.458893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.458936:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749120 00000100:00100000:3.0:1789395165.458949:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749120 00000100:00100000:2.0:1789395165.458959:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.458973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.459003:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750272 00000100:00100000:2.0:1789395165.459010:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395165.459013:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750272 00000100:00100000:3.0:1789395165.459015:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789395165.459057:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.459076:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789395165.459088:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789395165.459107:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3636:x1876316239748992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15176us (15567us total) trans 4294969941 rc 0/0 00000100:00100000:0.0:1789395165.459119:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5322 00000100:00100000:1.0:1789395165.460732:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239749632 00000100:00100000:0.0:1789395165.460770:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750784 00000100:00100000:0.0:1789395165.460785:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750784 00000100:00100000:3.0:1789395165.460817:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750656:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.460817:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239749632 00000100:00100000:3.0:1789395165.460907:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.460938:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750144 00000100:00100000:0.0:1789395165.460945:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750144 00000100:00100000:3.0:1789395165.460951:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239751168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.460956:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750656 00000100:00100000:1.0:1789395165.460963:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750656 00000100:00100000:0.0:1789395165.460982:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5328 00000100:00100000:3.0:1789395165.460989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.461002:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3638:x1876316239750272:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.461006:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751168 00000100:00100000:1.0:1789395165.461011:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751168 00000100:00100000:3.0:1789395165.461019:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789395165.461032:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.461037:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5329 00002000:00080000:0.0:1789395165.461040:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2550 count 1 00000100:00100000:1.0:1789395165.461051:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3638:x1876316239750784:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.461066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395165.461080:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750528:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.461082:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2554 count 1 00002000:00010000:1.0:1789395165.461121:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.461131:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.461150:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.461155:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.461163:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.461185:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.461195:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.461202:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.461304:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789395165.461341:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750016 00000100:00100000:2.0:1789395165.461350:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750016 00000100:00100000:2.0:1789395165.461381:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5330 00000100:00100000:2.0:1789395165.461412:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3637:x1876316239749632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789395165.461431:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2554 count 1 00002000:00010000:2.0:1789395165.461459:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395165.461467:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.461482:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fa:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.461487:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.461493:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395165.461722:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.461729:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.461740:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.461744:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.461748:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.461760:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.461771:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.461776:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.461779:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.461800:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.461808:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.461818:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789395165.461830:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1789395165.463854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.463867:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3638:x1876316239750272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2870us (4975us total) trans 4294969942 rc 0/0 00000100:00100000:0.0:1789395165.463881:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5328 00000100:00100000:0.0:1789395165.463913:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750400 00000100:00100000:0.0:1789395165.463921:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750400 00000100:00100000:0.0:1789395165.463952:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5331 00000100:00100000:0.0:1789395165.463960:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3637:x1876316239750144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.463987:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2558 count 1 00002000:00010000:0.0:1789395165.464020:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.464027:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464043:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fe:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.464048:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789395165.464080:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3638:x1876316239750784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3023us (5068us total) trans 4294969941 rc 0/0 00000100:00100000:1.0:1789395165.464093:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5329 00000100:00100000:1.0:1789395165.464132:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5332 00000100:00100000:1.0:1789395165.464145:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3637:x1876316239750656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.464176:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2553 count 1 00000100:00100000:2.0:1789395165.464274:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.464292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1789395165.464302:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.464312:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.464328:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.464333:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.464340:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464346:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.464348:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239751040:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789395165.464433:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.464446:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.464457:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464487:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.464490:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789395165.464506:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464514:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464526:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1789395165.464619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789395165.464674:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009db100/2, rc 0, transno 4294969942 00000100:00100000:0.0:1789395165.464678:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3637:x1876316239750144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 717us (5619us total) trans 4294969948 rc 0/0 00000100:00100000:0.0:1789395165.464688:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5331 00000100:00100000:0.0:1789395165.464721:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750528 00000100:00100000:0.0:1789395165.464725:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750528 00000100:00100000:0.0:1789395165.464744:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239750912 00000100:00100000:0.0:1789395165.464747:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239750912 00000100:00100000:0.0:1789395165.464759:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5333 00000100:00100000:0.0:1789395165.464765:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3637:x1876316239751168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789395165.464782:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2559 count 1 00002000:00010000:0.0:1789395165.464801:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.464807:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464817:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.464821:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.464825:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464835:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464843:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464851:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.464860:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1789395165.464929:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3637:x1876316239750656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 786us (4027us total) trans 4294969943 rc 0/0 00000100:00100000:1.0:1789395165.464941:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5332 00000100:00100000:0.0:1789395165.464958:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3637:x1876316239751168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 188us (3966us total) trans 4294969949 rc 0/0 00000100:00100000:0.0:1789395165.464969:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5333 00000100:00100000:1.0:1789395165.464986:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5334 00000100:00100000:2.0:1789395165.464992:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.465007:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3637:x1876316239750016:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.465022:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c988d180/2, rc 0, transno 4294969941 00002000:00080000:1.0:1789395165.465029:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2557 count 1 00002000:00010000:1.0:1789395165.465057:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.465064:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.465075:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fd:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.465079:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.465084:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.465101:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.465110:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.465118:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.465128:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1789395165.465185:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.465278:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239751296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.465304:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3637:x1876316239750016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 302us (4235us total) trans 4294969950 rc 0/0 00000100:00100000:2.0:1789395165.465317:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395165.465338:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395165.465345:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239751424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789395165.465366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.465412:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789395165.465421:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.465431:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.465436:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.465447:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.465471:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.465478:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3634c5f/0xff35729af316d550 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.465502:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:3.0:1789395165.465818:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395165.465883:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5335 00000100:00100000:0.0:1789395165.465897:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3638:x1876316239750400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.465917:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2551 count 1 00002000:00010000:0.0:1789395165.465940:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.465945:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.465955:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.465959:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395165.465963:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.466028:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5334 00010000:00010000:0.0:1789395165.466042:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.466054:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.466079:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751296 00000100:00100000:1.0:1789395165.466089:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751296 00000100:00100000:1.0:1789395165.466117:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751424 00000100:00100000:1.0:1789395165.466120:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751424 00000100:00100000:1.0:1789395165.466129:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751040 00000100:00100000:1.0:1789395165.466132:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751040 00000100:00100000:1.0:1789395165.466145:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5336 00000100:00100000:1.0:1789395165.466153:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3637:x1876316239750528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.466172:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2552 count 1 00002000:00010000:1.0:1789395165.466196:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.466202:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.466263:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.466274:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1789395165.466369:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.466380:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.466428:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.466476:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.466477:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.466632:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.466642:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.466658:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.466668:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.466676:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.466688:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1789395165.466726:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3638:x1876316239750400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 830us (2876us total) trans 4294969944 rc 0/0 00000100:00100000:0.0:1789395165.466736:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5335 00000100:00100000:0.0:1789395165.466907:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5337 00000100:00100000:0.0:1789395165.466920:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3638:x1876316239750912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789395165.466941:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2555 count 1 00002000:00010000:0.0:1789395165.466970:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1789395165.466991:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c79bf800/2, rc 0, transno 4294969949 00010000:00010000:2.0:1789395165.466993:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.467008:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239751168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789395165.467009:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3637:x1876316239750528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 851us (2717us total) trans 4294969945 rc 0/0 00010000:00010000:2.0:1789395165.467015:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316d55e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.467031:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5336 00000004:00080000:3.0:1789395165.467035:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c79bf100/2, rc 0, transno 4294969948 00000100:00100000:3.0:1789395165.467041:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750144:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789395165.467056:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395165.467066:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d8a80/2, rc 0, transno 4294969943 00000100:00100000:1.0:1789395165.467082:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5338 00000100:00100000:1.0:1789395165.467094:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3638:x1876316239751296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.467111:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2557 count 1 00002000:00010000:1.0:1789395165.467133:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.467138:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467153:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.467157:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.467161:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467172:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467195:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.467204:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=616s v=(0 0) 00010000:00010000:2.0:1789395165.467210:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789395165.467211:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395165.467217:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.467220:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467240:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.467246:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.467253:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467257:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.467269:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467277:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467280:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.467280:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467301:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da759c25/0xff35729af316d557 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467335:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1789395165.467337:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1789395165.467343:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789395165.467349:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467355:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.467359:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467366:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467378:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467425:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ff865a4/0xff35729af316d56c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467442:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789395165.467446:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467452:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.467456:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467463:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467473:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467480:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316d565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.467494:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789395165.467498:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395165.467560:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750656:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789395165.467592:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c904c380/2, rc 0, transno 4294969950 00000100:00100000:3.0:1789395165.467597:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750016:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789395165.467607:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009d8e00/2, rc 0, transno 4294969945 00000100:00100000:3.0:1789395165.467612:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239750528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.467639:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3638:x1876316239751296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 547us (2321us total) trans 4294969946 rc 0/0 00000100:00100000:1.0:1789395165.467649:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5338 00000100:00100000:3.0:1789395165.467672:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5339 00000100:00100000:3.0:1789395165.467682:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3638:x1876316239751424:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.467685:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5340 00000100:00100000:1.0:1789395165.467699:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3637:x1876316239751040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789395165.467718:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2558 count 1 00002000:00080000:1.0:1789395165.467724:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2556 count 1 00002000:00010000:3.0:1789395165.467746:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789395165.467754:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.467766:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1789395165.467770:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395165.467776:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.467793:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.467804:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.467812:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395165.467825:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1789395165.467878:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.467887:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395165.467900:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5341 00010000:00010000:1.0:1789395165.467917:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=616s v=(0 0) 00000100:00100000:0.0:1789395165.467924:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3637:x1876316239749120:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789395165.467927:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.467939:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789395165.467953:0:14650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2549 count 1 00010000:00010000:1.0:1789395165.467954:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467970:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467978:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.467988:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1789395165.468054:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395165.468070:0:14650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.468082:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1789395165.468087:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789395165.468091:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3637:x1876316239751040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 391us (2269us total) trans 4294969947 rc 0/0 00010000:00010000:0.0:1789395165.468096:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395165.468103:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5340 00010000:00010000:0.0:1789395165.468227:0:14650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.468243:0:14650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.468250:0:14650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395165.468259:0:14650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000004:00080000:1.0:1789395165.468289:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c988c700/2, rc 0, transno 4294969947 00000100:00100000:1.0:1789395165.468297:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239751040:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789395165.468316:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1789395165.468326:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468336:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57c00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395165.468343:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468354:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468373:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468412:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac88c42c/0xff35729af316d57a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468439:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789395165.468444:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468451:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ca00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395165.468454:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468461:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468471:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468479:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09bee13/0xff35729af316d581 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468535:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.468542:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468554:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468568:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468575:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ec093c3/0xff35729af316d573 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468616:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789395165.468621:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789395165.468622:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468630:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468637:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57e00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.468645:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468649:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395165.468658:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468667:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468687:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468774:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468784:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d12238b/0xff35729af316d588 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468802:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789395165.468806:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468812:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.468816:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468823:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468832:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468838:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316d58f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468849:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789395165.468853:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468858:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.468861:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468873:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468881:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468887:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc27afc2/0xff35729af316d59d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.468899:0:9511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789395165.468902:0:9511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468928:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468939:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004365ad9b/0xff35729af316d596 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468958:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395165.468962:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468970:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395165.468974:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.468989:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.469000:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.469008:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042414378/0xff35729af316d5ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.469022:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395165.469024:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395165.469027:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395165.469046:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3637:x1876316239749120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 574us (9723us total) trans 4294969948 rc 0/0 00010000:00010000:2.0:1789395165.469056:0:9511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56400 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395165.469063:0:9511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395165.469066:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009da680/2, rc 0, transno 4294969948 00000100:00100000:0.0:1789395165.469066:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5341 00000100:00100000:1.0:1789395165.469082:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239749120:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789395165.469084:0:9511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.469107:0:9511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.469114:0:9511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc54c2aa/0xff35729af316d5a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395165.469143:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.469146:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.469150:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789395165.469154:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c77d6300/2, rc 0, transno 4294969941 00000100:00100000:1.0:1789395165.469165:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239748992:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789395165.469179:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4fedf4700/2, rc 0, transno 4294969942 00000100:00100000:1.0:1789395165.469184:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239749504:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.469282:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20c380/2, rc 0, transno 4294969946 00000100:00100000:2.0:1789395165.469291:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239751296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.469316:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239751552:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.470505:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009db800/2, rc 0, transno 4294969944 00000100:00100000:2.0:1789395165.470516:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395165.470567:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789395165.470571:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395165.470582:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395165.470631:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751552 00000100:00100000:1.0:1789395165.470642:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751552 00000100:00100000:2.0:1789395165.470664:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3637:x1876316239749632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9251us (11690us total) trans 4294969947 rc 0/0 00000100:00100000:2.0:1789395165.470674:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5330 00000100:00100000:1.0:1789395165.471105:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5342 00000100:00100000:1.0:1789395165.471121:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3636:x1876316239751552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395165.471161:0:14638:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2559 count 1 00002000:00010000:1.0:1789395165.471200:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395165.471281:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.471301:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1789395165.471306:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395165.471315:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.471330:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.471341:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.471350:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.471372:0:14638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789395165.471703:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3638:x1876316239751424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4020us (6333us total) trans 4294969950 rc 0/0 00000100:00100000:0.0:1789395165.473269:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3638:x1876316239750912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6343us (8640us total) trans 4294969949 rc 0/0 00000100:00100000:1.0:1789395165.473353:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3636:x1876316239751552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2232us (2785us total) trans 4294969951 rc 0/0 00000004:00080000:2.0:1789395165.473604:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4c2a40e00/2, rc 0, transno 4294969947 00000100:00100000:2.0:1789395165.473613:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239749632:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789395165.473647:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20f480/2, rc 0, transno 4294969950 00000100:00100000:2.0:1789395165.473651:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239751424:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789395165.473662:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3c988c380/2, rc 0, transno 4294969949 00000100:00100000:2.0:1789395165.473665:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239750912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789395165.477753:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5339 00000100:00100000:0.0:1789395165.478055:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5337 00000100:00100000:1.0:1789395165.480093:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5342 00010000:00010000:1.0:1789395165.480170:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395165.480181:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.480203:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56a00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395165.480215:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.480230:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.480331:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.480342:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316d5b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395165.480374:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395165.480376:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395165.480378:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789395165.480863:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a3ca20dc00/2, rc 0, transno 4294969951 00000100:00100000:1.0:1789395165.480874:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239751552:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789395165.761771:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969950 is committed 00000001:00080000:3.0:1789395165.767662:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969951 is committed 00010000:00010000:2.0:1789395165.938372:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789395166.311432:0:22020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395166.311446:0:22020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1789395166.312315:0:22020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1789395166.312330:0:22020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1789395166.962483:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789395167.715606:0:22068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789395167.715615:0:22068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1789395167.715643:0:22068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:1.0:1789395167.715650:0:22068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1789395167.794610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395167.794668:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395167.794668:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854208 00000100:00100000:2.0:1789395167.794684:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854208 00000100:00100000:3.0:1789395167.794718:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395167.794755:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395167.794772:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 449 00000100:00100000:3.0:1789395167.794785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395167.794791:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231854208:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395167.794815:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854464 00000100:00100000:3.0:1789395167.794820:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854464 00000100:00100000:3.0:1789395167.794863:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854336 00000100:00100000:3.0:1789395167.794865:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854336 00000100:00100000:3.0:1789395167.794887:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 643 00000100:00100000:3.0:1789395167.794895:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231854464:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395167.794903:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3d63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231854208:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 117us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395167.794913:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 449 00000100:00100000:3.0:1789395167.794938:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231854464:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 42us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395167.794947:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 643 00000100:00100000:3.0:1789395167.794964:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 644 00000100:00100000:3.0:1789395167.794970:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2397:x1876316231854336:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395167.794994:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2397:x1876316231854336:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395167.794999:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854720 00000100:00100000:1.0:1789395167.795005:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854720 00000100:00100000:3.0:1789395167.795014:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 644 00000100:00080000:3.0:1789395167.795034:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395167.795039:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395167.795041:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395167.795057:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854592 00000100:00100000:1.0:1789395167.795061:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854592 00000100:00100000:1.0:1789395167.795094:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 433 00000100:00100000:1.0:1789395167.795103:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231854720:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395167.795139:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231854720:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395167.795145:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 433 00000100:00100000:1.0:1789395167.795159:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 434 00000100:00100000:1.0:1789395167.795165:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2397:x1876316231854592:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395167.795191:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2397:x1876316231854592:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395167.795197:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 434 00000100:00080000:3.0:1789395167.795753:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395167.814089:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395167.815044:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231854848 00000100:00100000:0.0:1789395167.815059:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231854848 00000100:00100000:0.0:1789395167.815132:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23802 00000100:00100000:0.0:1789395167.815145:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:19449:x1876316231854848:12345-192.168.203.54@tcp:46:lfs.0 00000004:00000080:0.0:1789395167.815548:0:21735:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff89a4d0065d08 uarg=0000000000000000 00000004:00000080:0.0:1789395167.815612:0:21735:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff89a4d0065d08 00000004:00000080:0.0:1789395167.815621:0:21735:0:(mdd_device.c:2174:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:0.0:1789395167.815680:0:21735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789395167.815685:0:21735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1789395167.815722:0:21735:0:(mdd_device.c:2146:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:0.0:1789395167.815805:0:21735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:0.0:1789395167.815813:0:21735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1789395167.815819:0:21735:0:(mdd_device.c:2223:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1789395167.815836:0:21735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789395167.815839:0:21735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1789395167.826746:0:21735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 400 count 1 00000040:00080000:0.0:1789395167.826768:0:21735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1789395167.826945:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:19449:x1876316231854848:12345-192.168.203.54@tcp:46:lfs.0 Request processed in 11793us (12861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395167.826959:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23802 00010000:00010000:1.0:1789395167.990818:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789395168.783296:0:22116:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffdf0f2b130 00000004:00000080:2.0:1789395168.783320:0:22116:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff89a3c7b55400 uarg=0000000000000000 00000004:00000080:2.0:1789395168.783676:0:22116:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff89a3c7b55400 00000004:00000080:2.0:1789395168.783696:0:22116:0:(mdd_device.c:2174:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:2.0:1789395168.783801:0:22116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395168.783807:0:22116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1789395168.783834:0:22116:0:(mdd_device.c:2146:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:2.0:1789395168.783895:0:22116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:2.0:1789395168.783902:0:22116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1789395168.783946:0:22116:0:(mdd_device.c:2223:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:2.0:1789395168.783978:0:22116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395168.783980:0:22116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1789395168.784967:0:22116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:2.0:1789395168.784982:0:22116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:2.0:1789395168.785148:0:22116:0:(mdd_device.c:2027:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:2.0:1789395168.785200:0:22116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395168.785204:0:22116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1789395168.785359:0:22116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1789395168.785365:0:22116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1789395168.785522:0:22116:0:(mdd_device.c:2049:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1789395168.785525:0:22116:0:(mdd_device.c:493:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1789395168.788570:0:22116:0:(mdd_device.c:2059:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:2.0:1789395168.788705:0:22116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395168.788710:0:22116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1789395168.790119:0:22116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:2.0:1789395168.790135:0:22116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1789395168.790332:0:22116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395168.790336:0:22116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1789395168.790938:0:22116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1789395168.790946:0:22116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1789395168.948460:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239751680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395168.948563:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395168.948617:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751680 00000100:00100000:0.0:1789395168.948627:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751680 00000100:00100000:0.0:1789395168.948698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3540 00000100:00100000:0.0:1789395168.948709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239751680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395168.948756:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395168.948821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239751680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395168.948829:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3540 00000100:00100000:3.0:1789395168.948911:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239751680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789395169.012537:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789395169.728299:0:22164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789395169.728314:0:22164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1789395169.729199:0:22164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1789395169.729214:0:22164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1789395169.970140:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239752064:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.970235:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395169.970300:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239752576:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.970704:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395169.970738:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239753088:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.970837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395169.970877:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789395169.970885:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239752192:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.970910:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395169.970929:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239752704:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.971196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395169.971221:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239753216:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.971244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395169.971292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752064 00000100:00100000:1.0:1789395169.971301:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752064 00000100:00100000:1.0:1789395169.971362:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541 00000100:00100000:1.0:1789395169.971374:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239752064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.971467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239752064:12345-0@lo:400:kworker.0 Request processed in 94us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395169.971476:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541 00000100:00100000:1.0:1789395169.971505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752576 00000100:00100000:1.0:1789395169.971509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752576 00000100:00100000:1.0:1789395169.971551:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753088 00000100:00100000:1.0:1789395169.971555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753088 00000100:00100000:1.0:1789395169.971573:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752192 00000100:00100000:1.0:1789395169.971576:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752192 00000100:00100000:1.0:1789395169.971595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1789395169.971602:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239752576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.971634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239752576:12345-0@lo:400:kworker.0 Request processed in 32us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395169.971641:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1789395169.971652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1789395169.971658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239753088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.971702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239753088:12345-0@lo:400:kworker.0 Request processed in 44us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395169.971709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1789395169.971721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1789395169.971727:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239752192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.971893:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752704 00000100:00100000:3.0:1789395169.971899:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752704 00000100:00100000:3.0:1789395169.971930:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753216 00000100:00100000:3.0:1789395169.971933:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753216 00000100:00100000:3.0:1789395169.971968:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789395169.971976:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239752704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.972015:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239752704:12345-0@lo:400:kworker.0 Request processed in 40us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.972021:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789395169.972035:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789395169.972040:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239753216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.972068:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239753216:12345-0@lo:400:kworker.0 Request processed in 28us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.972074:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:0.0:1789395169.972593:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395169.972599:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789395169.972601:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395169.972641:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239752192:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972654:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239752704:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972663:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239753216:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972683:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239752064:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972694:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239752576:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972703:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239753088:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972791:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239751808:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395169.972879:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239752320:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.972905:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395169.972925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239752832:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.973252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395169.973274:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239753344:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.973296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395169.973320:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789395169.973326:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239751936:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.973352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395169.973369:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239752448:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.973417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395169.973434:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239752960:0@lo:400:kworker.0 00000100:00100000:0.0:1789395169.973455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395169.973630:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751808 00000100:00100000:3.0:1789395169.973638:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751808 00000100:00100000:3.0:1789395169.973695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789395169.973704:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3d61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239751808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.973764:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3d61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239751808:12345-0@lo:400:kworker.0 Request processed in 49us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.973772:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789395169.973812:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752320 00000100:00100000:3.0:1789395169.973816:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752320 00000100:00100000:3.0:1789395169.973844:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3542 00000100:00100000:3.0:1789395169.973851:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239752320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.973884:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239752320:12345-0@lo:400:kworker.0 Request processed in 34us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.973890:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3542 00000100:00100000:3.0:1789395169.973922:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239751808:0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.973945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239752320:0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.973980:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239751936 00000100:00100000:3.0:1789395169.973983:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239751936 00000100:00100000:3.0:1789395169.974008:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752448 00000100:00100000:3.0:1789395169.974010:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752448 00000100:00100000:3.0:1789395169.974030:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752960 00000100:00100000:3.0:1789395169.974032:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752960 00000100:00100000:3.0:1789395169.974045:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1789395169.974050:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.974083:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239751936:12345-0@lo:400:kworker.0 Request processed in 33us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.974089:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1789395169.974099:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1789395169.974104:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239752448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.974123:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239752448:12345-0@lo:400:kworker.0 Request processed in 19us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.974128:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1789395169.974148:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1789395169.974153:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239752960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.974174:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239752960:12345-0@lo:400:kworker.0 Request processed in 22us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395169.974179:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00080000:3.0:1789395169.974195:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395169.974215:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239751936:0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.974224:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239752448:0@lo:400:kworker.0 00000100:00100000:3.0:1789395169.974232:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239752960:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.974466:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239752192:12345-0@lo:400:kworker.0 Request processed in 27us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395169.974474:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1789395169.974502:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239752832 00000100:00100000:1.0:1789395169.974506:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239752832 00000100:00100000:1.0:1789395169.974533:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753344 00000100:00100000:1.0:1789395169.974535:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753344 00000100:00100000:1.0:1789395169.974552:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1789395169.974557:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.974594:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239752832:12345-0@lo:400:kworker.0 Request processed in 37us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395169.974600:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1789395169.974609:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789395169.974614:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239753344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.974636:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239753344:12345-0@lo:400:kworker.0 Request processed in 23us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395169.974642:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789395169.974667:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969951 gen 2 00000004:00080000:1.0:1789395169.974684:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a41c00, transno 4294969903 00000004:00080000:1.0:1789395169.974701:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a41880, transno 4294969904 00000004:00080000:1.0:1789395169.974703:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a43800, transno 4294969905 00000004:00080000:1.0:1789395169.974706:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a34000, transno 4294969906 00000004:00080000:1.0:1789395169.974709:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a43b80, transno 4294969907 00000004:00080000:1.0:1789395169.974712:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a36300, transno 4294969908 00000004:00080000:1.0:1789395169.974714:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a43480, transno 4294969909 00000004:00080000:1.0:1789395169.974716:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4ffb6ea00, transno 4294969910 00000004:00080000:1.0:1789395169.974719:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4f6404e00, transno 4294969911 00000004:00080000:1.0:1789395169.974723:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4f6407800, transno 4294969912 00000004:00080000:1.0:1789395169.974727:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4ff86ca80, transno 4294969913 00000004:00080000:1.0:1789395169.974729:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4ff86fb80, transno 4294969914 00000004:00080000:1.0:1789395169.974732:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4ff86ed80, transno 4294969915 00000004:00080000:1.0:1789395169.974735:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a6fb80, transno 4294969916 00000004:00080000:1.0:1789395169.974737:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4ff86e300, transno 4294969917 00000004:00080000:1.0:1789395169.974740:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c825a680, transno 4294969918 00000004:00080000:1.0:1789395169.974743:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9126d80, transno 4294969919 00000004:00080000:1.0:1789395169.974745:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c8259180, transno 4294969920 00000004:00080000:1.0:1789395169.974748:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c825ad80, transno 4294969921 00000100:00080000:3.0:1789395169.975128:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395169.975132:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789395169.975229:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c8259c00, transno 4294969922 00000004:00080000:1.0:1789395169.975234:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c8258380, transno 4294969923 00000004:00080000:1.0:1789395169.975237:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c825b480, transno 4294969924 00000004:00080000:1.0:1789395169.975239:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c8259880, transno 4294969925 00000004:00080000:1.0:1789395169.975242:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a6d880, transno 4294969926 00000004:00080000:1.0:1789395169.975245:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009db480, transno 4294969927 00000004:00080000:1.0:1789395169.975247:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d9c00, transno 4294969928 00000004:00080000:1.0:1789395169.975250:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009daa00, transno 4294969929 00000004:00080000:1.0:1789395169.975253:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d8000, transno 4294969930 00000004:00080000:1.0:1789395169.975256:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c98f3480, transno 4294969931 00000004:00080000:1.0:1789395169.975258:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d8700, transno 4294969932 00000004:00080000:1.0:1789395169.975261:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d9180, transno 4294969933 00000004:00080000:1.0:1789395169.975263:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d9f80, transno 4294969934 00000004:00080000:1.0:1789395169.975266:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d9880, transno 4294969935 00000004:00080000:1.0:1789395169.975268:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009da300, transno 4294969936 00000004:00080000:1.0:1789395169.975270:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009dbb80, transno 4294969937 00000004:00080000:1.0:1789395169.975272:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d9500, transno 4294969938 00000004:00080000:1.0:1789395169.975275:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d8380, transno 4294969939 00000004:00080000:1.0:1789395169.975278:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009dad80, transno 4294969940 00000004:00080000:1.0:1789395169.975281:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c988d180, transno 4294969941 00000004:00080000:1.0:1789395169.975284:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009db100, transno 4294969942 00000004:00080000:1.0:1789395169.975287:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d8a80, transno 4294969943 00000004:00080000:1.0:1789395169.975289:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009db800, transno 4294969944 00000004:00080000:1.0:1789395169.975291:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009d8e00, transno 4294969945 00000004:00080000:1.0:1789395169.975294:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20c380, transno 4294969946 00000004:00080000:1.0:1789395169.975297:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c988c700, transno 4294969947 00000004:00080000:1.0:1789395169.975299:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009da680, transno 4294969948 00000004:00080000:1.0:1789395169.975302:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c988c380, transno 4294969949 00000004:00080000:1.0:1789395169.975304:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20f480, transno 4294969950 00000004:00080000:1.0:1789395169.975307:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20dc00, transno 4294969951 00000100:00100000:1.0:1789395169.975314:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239752832:0@lo:400:kworker.0 00000100:00100000:1.0:1789395169.975331:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969950 gen 2 00000004:00080000:1.0:1789395169.975334:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c98f0a80, transno 4294969902 00000004:00080000:1.0:1789395169.975351:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c98f1180, transno 4294969903 00000004:00080000:1.0:1789395169.975353:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a6f480, transno 4294969904 00000004:00080000:1.0:1789395169.975356:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a49880, transno 4294969905 00000004:00080000:1.0:1789395169.975358:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c98f3100, transno 4294969906 00000004:00080000:1.0:1789395169.975361:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3cac40380, transno 4294969907 00000004:00080000:1.0:1789395169.975364:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c98f2300, transno 4294969908 00000004:00080000:1.0:1789395169.975366:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c98f3b80, transno 4294969909 00000004:00080000:1.0:1789395169.975369:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a6ed80, transno 4294969910 00000004:00080000:1.0:1789395169.975372:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c5cc4700, transno 4294969911 00000004:00080000:1.0:1789395169.975374:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c5cc4380, transno 4294969912 00000004:00080000:1.0:1789395169.975376:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9125180, transno 4294969913 00000004:00080000:1.0:1789395169.975379:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9125500, transno 4294969914 00000004:00080000:1.0:1789395169.975409:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d8356a00, transno 4294969915 00000004:00080000:1.0:1789395169.975412:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d8355180, transno 4294969916 00000004:00080000:1.0:1789395169.975415:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9124380, transno 4294969917 00000004:00080000:1.0:1789395169.975417:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d8357480, transno 4294969918 00000004:00080000:1.0:1789395169.975421:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9127100, transno 4294969919 00000004:00080000:1.0:1789395169.975424:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d8354700, transno 4294969920 00000004:00080000:1.0:1789395169.975427:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d8355880, transno 4294969921 00000004:00080000:1.0:1789395169.975430:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d99d6a00, transno 4294969922 00000004:00080000:1.0:1789395169.975432:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d99d5880, transno 4294969923 00000004:00080000:1.0:1789395169.975435:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4e7f63800, transno 4294969924 00000004:00080000:1.0:1789395169.975438:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4e7f61180, transno 4294969925 00000004:00080000:1.0:1789395169.975441:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c93e6300, transno 4294969926 00000004:00080000:1.0:1789395169.975443:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20f100, transno 4294969927 00000004:00080000:1.0:1789395169.975445:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d99d4700, transno 4294969928 00000004:00080000:1.0:1789395169.975447:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4e7f60e00, transno 4294969929 00000004:00080000:1.0:1789395169.975450:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20d180, transno 4294969930 00000004:00080000:1.0:1789395169.975452:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4e7f62d80, transno 4294969931 00000004:00080000:1.0:1789395169.975454:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4d99d7800, transno 4294969932 00000004:00080000:1.0:1789395169.975456:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4e7f63480, transno 4294969933 00000004:00080000:1.0:1789395169.975459:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20f800, transno 4294969934 00000004:00080000:1.0:1789395169.975461:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3ca20ce00, transno 4294969935 00000004:00080000:1.0:1789395169.975463:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a41880, transno 4294969936 00000004:00080000:1.0:1789395169.975465:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a41c00, transno 4294969937 00000004:00080000:1.0:1789395169.975468:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a41180, transno 4294969938 00000004:00080000:1.0:1789395169.975470:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a42d80, transno 4294969939 00000004:00080000:1.0:1789395169.975473:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c9a43100, transno 4294969940 00000004:00080000:1.0:1789395169.975476:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c77d6300, transno 4294969941 00000004:00080000:1.0:1789395169.975478:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4fedf4700, transno 4294969942 00000004:00080000:1.0:1789395169.975480:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c77d5c00, transno 4294969943 00000004:00080000:1.0:1789395169.975483:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3cac41880, transno 4294969944 00000004:00080000:1.0:1789395169.975486:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c8851c00, transno 4294969945 00000004:00080000:1.0:1789395169.975488:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c8ba8700, transno 4294969946 00000004:00080000:1.0:1789395169.975491:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4c2a40e00, transno 4294969947 00000004:00080000:1.0:1789395169.975493:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c79bf100, transno 4294969948 00000004:00080000:1.0:1789395169.975497:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c79bf800, transno 4294969949 00000004:00080000:1.0:1789395169.975499:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a3c904c380, transno 4294969950 00000100:00100000:1.0:1789395169.975503:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239753344:0@lo:400:kworker.0 00000004:00080000:0.0:1789395169.976452:0:8903:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 49 done 00000004:00080000:3.0:1789395169.978303:0:10001:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 49 done 00010000:00010000:2.0:1789395170.033583:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395170.481764:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239753472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395170.481883:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395170.482300:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239753728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395170.482322:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239753600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395170.482337:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395170.482381:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239753856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395170.482423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395170.482616:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239753984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395170.482642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395170.482767:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395170.482849:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753472 00000100:00100000:2.0:1789395170.482858:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753472 00000100:00100000:2.0:1789395170.482905:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753728 00000100:00100000:2.0:1789395170.482908:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753728 00000100:00100000:2.0:1789395170.482918:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753856 00000100:00100000:2.0:1789395170.482920:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753856 00000100:00100000:2.0:1789395170.482928:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753984 00000100:00100000:2.0:1789395170.482930:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753984 00000100:00100000:2.0:1789395170.482944:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789395170.482953:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239753472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395170.482992:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59098816 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789395170.483065:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239753472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395170.483073:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789395170.483092:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789395170.483098:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239753728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395170.483124:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395170.483163:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239753728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395170.483169:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789395170.483181:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789395170.483187:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239753856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395170.483196:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395170.483221:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239753856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395170.483227:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789395170.483238:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789395170.483244:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239753984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789395170.483253:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59098816 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789395170.483275:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239753984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395170.483281:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789395170.483328:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239753856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395170.483328:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239753728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395170.483377:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239753984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395170.483416:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239753472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395170.492101:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239753600 00000100:00100000:1.0:1789395170.492124:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239753600 00000100:00100000:1.0:1789395170.492211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543 00000100:00100000:1.0:1789395170.492224:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239753600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789395170.492277:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1789395170.492422:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239753600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (9653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395170.492430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543 00000100:00100000:2.0:1789395170.493923:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239753600:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789395171.069686:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789395171.733690:0:22212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 10:12:50 (1789395170) 00000100:00100000:3.0:1789395171.797592:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395171.798022:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231855104 00000100:00100000:1.0:1789395171.798036:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231855104 00000100:00100000:1.0:1789395171.798135:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23803 00000100:00100000:1.0:1789395171.798149:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:19619:x1876316231855104:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395171.798177:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395171.798182:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789395171.798215:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca2aac00/0xff35729af316ba3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021061fc expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798236:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395171.798244:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395171.798263:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d5b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064c6 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798436:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798453:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798464:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798482:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798490:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.798497:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789395171.798995:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789395171.799203:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa00:0x0], index 1: 0 00010000:00010000:1.0:1789395171.801021:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d5ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801049:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801062:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801122:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801132:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801139:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801147:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801155:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395171.801160:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801170:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801185:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395171.801188:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395171.801194:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801202:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395171.801219:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3bae678 reply state 00000000814e28d3 transno 4294984073 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801232:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801239:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa58cf3a (ffff89a4e7d26200) 00010000:00010000:1.0:1789395171.801242:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395171.801245:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395171.801289:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d5b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064c6 expref: 13 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801306:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57a00/0xff35729af316d5ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064c6 expref: 12 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.801315:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff89a4e7d26d00) 00010000:00010000:1.0:1789395171.801318:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395171.801320:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57a00, rc 0) 00000100:00100000:1.0:1789395171.801441:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:19619:x1876316231855104:12345-192.168.203.54@tcp:101:dd.0 Request processed in 3295us (3863us total) trans 4294984073 rc 0/0 00000100:00100000:1.0:1789395171.801451:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23803 00000100:00100000:1.0:1789395171.808115:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395171.808209:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231855232 00000100:00100000:2.0:1789395171.808222:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231855232 00000100:00100000:2.0:1789395171.808313:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5343 00000100:00100000:2.0:1789395171.808327:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:19619:x1876316231855232:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395171.808350:0:14639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395171.808376:0:14639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d5dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064cd expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395171.808434:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395171.808462:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1789395171.808468:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395171.808480:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064cd expref: 7 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395171.808499:0:14639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064cd expref: 7 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395171.808515:0:14639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395171.808584:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:19619:x1876316231855232:12345-192.168.203.54@tcp:101:dd.0 Request processed in 261us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395171.808592:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5343 00000100:00080000:3.0:1789395171.808799:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789395171.814464:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395171.814559:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231855488 00000100:00100000:1.0:1789395171.814572:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231855488 00000100:00100000:1.0:1789395171.814644:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5198 00000100:00100000:1.0:1789395171.814666:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:19619:x1876316231855488:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395171.815072:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:19619:x1876316231855488:12345-192.168.203.54@tcp:35:dd.0 Request processed in 416us (617us total) trans 4294984074 rc 0/0 00000100:00100000:1.0:1789395171.815080:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5198 00000100:00100000:2.0:1789395171.843940:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395171.844117:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231855616 00000100:00100000:0.0:1789395171.844131:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231855616 00000100:00100000:0.0:1789395171.844237:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1394 00000100:00100000:0.0:1789395171.844248:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:6165:x1876316231855616:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395171.844271:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1789395171.844296:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c7:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1789395171.844300:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c7:0x0] updating lvb mtime from disk: 0 -> 1789395024 00002000:00010000:0.0:1789395171.844302:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x9c7:0x0] updating lvb atime from disk: 0 -> 1789395024 00002000:00010000:0.0:1789395171.844304:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c7:0x0] updating lvb ctime from disk: 0 -> 1789395024 00002000:00010000:0.0:1789395171.844306:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789395171.844336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028a08ec3/0xff35729af3156c1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402102197 expref: 7 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395171.844372:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 35424 00002000:00010000:0.0:1789395171.844375:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789394830 00002000:00010000:0.0:1789395171.844377:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789394830 00002000:00010000:0.0:1789395171.844379:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:0.0:1789395171.844415:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b578ea/0xff35729af30df0ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.203.54@tcp remote: 0x5fa44584020e870d expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395171.844431:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395171.844500:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:6165:x1876316231855616:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 253us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395171.844509:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1394 00000100:00080000:3.0:1789395171.844779:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395171.845818:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395171.847312:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231855744 00000100:00100000:2.0:1789395171.847330:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231855744 00002000:00100000:2.0:1789395171.847422:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4095) req@ffff89a501d07100 x1876316231855744/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:637/0 lens 4584/0 e 0 to 0 dl 1789395182 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395171.847438:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501d07100 with x1876316231855744 ext(0->4095) 00002000:00010000:2.0:1789395171.847446:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501d07100 00000100:00100000:2.0:1789395171.847485:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 16 00000100:00100000:2.0:1789395171.847497:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2396:x1876316231855744:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395171.848788:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231855744:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1284us (2968us total) trans 4294969951 rc 0/0 00000100:00100000:2.0:1789395171.848802:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 16 00002000:00100000:2.0:1789395171.848814:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4095) req@ffff89a501d07100 x1876316231855744/t4294969951(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:637/0 lens 4584/448 e 0 to 0 dl 1789395182 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395171.848834:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501d07100 with x1876316231855744 ext(0->4095) 00002000:00010000:2.0:1789395171.848841:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501d07100 00000100:00100000:0.0:1789395171.853357:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395171.853469:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231855872 00000100:00100000:2.0:1789395171.853482:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231855872 00000100:00100000:2.0:1789395171.853563:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1395 00000100:00100000:2.0:1789395171.853575:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:6164:x1876316231855872:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395171.853595:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:2.0:1789395171.853621:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1789395171.853625:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1789395172 00002000:00010000:2.0:1789395171.853628:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1789395172 00002000:00010000:2.0:1789395171.853630:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789395171.853674:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f370e991/0xff35729af316d5dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064cd expref: 9 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395171.853723:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060079def/0xff35729af3156b41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210215f expref: 8 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395171.853741:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395171.853814:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:6164:x1876316231855872:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 241us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395171.853838:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1395 00000001:00080000:2.0:1789395171.856290:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969951 is committed 00000100:00100000:3.0:1789395171.984912:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395171.985067:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856000 00000100:00100000:1.0:1789395171.985081:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856000 00000100:00100000:1.0:1789395171.985188:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23804 00000100:00100000:1.0:1789395171.985200:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:19626:x1876316231856000:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:1.0:1789395171.985232:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395171.985261:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064d4 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.985348:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d5ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.985378:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d5ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.985455:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d5ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395171.985509:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:1.0:1789395171.985513:0:21735:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395171.985562:0:21735:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d5ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.985590:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d5e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064d4 expref: 16 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.985610:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d5ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064d4 expref: 15 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395171.985631:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395171.985635:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395171.985639:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56e00, rc 0) 00000100:00100000:1.0:1789395171.985719:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:19626:x1876316231856000:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 520us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395171.985727:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23804 00000100:00100000:3.0:1789395172.000157:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395172.000353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856256 00000100:00100000:0.0:1789395172.000368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856256 00000100:00100000:0.0:1789395172.000739:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23805 00000100:00100000:0.0:1789395172.000751:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:19626:x1876316231856256:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:0.0:1789395172.000781:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395172.000786:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789395172.000822:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d5ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064d4 expref: 15 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.000854:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395172.000861:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395172.000879:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d5f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.001031:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316d5f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.001047:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316d5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.001059:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316d5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395172.001072:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x158f:0x0]: returning size 4096 00010000:00010000:0.0:1789395172.001213:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d5f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064db expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.001230:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316d5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064db expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.001239:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff89a4e7d26d00) 00010000:00010000:0.0:1789395172.001242:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395172.001245:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d800, rc 0) 00000100:00100000:0.0:1789395172.001324:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:19626:x1876316231856256:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 575us (1182us total) trans 4294984075 rc 0/0 00000100:00100000:0.0:1789395172.001335:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23805 00000100:00100000:3.0:1789395172.007103:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395172.008188:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856384 00000100:00100000:0.0:1789395172.008206:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856384 00000100:00100000:0.0:1789395172.008506:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1396 00000100:00100000:0.0:1789395172.008520:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231856384:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395172.008542:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395172.008575:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d800/0xff35729af316d5f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064db expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.008600:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff89a4e7d26d00) 00010000:00010000:0.0:1789395172.008607:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395172.008639:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395172.008685:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231856384:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 168us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395172.008694:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1396 00000100:00100000:3.0:1789395172.009326:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856512 00000100:00100000:3.0:1789395172.009335:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856512 00000100:00100000:3.0:1789395172.009406:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5344 00000100:00100000:3.0:1789395172.009415:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2396:x1876316231856512:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:3.0:1789395172.009433:0:14650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395172.009456:0:14650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064e2 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789395172.009485:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa00:0x0] initial LVB size: 4096, mtime: 0x6aa800e4, atime: 0x0, ctime: 0x6aa800e4, blocks: 0x8 00010000:00010000:3.0:1789395172.009504:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=623s v=(0 0) 00010000:00010000:3.0:1789395172.009510:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789395172.009521:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 6 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395172.010432:0:14650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 6 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395172.010454:0:14650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b200, rc 0) 00000100:00100000:3.0:1789395172.010529:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231856512:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 1113us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395172.011843:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5344 00000100:00100000:1.0:1789395172.020284:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395172.020376:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856640 00000100:00100000:0.0:1789395172.020494:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856640 00000100:00100000:0.0:1789395172.020631:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5345 00000100:00100000:0.0:1789395172.020643:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:19626:x1876316231856640:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:0.0:1789395172.020746:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395172.020773:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042414378/0xff35729af316d60d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064e9 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.020813:0:14478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 7 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.020830:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395172.020835:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395172.020841:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042414378/0xff35729af316d60d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e9 expref: 7 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.020885:0:14478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 7 pid: 14650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395172.020901:0:14478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 7 pid: 14650 timeout: 723 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395172.020918:0:14478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14478:1876316239754112:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395172.021115:0:14478:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c741fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789395172.026945:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395172.027005:0:14478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14478:1876316239754112:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395172.027027:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856768 00000100:00100000:1.0:1789395172.027039:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856768 00010000:00010000:2.0:1789395172.027063:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042414378/0xff35729af316d60d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e9 expref: 8 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395172.027088:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 8 pid: 14650 timeout: 723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395172.027099:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d800, rc 0) 00000100:00100000:1.0:1789395172.027135:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1600 00000100:00100000:1.0:1789395172.027147:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231856768:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395172.027165:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395172.027197:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 8 pid: 14650 timeout: 723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395172.027212:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 8 pid: 14650 timeout: 723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395172.027239:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e073222/0xff35729af316d606 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e2 expref: 8 pid: 14650 timeout: 723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395172.027255:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395172.027260:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395172.027269:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042414378/0xff35729af316d60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e9 expref: 7 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395172.027282:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042414378/0xff35729af316d60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e9 expref: 7 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395172.027323:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000042414378/0xff35729af316d60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064e9 expref: 7 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395172.027340:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1876316239754240:192.168.203.54@tcp:105: 00000100:00100000:2.0:1789395172.028701:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:19626:x1876316231856640:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 8047us (8415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395172.028718:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5345 00000100:00100000:1.0:1789395172.031441:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80ea900 going to sleep for 11 seconds 00000100:00100000:1.0:1789395172.045418:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1876316239754240:192.168.203.54@tcp:105: 00010000:00010000:1.0:1789395172.045453:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395172.045527:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231856768:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 18381us (18595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395172.045541:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1600 00000100:00100000:3.0:1789395172.048465:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395172.048592:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231856896 00000100:00100000:0.0:1789395172.048607:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231856896 00002000:00100000:0.0:1789395172.050157:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4095) req@ffff89a4fedf4700 x1876316231856896/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:638/0 lens 488/0 e 0 to 0 dl 1789395183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395172.050177:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf4700 with x1876316231856896 ext(0->4095) 00002000:00010000:0.0:1789395172.050186:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf4700 00000100:00100000:0.0:1789395172.050329:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 17 00000100:00100000:0.0:1789395172.050353:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231856896:12345-192.168.203.54@tcp:3:dd.0 00000100:00100000:0.0:1789395172.051845:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231856896:12345-192.168.203.54@tcp:3:dd.0 Request processed in 1492us (3383us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789395172.051859:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 17 00002000:00100000:0.0:1789395172.051871:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4095) req@ffff89a4fedf4700 x1876316231856896/t0(0) o3->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:638/0 lens 488/4536 e 0 to 0 dl 1789395183 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395172.051887:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf4700 with x1876316231856896 ext(0->4095) 00002000:00010000:0.0:1789395172.051895:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf4700 00000100:00100000:3.0:1789395172.059913:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395172.060040:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857152 00000100:00100000:2.0:1789395172.060053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857152 00000100:00100000:2.0:1789395172.060127:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5199 00000100:00100000:2.0:1789395172.060142:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:19626:x1876316231857152:12345-192.168.203.54@tcp:35:multiop.0 00000100:00100000:2.0:1789395172.060568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:19626:x1876316231857152:12345-192.168.203.54@tcp:35:multiop.0 Request processed in 427us (668us total) trans 4294984076 rc 0/0 00000100:00100000:2.0:1789395172.060576:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5199 00010000:00010000:1.0:1789395172.081823:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395172.084492:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395172.086481:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857280 00000100:00100000:1.0:1789395172.086501:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857280 00002000:00100000:1.0:1789395172.086576:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4095) req@ffff89a3cac41880 x1876316231857280/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:638/0 lens 4584/0 e 0 to 0 dl 1789395183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395172.086590:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac41880 with x1876316231857280 ext(0->4095) 00002000:00010000:1.0:1789395172.086597:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cac41880 00000100:00100000:1.0:1789395172.086638:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 18 00000100:00100000:1.0:1789395172.086650:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231857280:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395172.090565:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231857280:12345-192.168.203.54@tcp:4:dd.0 Request processed in 3901us (6073us total) trans 4294969952 rc 0/0 00000100:00100000:1.0:1789395172.090583:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 18 00002000:00100000:1.0:1789395172.090601:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4095) req@ffff89a3cac41880 x1876316231857280/t4294969952(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:638/0 lens 4584/448 e 0 to 0 dl 1789395183 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395172.090613:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac41880 with x1876316231857280 ext(0->4095) 00002000:00010000:1.0:1789395172.090621:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cac41880 00000100:00100000:3.0:1789395172.919557:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395172.919608:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395172.919641:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395172.919680:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395172.919711:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395172.919741:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857664 00000100:00100000:3.0:1789395172.919753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857664 00000100:00100000:3.0:1789395172.919898:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857536 00000100:00100000:1.0:1789395172.920002:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857408 00000100:00100000:1.0:1789395172.920007:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857408 00000100:00100000:1.0:1789395172.920046:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 451 00000100:00100000:1.0:1789395172.920059:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231857408:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395172.920238:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857536 00000100:00100000:3.0:1789395172.920267:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 651 00000100:00100000:3.0:1789395172.920275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231857664:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:2.0:1789395172.920443:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395172.920565:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231857408:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 508us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395172.920574:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 451 00000100:00100000:3.0:1789395172.921004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231857664:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 625us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395172.921014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 651 00000100:00100000:3.0:1789395172.921034:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 652 00000100:00100000:3.0:1789395172.921043:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231857536:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395172.921078:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231857536:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 36us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395172.921083:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 652 00000100:00100000:2.0:1789395172.921198:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857920 00000100:00100000:2.0:1789395172.921204:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857920 00000100:00100000:2.0:1789395172.921246:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231857792 00000100:00100000:2.0:1789395172.921249:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231857792 00000100:00100000:2.0:1789395172.921271:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 439 00000100:00100000:2.0:1789395172.921278:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231857920:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395172.921309:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231857920:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 32us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395172.921316:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 439 00000100:00100000:2.0:1789395172.921330:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 440 00000100:00100000:2.0:1789395172.921336:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2397:x1876316231857792:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395172.921361:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2397:x1876316231857792:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 26us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395172.921366:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 440 00010000:00010000:1.0:1789395173.107275:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395174.067573:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239754368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395174.067683:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395174.067857:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239754368 00000100:00100000:3.0:1789395174.067877:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239754368 00000100:00100000:3.0:1789395174.067941:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544 00000100:00100000:3.0:1789395174.067952:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239754368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789395174.067996:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:3.0:1789395174.068069:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239754368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395174.068077:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544 00000100:00100000:1.0:1789395174.068310:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239754368:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1789395174.069634:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984076 is committed 00010000:00010000:1.0:1789395174.069797:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395174.069811:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395174.069820:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395174.069826:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395174.069832:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395174.069841:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395174.069864:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa58cf3a (ffff89a4e7d26200) 00010000:00010000:1.0:1789395174.069868:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395174.069874:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395174.069881:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d5c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395174.131764:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395175.090118:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239754624:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.090312:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239755136:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.090361:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239755648:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.090461:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789395175.090467:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239754752:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.090513:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239755264:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.090552:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239755776:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090576:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.090616:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239754624 00000100:00100000:3.0:1789395175.090626:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239754624 00000100:00100000:3.0:1789395175.090687:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755136 00000100:00100000:3.0:1789395175.090690:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755136 00000100:00100000:3.0:1789395175.090712:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755648 00000100:00100000:3.0:1789395175.090715:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755648 00000100:00100000:3.0:1789395175.090725:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755264 00000100:00100000:3.0:1789395175.090727:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755264 00000100:00100000:3.0:1789395175.090738:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755776 00000100:00100000:3.0:1789395175.090740:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755776 00000100:00100000:3.0:1789395175.090755:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1789395175.090764:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239754624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090827:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239754624:12345-0@lo:400:kworker.0 Request processed in 63us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395175.090836:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1789395175.090858:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1789395175.090864:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239755136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090893:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239755136:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395175.090900:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1789395175.090911:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1789395175.090917:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239755648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090942:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239755648:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395175.090948:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1789395175.090960:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1789395175.090966:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239755264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.090994:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239755264:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395175.091000:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1789395175.091010:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1789395175.091016:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239755776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.091042:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239755776:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395175.091047:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1789395175.091100:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239755264:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.091111:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239755776:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.091120:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239754624:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.091128:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239755136:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.091136:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239755648:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091477:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239754880:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091514:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091538:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239755392:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091563:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091593:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239755904:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091614:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091653:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789395175.091660:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239754496:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091692:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091715:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239755008:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091764:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239755520:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091802:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239756032:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091823:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.091855:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239754752 00000100:00100000:1.0:1789395175.091861:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239754752 00000100:00100000:1.0:1789395175.091897:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755008 00000100:00100000:1.0:1789395175.091900:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755008 00000100:00100000:1.0:1789395175.091921:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3545 00000100:00100000:1.0:1789395175.091927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239754752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.091973:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239754752:12345-0@lo:400:kworker.0 Request processed in 46us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.091980:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3545 00000100:00100000:1.0:1789395175.091994:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3546 00000100:00100000:1.0:1789395175.092000:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239755008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092030:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239755008:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.092036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3546 00000100:00100000:1.0:1789395175.092054:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755392 00000100:00100000:1.0:1789395175.092058:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755392 00000100:00100000:1.0:1789395175.092086:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755904 00000100:00100000:1.0:1789395175.092089:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755904 00000100:00100000:1.0:1789395175.092201:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239755520 00000100:00100000:1.0:1789395175.092205:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239755520 00000100:00100000:1.0:1789395175.092223:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756032 00000100:00100000:1.0:1789395175.092226:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756032 00000100:00100000:1.0:1789395175.092246:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789395175.092253:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239755392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092287:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239755392:12345-0@lo:400:kworker.0 Request processed in 35us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.092293:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789395175.092305:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789395175.092311:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239755904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092337:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239755904:12345-0@lo:400:kworker.0 Request processed in 26us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.092343:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789395175.092353:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789395175.092359:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239755520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092420:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239755520:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.092426:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789395175.092437:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789395175.092443:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239756032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092469:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239756032:12345-0@lo:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.092475:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789395175.092499:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239754496 00000100:00100000:1.0:1789395175.092502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239754496 00000100:00100000:1.0:1789395175.092528:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789395175.092534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239754496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092563:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239754496:12345-0@lo:400:kworker.0 Request processed in 29us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.092569:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789395175.092654:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239754496:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092667:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239755008:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092678:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239755520:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092687:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239756032:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092698:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239755392:0@lo:400:kworker.0 00000100:00100000:1.0:1789395175.092707:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239755904:0@lo:400:kworker.0 00000100:00100000:0.0:1789395175.093061:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239754880 00000100:00100000:0.0:1789395175.093067:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239754880 00000100:00100000:0.0:1789395175.093122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1789395175.093130:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239754880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395175.093177:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239754880:12345-0@lo:400:kworker.0 Request processed in 47us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395175.093184:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:2.0:1789395175.093329:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395175.093335:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789395175.093338:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395175.093340:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395175.093425:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239754880:0@lo:400:kworker.0 00000100:00100000:3.0:1789395175.093680:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239754752:0@lo:400:kworker.0 00010000:00010000:1.0:1789395175.153577:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395175.601749:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395175.601798:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239756160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395175.601894:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.602156:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239756288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395175.602193:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395175.602279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756288 00000100:00100000:0.0:1789395175.602290:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756288 00000100:00100000:0.0:1789395175.602353:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3547 00000100:00100000:0.0:1789395175.602364:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239756288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395175.602434:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395175.602488:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239756288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395175.602496:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3547 00000100:00100000:2.0:1789395175.602566:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756160 00000100:00100000:2.0:1789395175.602571:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756160 00000100:00100000:2.0:1789395175.602614:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789395175.602622:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239756160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395175.602654:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395175.602689:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239756160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395175.602696:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789395175.603089:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239756288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395175.603105:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239756160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395175.607282:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239756416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395175.607381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395175.607614:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395175.607624:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239756544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395175.607662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395175.607740:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756416 00000100:00100000:1.0:1789395175.607750:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756416 00000100:00100000:1.0:1789395175.607819:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756544 00000100:00100000:1.0:1789395175.607823:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756544 00000100:00100000:1.0:1789395175.607842:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789395175.607852:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239756416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789395175.607882:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395175.607936:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239756416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.607945:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789395175.607964:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789395175.607971:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239756544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395175.607991:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75945664 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395175.608020:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239756544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395175.608027:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789395175.608162:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239756544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395175.608177:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239756416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395175.609153:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239756672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395175.609212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395175.609542:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756672 00000100:00100000:2.0:1789395175.609551:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756672 00000100:00100000:2.0:1789395175.609604:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789395175.609613:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239756672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395175.609647:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75945664 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395175.609708:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239756672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395175.609719:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789395175.609826:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239756672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789395176.186613:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395177.201614:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789395177.662829:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969952 is committed 00000100:00100000:3.0:1789395178.032361:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395178.032461:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858048 00000100:00100000:1.0:1789395178.032477:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858048 00000100:00100000:1.0:1789395178.032564:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 453 00000100:00100000:1.0:1789395178.032577:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231858048:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395178.032648:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395178.032688:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858176 00000100:00100000:3.0:1789395178.032698:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858176 00000100:00100000:1.0:1789395178.032721:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231858048:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 142us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395178.032731:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 453 00000100:00100000:3.0:1789395178.032774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 659 00000100:00100000:3.0:1789395178.032787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231858176:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:0.0:1789395178.032809:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395178.032858:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231858176:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395178.032867:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 659 00000100:00100000:3.0:1789395178.034913:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395178.035003:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858304 00000100:00100000:0.0:1789395178.035017:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858304 00000100:00100000:0.0:1789395178.035105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 660 00000100:00100000:0.0:1789395178.035116:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231858304:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:2.0:1789395178.035572:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395178.035733:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231858304:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 617us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395178.035798:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 660 00000100:00100000:3.0:1789395178.036738:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395178.036964:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858432 00000100:00100000:0.0:1789395178.036975:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858432 00000100:00100000:3.0:1789395178.037187:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395178.037223:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858560 00000100:00100000:3.0:1789395178.037228:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858560 00000100:00100000:3.0:1789395178.037282:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 445 00000100:00100000:3.0:1789395178.037295:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231858560:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395178.037366:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231858560:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395178.037375:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 445 00000100:00080000:2.0:1789395178.037504:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395178.037514:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395178.037696:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 446 00000100:00100000:0.0:1789395178.037708:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2398:x1876316231858432:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395178.037744:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2398:x1876316231858432:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 40us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395178.037751:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 446 00010000:00010000:2.0:1789395178.227079:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789395178.371743:0:22407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61b: mmap() of unstriped file is successful ========================================================== 10:12:57 (1789395177) 00000100:00100000:3.0:1789395178.463477:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395178.463575:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858688 00000100:00100000:1.0:1789395178.463587:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858688 00000100:00100000:1.0:1789395178.463669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23806 00000100:00100000:1.0:1789395178.463681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:20200:x1876316231858688:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 00010000:00010000:1.0:1789395178.463708:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395178.463736:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.463823:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d61b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.463841:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d61b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.463856:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d61b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395178.463910:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:1.0:1789395178.463914:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395178.463963:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d61b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.463999:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064f0 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.464021:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d61b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064f0 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.464031:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395178.464034:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395178.464039:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56600, rc 0) 00000100:00100000:1.0:1789395178.464124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:20200:x1876316231858688:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 Request processed in 445us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395178.464132:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23806 00000100:00100000:3.0:1789395178.470813:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395178.470905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231858944 00000100:00100000:1.0:1789395178.470917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231858944 00000100:00100000:1.0:1789395178.470986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23807 00000100:00100000:1.0:1789395178.470996:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:20200:x1876316231858944:12345-192.168.203.54@tcp:36:mmap_mknod_test.0 00010000:00010000:1.0:1789395178.471067:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395178.471108:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d61b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064f0 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471131:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395178.471136:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395178.471224:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471241:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471254:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471270:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471278:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471285:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471790:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471800:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471807:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471814:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471820:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395178.471826:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471835:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471845:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395178.471849:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395178.471853:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471860:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d622 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395178.471874:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d66e94d reply state 00000000329f1b47 transno 4294984077 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471884:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.471890:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff89a4e7d26c00) 00010000:00010000:1.0:1789395178.471892:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395178.471894:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395178.472000:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:20200:x1876316231858944:12345-192.168.203.54@tcp:36:mmap_mknod_test.0 Request processed in 1002us (1198us total) trans 4294984077 rc 0/0 00000100:00100000:1.0:1789395178.472009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23807 00000100:00100000:0.0:1789395178.475373:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395178.475655:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231859072 00000100:00100000:3.0:1789395178.475668:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231859072 00000100:00100000:3.0:1789395178.475738:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23808 00000100:00100000:3.0:1789395178.475751:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:20200:x1876316231859072:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1789395178.475780:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395178.475806:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064f7 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.475886:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.475904:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.475919:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395178.475978:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395178.475983:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395178.476013:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.476044:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064f7 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.476064:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064f7 expref: 14 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.476143:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395178.476148:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395178.476152:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a400, rc 0) 00000100:00100000:3.0:1789395178.476230:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:20200:x1876316231859072:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 Request processed in 481us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395178.476242:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23808 00000100:00100000:0.0:1789395178.479956:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395178.480013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231859200 00000100:00100000:0.0:1789395178.480026:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231859200 00000100:00100000:0.0:1789395178.481355:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23809 00000100:00100000:0.0:1789395178.481378:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:20200:x1876316231859200:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 00010000:00010000:1.0:1789395178.486304:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395178.486346:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d63e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021064fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486718:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486737:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486752:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486770:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486777:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486784:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486874:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486884:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486891:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395178.486943:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1590:0x0]: returning size 0 00000004:00200000:1.0:1789395178.486947:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395178.486971:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486985:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.486995:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487003:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487014:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487021:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487028:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395178.487033:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487042:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487057:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395178.487061:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395178.487067:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487593:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487625:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487633:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487641:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487647:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395178.487651:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487659:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487669:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff89a4e7d26c00) 00010000:00010000:1.0:1789395178.487672:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395178.487676:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487682:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57600/0xff35729af316d64c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487720:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d63e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064fe expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487736:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064fe expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.487745:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:1.0:1789395178.487747:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395178.487750:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56e00, rc 0) 00000100:00100000:1.0:1789395178.487877:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:20200:x1876316231859200:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 Request processed in 6507us (7934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395178.487888:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23809 00000100:00100000:2.0:1789395178.502904:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395178.503224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231859328 00000100:00100000:3.0:1789395178.503238:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231859328 00000100:00100000:3.0:1789395178.503312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23810 00000100:00100000:3.0:1789395178.503324:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:20200:x1876316231859328:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1789395178.503352:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395178.503379:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d65a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106505 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.503457:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.503473:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.503487:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.503651:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d65a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106505 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.503671:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a200/0xff35729af316d661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106505 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.503681:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:3.0:1789395178.503684:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789395178.503689:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a200, rc 0) 00000100:00100000:3.0:1789395178.503765:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20200:x1876316231859328:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 Request processed in 443us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395178.503774:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23810 00000100:00100000:0.0:1789395178.513473:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395178.513788:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231859584 00000100:00100000:3.0:1789395178.513802:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231859584 00000100:00100000:3.0:1789395178.513885:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23811 00000100:00100000:3.0:1789395178.513898:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20200:x1876316231859584:12345-192.168.203.54@tcp:36:mmap_mknod_test.0 00010000:00010000:3.0:1789395178.513969:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395178.514012:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56e00/0xff35729af316d653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064fe expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.514037:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:3.0:1789395178.514043:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395178.514189:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.514206:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.514218:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395178.514353:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070f19b91 reply state 00000000edca6f73 transno 4294984078 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.514367:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395178.514374:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:3.0:1789395178.514377:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395178.514381:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395178.514521:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20200:x1876316231859584:12345-192.168.203.54@tcp:36:mmap_mknod_test.0 Request processed in 625us (1062us total) trans 4294984078 rc 0/0 00000100:00100000:3.0:1789395178.514530:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23811 00000100:00100000:2.0:1789395178.520324:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395178.520436:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231859712 00000100:00100000:1.0:1789395178.520450:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231859712 00000100:00100000:1.0:1789395178.520521:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23812 00000100:00100000:1.0:1789395178.520533:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20200:x1876316231859712:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 00010000:00010000:1.0:1789395178.520565:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395178.520592:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d66f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210650c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.520684:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d66f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210650c expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.520701:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57400/0xff35729af316d66f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210650c expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395178.520713:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:1.0:1789395178.520716:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395178.520721:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57400, rc 0) 00000100:00100000:1.0:1789395178.520793:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20200:x1876316231859712:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 Request processed in 262us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395178.520802:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23812 00000100:00100000:2.0:1789395178.532206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395178.538156:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231859840 00000100:00100000:0.0:1789395178.538175:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231859840 00000100:00100000:0.0:1789395178.538254:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5200 00000100:00100000:0.0:1789395178.538267:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20200:x1876316231859840:12345-192.168.203.54@tcp:49:mmap_mknod_test.0 00000100:00100000:0.0:1789395178.538474:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20200:x1876316231859840:12345-192.168.203.54@tcp:49:mmap_mknod_test.0 Request processed in 209us (6282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395178.538487:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5200 00000100:00100000:2.0:1789395178.552291:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395178.557454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860096 00000100:00100000:2.0:1789395178.557475:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860096 00000100:00100000:2.0:1789395178.557556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23813 00000100:00100000:2.0:1789395178.557568:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20200:x1876316231860096:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 00010000:00010000:2.0:1789395178.557594:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395178.557632:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106513 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557724:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557743:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557757:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557769:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557782:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557789:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557916:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d68b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557927:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.557934:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395178.557946:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1590:0x0]: returning size 4096 00010000:00010000:2.0:1789395178.558275:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558285:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558292:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558299:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558305:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395178.558310:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558324:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558339:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395178.558342:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395178.558347:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558354:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d67d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558367:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558372:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558378:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558411:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395178.558414:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558421:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558431:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff89a4e7d26c00) 00010000:00010000:2.0:1789395178.558434:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395178.558437:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558449:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558498:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106513 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558514:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dee00/0xff35729af316d68b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106513 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395178.558522:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:2.0:1789395178.558525:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395178.558528:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dee00, rc 0) 00000100:00100000:2.0:1789395178.558625:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20200:x1876316231860096:12345-192.168.203.54@tcp:101:mmap_mknod_test.0 Request processed in 1059us (6346us total) trans 4294984079 rc 0/0 00000100:00100000:2.0:1789395178.558634:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23813 00000100:00100000:1.0:1789395178.572462:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395178.573627:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860352 00000100:00100000:3.0:1789395178.573644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860352 00000100:00100000:3.0:1789395178.573720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5201 00000100:00100000:3.0:1789395178.573733:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20200:x1876316231860352:12345-192.168.203.54@tcp:35:mmap_mknod_test.0 00000100:00100000:3.0:1789395178.574261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:20200:x1876316231860352:12345-192.168.203.54@tcp:35:mmap_mknod_test.0 Request processed in 528us (1808us total) trans 4294984080 rc 0/0 00000100:00100000:3.0:1789395178.574270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5201 00000100:00100000:2.0:1789395179.191576:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395179.191627:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239756800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395179.191745:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395179.192318:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756800 00000100:00100000:0.0:1789395179.192330:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756800 00000100:00100000:0.0:1789395179.192433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3548 00000100:00100000:0.0:1789395179.192444:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239756800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395179.192492:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395179.192557:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239756800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395179.192566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3548 00000100:00100000:2.0:1789395179.193518:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239756800:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789395179.250348:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395180.215185:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239756928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215330:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239757440:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215355:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215381:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239757952:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215440:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239758464:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215463:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215491:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789395180.215497:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239757056:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215524:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215544:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239757568:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215585:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239758080:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215663:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239757312:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215688:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215708:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239757824:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215729:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215745:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239758336:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215782:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789395180.215787:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239757184:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215820:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239757696:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215840:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215853:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239758208:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.215871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.215899:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239756928 00000100:00100000:1.0:1789395180.215907:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239756928 00000100:00100000:1.0:1789395180.215958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789395180.215967:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239756928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216023:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239756928:12345-0@lo:400:kworker.0 Request processed in 57us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216030:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789395180.216066:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757952 00000100:00100000:1.0:1789395180.216070:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757952 00000100:00100000:1.0:1789395180.216106:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758464 00000100:00100000:1.0:1789395180.216109:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758464 00000100:00100000:1.0:1789395180.216123:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757824 00000100:00100000:1.0:1789395180.216125:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757824 00000100:00100000:1.0:1789395180.216141:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758336 00000100:00100000:1.0:1789395180.216144:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758336 00000100:00100000:1.0:1789395180.216164:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1789395180.216171:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239757952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216205:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239757952:12345-0@lo:400:kworker.0 Request processed in 35us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216211:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1789395180.216223:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1789395180.216229:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216255:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239758464:12345-0@lo:400:kworker.0 Request processed in 27us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216260:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1789395180.216269:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789395180.216274:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239757824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216298:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239757824:12345-0@lo:400:kworker.0 Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216304:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789395180.216312:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789395180.216318:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216340:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239758336:12345-0@lo:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216345:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789395180.216364:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757056 00000100:00100000:1.0:1789395180.216367:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757056 00000100:00100000:1.0:1789395180.216407:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757568 00000100:00100000:1.0:1789395180.216410:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757568 00000100:00100000:1.0:1789395180.216423:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758080 00000100:00100000:1.0:1789395180.216425:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758080 00000100:00100000:1.0:1789395180.216434:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757312 00000100:00100000:1.0:1789395180.216436:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757312 00000100:00100000:1.0:1789395180.216445:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757696 00000100:00100000:1.0:1789395180.216447:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757696 00000100:00100000:1.0:1789395180.216459:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758208 00000100:00100000:1.0:1789395180.216461:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758208 00000100:00100000:1.0:1789395180.216474:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1789395180.216479:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216512:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239757056:12345-0@lo:400:kworker.0 Request processed in 32us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216518:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1789395180.216530:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1789395180.216536:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239757568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216562:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239757568:12345-0@lo:400:kworker.0 Request processed in 27us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216568:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1789395180.216579:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1789395180.216585:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239758080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216627:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239758080:12345-0@lo:400:kworker.0 Request processed in 42us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216632:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1789395180.216642:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1789395180.216647:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239757312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216667:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239757312:12345-0@lo:400:kworker.0 Request processed in 21us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216672:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1789395180.216680:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1789395180.216684:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239757696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216707:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239757696:12345-0@lo:400:kworker.0 Request processed in 22us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216712:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1789395180.216723:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1789395180.216728:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239758208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216751:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239758208:12345-0@lo:400:kworker.0 Request processed in 24us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216757:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1789395180.216794:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757440 00000100:00100000:1.0:1789395180.216797:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757440 00000100:00100000:1.0:1789395180.216822:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239757184 00000100:00100000:1.0:1789395180.216825:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239757184 00000100:00100000:1.0:1789395180.216839:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549 00000100:00100000:1.0:1789395180.216844:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239757440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216872:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239757440:12345-0@lo:400:kworker.0 Request processed in 28us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216881:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549 00000100:00100000:1.0:1789395180.216890:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550 00000100:00100000:1.0:1789395180.216895:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239757184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216916:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239757184:12345-0@lo:400:kworker.0 Request processed in 21us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.216921:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550 00000100:00100000:1.0:1789395180.216971:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239757184:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216985:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239757696:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.216995:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239758208:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217004:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239757312:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217016:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239757824:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217026:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239758336:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217072:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239757056:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217083:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239757568:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239758080:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217101:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239756928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217110:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239757440:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217121:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239757952:0@lo:400:kworker.0 00000100:00100000:1.0:1789395180.217131:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239758464:0@lo:400:kworker.0 00000100:00080000:2.0:1789395180.224725:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395180.224741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395180.224747:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395180.224750:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789395180.273677:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395180.721887:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395180.721927:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239758592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395180.722036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395180.722551:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758592 00000100:00100000:0.0:1789395180.722562:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758592 00000100:00100000:0.0:1789395180.722636:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789395180.722729:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239758592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395180.722745:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239758848:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789395180.722773:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395180.722803:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395180.722839:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395180.722845:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239758592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395180.722848:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395180.722859:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789395180.722883:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395180.722884:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758848 00000100:00100000:0.0:1789395180.722889:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758848 00000100:00100000:0.0:1789395180.722909:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758720 00000100:00100000:0.0:1789395180.722912:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758720 00000100:00100000:0.0:1789395180.722929:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789395180.722938:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239758848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395180.722946:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239758592:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395180.722949:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395180.723102:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789395180.723112:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789395180.723133:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395180.723224:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239759104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395180.723361:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c80d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239758976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395180.725890:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395180.725997:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16 00000100:00100000:2.0:1789395180.726009:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_003' 00000100:00100000:0.0:1789395180.726518:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239758848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3579us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395180.726537:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789395180.726570:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759104 00000100:00100000:0.0:1789395180.726579:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759104 00000100:00100000:0.0:1789395180.726625:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789395180.726634:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239759104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395180.726725:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395180.726780:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239759104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395180.726787:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789395180.726843:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239758848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395180.726897:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239759104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395180.731619:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8491us (8720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395180.731892:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395180.740185:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789395180.740333:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395180.741258:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239758976 00000100:00100000:2.0:1789395180.741274:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239758976 00000100:00100000:2.0:1789395180.741873:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3551 00000100:00100000:2.0:1789395180.741889:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239758976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395180.741957:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395180.742054:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239758976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (10175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395180.742242:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3551 00000100:00100000:1.0:1789395180.742365:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c80d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239758976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789395181.299524:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395182.322206:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395183.153660:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395183.153709:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395183.153741:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395183.153766:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395183.153795:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395183.153796:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860736 00000100:00100000:2.0:1789395183.153810:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860736 00000100:00100000:3.0:1789395183.153839:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860608 00000100:00100000:3.0:1789395183.153845:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860608 00000100:00100000:2.0:1789395183.153895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 667 00000100:00100000:2.0:1789395183.154090:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231860736:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395183.154141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860480 00000100:00100000:1.0:1789395183.154148:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860480 00000100:00100000:1.0:1789395183.154195:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 455 00000100:00100000:1.0:1789395183.154204:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231860480:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395183.154271:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231860736:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 365us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395183.154691:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 668 00000100:00100000:3.0:1789395183.154703:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231860608:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395183.154713:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 667 00000100:00080000:2.0:1789395183.154747:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395183.154752:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395183.156460:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860992 00000100:00100000:2.0:1789395183.156478:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860992 00000100:00100000:2.0:1789395183.156558:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231860864 00000100:00100000:2.0:1789395183.156561:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231860864 00000100:00100000:2.0:1789395183.156606:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 451 00000100:00100000:2.0:1789395183.156619:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231860992:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395183.162528:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231860480:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 8307us (8865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395183.162547:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 455 00000100:00100000:1.0:1789395183.162830:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 452 00000100:00100000:1.0:1789395183.162848:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2397:x1876316231860864:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395183.163179:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2397:x1876316231860864:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 337us (9381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395183.163201:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 452 00000100:00100000:3.0:1789395183.167753:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231860608:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 13034us (13967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395183.167775:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 668 00000100:00080000:3.0:1789395183.168029:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395183.168037:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789395183.174858:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231860992:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 16808us (19680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395183.174885:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 451 00010000:00010000:1.0:1789395183.345534:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789395183.798049:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984080 is committed 00010000:00010000:2.0:1789395183.798691:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.798709:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.798718:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.798725:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395183.798731:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.798887:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.798911:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff89a4e7d26c00) 00010000:00010000:2.0:1789395183.798914:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395183.798921:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.798928:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d629 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799027:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799094:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799106:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799112:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395183.799115:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799227:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799239:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff89a4e7d26700) 00010000:00010000:2.0:1789395183.799242:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395183.799246:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395183.799253:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b800/0xff35729af316d668 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395184.306318:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239759232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395184.306436:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395184.306578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759232 00000100:00100000:0.0:1789395184.306588:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759232 00000100:00100000:0.0:1789395184.306652:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552 00000100:00100000:0.0:1789395184.306663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239759232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395184.306707:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395184.306777:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239759232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395184.306785:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552 00000100:00100000:0.0:1789395184.306848:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239759232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395184.374442:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789395185.033604:0:22603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 10:13:03 (1789395183) 00000100:00100000:1.0:1789395185.160097:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395185.160144:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231861248 00000100:00100000:3.0:1789395185.160154:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231861248 00000100:00100000:3.0:1789395185.160627:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23814 00000100:00100000:3.0:1789395185.160637:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:20775:x1876316231861248:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395185.160657:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395185.160659:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395185.160686:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021064f7 expref: 15 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.160701:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395185.160706:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395185.160719:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d699 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210651a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789395185.161778:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789395185.163528:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.163551:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.163575:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.163601:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.163609:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.163616:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395185.163975:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa00:0x0], index 0: 0 00010000:00010000:3.0:1789395185.164136:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316d6ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164144:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164151:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164182:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164189:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164194:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164201:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164206:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395185.164210:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164220:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164501:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395185.164506:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395185.164512:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164520:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d6a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395185.164533:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094554370 reply state 00000000d59a7598 transno 4294984081 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164544:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164550:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8812000) 00010000:00010000:3.0:1789395185.164552:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395185.164565:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395185.164602:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d699 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210651a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164617:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316d6ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210651a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395185.164626:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395185.164628:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395185.164630:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ae00, rc 0) 00000100:00100000:3.0:1789395185.164708:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20775:x1876316231861248:12345-192.168.203.54@tcp:101:dd.0 Request processed in 4072us (4618us total) trans 4294984081 rc 0/0 00000100:00100000:3.0:1789395185.164717:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23814 00000100:00100000:3.0:1789395185.175655:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395185.175719:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231861376 00000100:00100000:0.0:1789395185.175729:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231861376 00000100:00080000:3.0:1789395185.175790:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395185.175799:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5346 00000100:00100000:0.0:1789395185.175810:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c80d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:20775:x1876316231861376:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395185.175828:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395185.175849:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106521 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395185.175876:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395185.175897:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=636s v=(0 0) 00010000:00010000:0.0:1789395185.175902:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395185.175910:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395185.175926:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395185.175939:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10de00, rc 0) 00000100:00100000:0.0:1789395185.175999:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c80d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:20775:x1876316231861376:12345-192.168.203.54@tcp:101:dd.0 Request processed in 191us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.176007:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5346 00000100:00100000:3.0:1789395185.329830:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239759616:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.329899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.329957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239760128:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.329984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239760640:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330021:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330047:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789395185.330053:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239759488:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330075:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239760000:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330113:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.330123:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239759360:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330132:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239760512:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.330155:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.330176:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239759872:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759616 00000100:00100000:3.0:1789395185.330197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759616 00000100:00100000:0.0:1789395185.330198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.330214:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239760384:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330234:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759872 00000100:00100000:3.0:1789395185.330237:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759872 00000100:00100000:0.0:1789395185.330247:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239760896:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553 00000100:00100000:3.0:1789395185.330264:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239759616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330265:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.330278:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789395185.330283:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239759744:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330312:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239759616:12345-0@lo:400:kworker.0 Request processed in 48us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.330314:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239760256:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553 00000100:00100000:0.0:1789395185.330331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330338:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3554 00000100:00100000:0.0:1789395185.330342:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239760768:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330344:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.330368:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239759872:12345-0@lo:400:kworker.0 Request processed in 25us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395185.330373:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3554 00000100:00100000:0.0:1789395185.330409:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239759872:0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330410:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760128 00000100:00100000:3.0:1789395185.330414:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760128 00000100:00100000:0.0:1789395185.330434:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759360 00000100:00100000:0.0:1789395185.330437:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759360 00000100:00100000:3.0:1789395185.330440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760640 00000100:00100000:3.0:1789395185.330442:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760640 00000100:00100000:0.0:1789395185.330459:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789395185.330465:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330499:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239759360:12345-0@lo:400:kworker.0 Request processed in 34us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.330505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789395185.330537:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759488 00000100:00100000:0.0:1789395185.330541:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759488 00000100:00100000:0.0:1789395185.330563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760000 00000100:00100000:0.0:1789395185.330566:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760000 00000100:00100000:0.0:1789395185.330580:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760512 00000100:00100000:0.0:1789395185.330583:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760512 00000100:00100000:0.0:1789395185.330594:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239759744 00000100:00100000:0.0:1789395185.330596:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239759744 00000100:00100000:3.0:1789395185.330599:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1789395185.330605:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239760128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330606:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1789395185.330611:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239760640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395185.330636:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239760128:12345-0@lo:400:kworker.0 Request processed in 31us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.330636:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239760640:12345-0@lo:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395185.330642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1789395185.330817:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1789395185.330831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1789395185.330888:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239759488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239759488:12345-0@lo:400:kworker.0 Request processed in 81us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.330923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1789395185.330934:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1789395185.330940:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239760000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.330964:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239760000:12345-0@lo:400:kworker.0 Request processed in 24us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.331726:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1789395185.331747:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1789395185.331756:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239760512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.331797:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239760512:12345-0@lo:400:kworker.0 Request processed in 44us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.331803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1789395185.331815:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1789395185.331821:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239759744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.331857:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239759744:12345-0@lo:400:kworker.0 Request processed in 37us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.331864:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1789395185.331897:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239759744:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.331907:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239759360:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.331956:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760384 00000100:00100000:0.0:1789395185.331962:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760384 00000100:00100000:0.0:1789395185.332009:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760896 00000100:00100000:0.0:1789395185.332013:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760896 00000100:00100000:0.0:1789395185.332045:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760256 00000100:00100000:0.0:1789395185.332048:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760256 00000100:00100000:0.0:1789395185.332068:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239760768 00000100:00100000:0.0:1789395185.332071:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239760768 00000100:00100000:0.0:1789395185.332089:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789395185.332095:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239760384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332130:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239760384:12345-0@lo:400:kworker.0 Request processed in 35us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.332135:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789395185.332146:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789395185.332152:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239760896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332177:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239760896:12345-0@lo:400:kworker.0 Request processed in 26us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.332183:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789395185.332193:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1789395185.332198:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239760256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332225:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239760256:12345-0@lo:400:kworker.0 Request processed in 27us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.332230:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1789395185.332239:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789395185.332244:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239760768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332266:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239760768:12345-0@lo:400:kworker.0 Request processed in 22us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.332271:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789395185.332301:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239760256:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332311:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239760768:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332320:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239760384:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332328:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239760896:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332420:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239759488:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332432:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239760000:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332442:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239760512:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332452:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239759616:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332462:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4c2a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239760128:0@lo:400:kworker.0 00000100:00100000:0.0:1789395185.332473:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239760640:0@lo:400:kworker.0 00000100:00080000:0.0:1789395185.332502:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395185.332506:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789395185.332509:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789395185.332511:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789395185.393645:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395185.841982:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395185.842004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239761024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395185.842079:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.842146:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761024 00000100:00100000:0.0:1789395185.842153:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761024 00000100:00100000:0.0:1789395185.842194:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789395185.842203:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239761024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395185.842231:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395185.842272:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239761024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395185.842279:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789395185.842333:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239761024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395185.844808:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395185.844828:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239761152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395185.844943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395185.845042:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761152 00000100:00100000:1.0:1789395185.845049:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761152 00000100:00100000:1.0:1789395185.845095:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789395185.845103:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239761152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395185.845123:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 92710592 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395185.845166:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239761152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395185.845173:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789395185.845213:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239761152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395185.845285:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239761408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395185.845317:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395185.845352:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395185.845359:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239761280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395185.845405:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395185.845588:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761408 00000100:00100000:1.0:1789395185.845593:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761408 00000100:00100000:1.0:1789395185.845620:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761280 00000100:00100000:1.0:1789395185.845622:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761280 00000100:00100000:1.0:1789395185.845636:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789395185.845641:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239761408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395185.845662:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395185.845693:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239761408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395185.845699:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789395185.845711:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789395185.845717:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239761280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395185.845726:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395185.845749:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239761280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395185.845755:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789395185.845848:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395185.845857:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239761536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395185.845884:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395185.845976:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761536 00000100:00100000:3.0:1789395185.845980:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761536 00000100:00100000:3.0:1789395185.846013:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555 00000100:00100000:3.0:1789395185.846019:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239761536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789395185.846040:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1789395185.846079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239761536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395185.846084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555 00000100:00100000:1.0:1789395185.846149:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239761536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395185.849540:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239761280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395185.849572:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239761408:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789395186.417634:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395187.115261:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395187.115374:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231861504 00000100:00100000:2.0:1789395187.115416:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231861504 00002000:00100000:2.0:1789395187.115483:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a4ff86ca80 x1876316231861504/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:653/0 lens 488/0 e 0 to 0 dl 1789395198 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395187.115494:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ff86ca80 with x1876316231861504 ext(0->4194303) 00002000:00010000:2.0:1789395187.115500:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ff86ca80 00000100:00100000:2.0:1789395187.115535:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:2.0:1789395187.115555:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231861504:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:0.0:1789395187.118864:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395187.232825:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231861504:12345-192.168.203.54@tcp:4:dd.0 Request processed in 117268us (117561us total) trans 4294969952 rc 0/0 00000100:00100000:2.0:1789395187.232840:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 19 00002000:00100000:2.0:1789395187.232854:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a4ff86ca80 x1876316231861504/t4294969952(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:653/0 lens 488/448 e 0 to 0 dl 1789395198 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395187.232864:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ff86ca80 with x1876316231861504 ext(0->4194303) 00002000:00010000:2.0:1789395187.232870:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ff86ca80 00010000:00010000:1.0:1789395187.442289:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395188.278530:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395188.278793:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231861632 00000100:00100000:1.0:1789395188.278806:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231861632 00000100:00100000:1.0:1789395188.278878:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 457 00000100:00100000:1.0:1789395188.278889:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231861632:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395188.278982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231861632:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 94us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395188.278990:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 457 00000100:00100000:0.0:1789395188.287492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395188.287553:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395188.287658:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231861760 00000100:00100000:3.0:1789395188.287672:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231861760 00000100:00100000:3.0:1789395188.287762:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 675 00000100:00080000:1.0:1789395188.287770:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395188.287776:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231861760:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395188.287884:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231861760:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 111us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395188.287892:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 675 00000100:00100000:1.0:1789395188.288226:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395188.288263:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395188.288638:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231861888 00000100:00100000:3.0:1789395188.288644:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231861888 00000100:00100000:3.0:1789395188.288695:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 676 00000100:00100000:3.0:1789395188.288702:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231861888:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395188.288757:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231861888:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 55us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395188.288765:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 676 00000100:00080000:0.0:1789395188.291571:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395188.296650:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231862016 00000100:00100000:2.0:1789395188.296671:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231862016 00000100:00100000:2.0:1789395188.296749:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231862144 00000100:00100000:2.0:1789395188.296753:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231862144 00000100:00100000:2.0:1789395188.296819:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 457 00000100:00100000:2.0:1789395188.296831:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231862016:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:3.0:1789395188.296919:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789395188.297214:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231862016:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 384us (9659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395188.297224:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 457 00000100:00100000:2.0:1789395188.297256:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 458 00000100:00100000:2.0:1789395188.297263:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231862144:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395188.297298:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231862144:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 35us (9034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395188.297305:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 458 00010000:00010000:2.0:1789395188.466100:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395188.999030:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395188.999157:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231862272 00000100:00100000:1.0:1789395188.999170:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231862272 00002000:00100000:1.0:1789395188.999252:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a4e7f62d80 x1876316231862272/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:654/0 lens 488/0 e 0 to 0 dl 1789395199 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395188.999266:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f62d80 with x1876316231862272 ext(4194304->8388607) 00002000:00010000:1.0:1789395188.999273:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4e7f62d80 00000100:00100000:1.0:1789395188.999316:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:1.0:1789395188.999328:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231862272:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395189.099540:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231862272:12345-192.168.203.54@tcp:4:dd.0 Request processed in 100188us (100499us total) trans 4294969953 rc 0/0 00000100:00100000:2.0:1789395189.099558:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 20 00002000:00100000:2.0:1789395189.099577:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a4e7f62d80 x1876316231862272/t4294969953(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:654/0 lens 488/448 e 0 to 0 dl 1789395199 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395189.099589:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f62d80 with x1876316231862272 ext(4194304->8388607) 00002000:00010000:2.0:1789395189.099597:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4e7f62d80 00000100:00100000:1.0:1789395189.426620:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239761664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395189.426713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395189.427017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761664 00000100:00100000:0.0:1789395189.427028:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761664 00000100:00100000:0.0:1789395189.427091:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556 00000100:00100000:0.0:1789395189.427101:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239761664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395189.427142:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395189.427567:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239761664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 466us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395189.427575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556 00000100:00100000:1.0:1789395189.431561:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239761664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395189.498431:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395190.176652:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395190.176808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231862528 00000100:00100000:3.0:1789395190.176830:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231862528 00000100:00100000:3.0:1789395190.176932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5202 00000100:00100000:3.0:1789395190.176942:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20775:x1876316231862528:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:3.0:1789395190.177242:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984082 00000100:00100000:3.0:1789395190.177373:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20775:x1876316231862528:12345-192.168.203.54@tcp:35:dd.0 Request processed in 431us (732us total) trans 4294984083 rc 0/0 00000100:00100000:3.0:1789395190.177381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5202 00000020:00080000:3.0:1789395190.177416:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789395190.178499:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789395190.180380:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984083 is committed 00010000:00010000:2.0:1789395190.180505:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395190.180529:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395190.180538:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395190.180545:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395190.180558:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395190.180567:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395190.180595:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8812000) 00010000:00010000:2.0:1789395190.180598:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395190.180604:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395190.180611:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51be00/0xff35729af316d6a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395190.451913:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239762048:0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395190.452108:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239762560:0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452138:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395190.452156:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239763072:0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452178:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395190.452222:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789395190.452229:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239762176:0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395190.452297:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239762688:0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395190.452343:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239763200:0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452364:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395190.452423:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762048 00000100:00100000:3.0:1789395190.452433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762048 00000100:00100000:3.0:1789395190.452485:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3557 00000100:00100000:3.0:1789395190.452495:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239762048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.452569:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239762048:12345-0@lo:400:kworker.0 Request processed in 75us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395190.452577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3557 00000100:00100000:3.0:1789395190.452628:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239762048:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.452737:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239761792:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.452778:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.452817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239762304:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.452841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.452859:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239762816:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.452880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.452895:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239763328:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.452916:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.452934:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789395190.452940:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239761920:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.452962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.452982:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239762432:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453003:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.453021:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239762944:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453043:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.453074:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762304 00000100:00100000:2.0:1789395190.453078:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762304 00000100:00100000:2.0:1789395190.453107:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558 00000100:00100000:2.0:1789395190.453114:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239762304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453152:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239762304:12345-0@lo:400:kworker.0 Request processed in 39us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453158:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558 00000100:00100000:2.0:1789395190.453181:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762560 00000100:00100000:2.0:1789395190.453185:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762560 00000100:00100000:2.0:1789395190.453217:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763072 00000100:00100000:2.0:1789395190.453221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763072 00000100:00100000:2.0:1789395190.453234:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762176 00000100:00100000:2.0:1789395190.453237:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762176 00000100:00100000:2.0:1789395190.453248:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761920 00000100:00100000:2.0:1789395190.453251:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761920 00000100:00100000:2.0:1789395190.453260:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762432 00000100:00100000:2.0:1789395190.453263:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762432 00000100:00100000:2.0:1789395190.453274:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762944 00000100:00100000:2.0:1789395190.453276:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762944 00000100:00100000:2.0:1789395190.453289:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1789395190.453295:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239762560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453330:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239762560:12345-0@lo:400:kworker.0 Request processed in 35us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453336:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1789395190.453349:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1789395190.453355:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239763072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453417:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239763072:12345-0@lo:400:kworker.0 Request processed in 29us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453425:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1789395190.453436:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1789395190.453442:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239762176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453470:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239762176:12345-0@lo:400:kworker.0 Request processed in 29us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453476:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1789395190.453487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1789395190.453492:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239761920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453528:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239761920:12345-0@lo:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1789395190.453545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1789395190.453551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239762432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239762432:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1789395190.453595:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1789395190.453600:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239762944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453624:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239762944:12345-0@lo:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.453630:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:2.0:1789395190.453653:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395190.453657:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395190.453683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239761920:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453693:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239762432:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453701:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239762944:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453709:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239762304:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453742:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239762176:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453754:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239762560:0@lo:400:kworker.0 00000100:00100000:2.0:1789395190.453765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239763072:0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.454762:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762688 00000100:00100000:0.0:1789395190.454774:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762688 00000100:00100000:0.0:1789395190.454855:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763200 00000100:00100000:0.0:1789395190.454859:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763200 00000100:00100000:0.0:1789395190.454883:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239762816 00000100:00100000:0.0:1789395190.454886:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239762816 00000100:00100000:0.0:1789395190.454907:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763328 00000100:00100000:0.0:1789395190.454909:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763328 00000100:00100000:0.0:1789395190.454944:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789395190.454952:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239762688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455041:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239762688:12345-0@lo:400:kworker.0 Request processed in 89us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395190.455049:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789395190.455066:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789395190.455073:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239763200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455104:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239763200:12345-0@lo:400:kworker.0 Request processed in 33us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395190.455110:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789395190.455120:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789395190.455125:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239762816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455158:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239762816:12345-0@lo:400:kworker.0 Request processed in 33us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395190.455164:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789395190.455177:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789395190.455183:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239763328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455221:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239763328:12345-0@lo:400:kworker.0 Request processed in 39us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395190.455227:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789395190.455299:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239762816:0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455310:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239763328:0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455348:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239762688:0@lo:400:kworker.0 00000100:00100000:0.0:1789395190.455359:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239763200:0@lo:400:kworker.0 00000100:00080000:2.0:1789395190.456744:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395190.456755:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395190.456797:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239761792 00000100:00100000:3.0:1789395190.456809:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239761792 00000100:00100000:3.0:1789395190.457072:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1789395190.457085:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239761792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395190.457188:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239761792:12345-0@lo:400:kworker.0 Request processed in 107us (4408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395190.457197:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789395190.457286:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239761792:0@lo:400:kworker.0 00010000:00010000:2.0:1789395190.514327:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395190.961684:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239763456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395190.961787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395190.962021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395190.962057:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.962137:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763456 00000100:00100000:2.0:1789395190.962150:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763456 00000100:00100000:2.0:1789395190.962211:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763584 00000100:00100000:2.0:1789395190.962215:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763584 00000100:00100000:2.0:1789395190.962240:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789395190.962250:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239763456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395190.962289:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395190.962353:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239763456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.962360:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789395190.962378:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789395190.962402:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239763584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395190.962418:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 109586112 pending 8437760 free 3915100160 avail 3683577856 00000100:00100000:2.0:1789395190.962451:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239763584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.962457:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789395190.962461:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239763456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395190.962483:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239763584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395190.962970:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395190.962982:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239763712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395190.963019:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395190.963049:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763712 00000100:00100000:1.0:1789395190.963054:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763712 00000100:00100000:1.0:1789395190.963085:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789395190.963091:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239763712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395190.963104:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395190.963137:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239763712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395190.963144:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789395190.963176:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239763712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395190.963291:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395190.963300:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239763840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395190.963330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395190.963365:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763840 00000100:00100000:0.0:1789395190.963368:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763840 00000100:00100000:0.0:1789395190.963411:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789395190.963417:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239763840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395190.963428:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 109586112 pending 8437760 free 3915100160 avail 3683577856 00000100:00100000:0.0:1789395190.963457:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239763840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395190.963464:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789395190.963491:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239763840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395190.963673:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239763968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395190.963704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395190.964213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239763968 00000100:00100000:2.0:1789395190.964220:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239763968 00000100:00100000:2.0:1789395190.964260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559 00000100:00100000:2.0:1789395190.964267:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239763968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395190.964299:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395190.964356:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239763968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395190.964363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559 00000100:00100000:2.0:1789395190.964420:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239763968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395191.202540:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395191.202784:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231862656 00000100:00100000:2.0:1789395191.202798:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231862656 00000100:00100000:2.0:1789395191.203180:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23815 00000100:00100000:2.0:1789395191.203195:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:20787:x1876316231862656:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395191.203227:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395191.203432:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d6c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106528 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.203530:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d6ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.203550:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.203567:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395191.203625:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:2.0:1789395191.203631:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395191.203662:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.203699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d6c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106528 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.203721:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d6ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106528 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.203731:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395191.203734:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395191.203739:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395191.203825:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20787:x1876316231862656:12345-192.168.203.54@tcp:101:dd.0 Request processed in 633us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395191.203832:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23815 00000100:00100000:1.0:1789395191.209754:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395191.209843:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231862912 00000100:00100000:2.0:1789395191.210053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231862912 00000100:00100000:2.0:1789395191.210211:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23816 00000100:00100000:2.0:1789395191.210224:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20787:x1876316231862912:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395191.210257:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395191.210261:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789395191.210293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d6ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106528 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.210315:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395191.210320:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395191.210335:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d6d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210652f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.210523:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d6d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.210541:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.210553:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395191.210567:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 10866688 00010000:00010000:2.0:1789395191.210715:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d6d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210652f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.210731:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210652f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.210739:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395191.210742:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395191.210745:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395191.210817:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20787:x1876316231862912:12345-192.168.203.54@tcp:101:dd.0 Request processed in 596us (1076us total) trans 4294984084 rc 0/0 00000100:00100000:2.0:1789395191.210825:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23816 00000100:00100000:0.0:1789395191.215880:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395191.217109:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395191.217784:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863168 00000100:00100000:0.0:1789395191.217798:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863168 00000100:00100000:0.0:1789395191.217917:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1397 00000100:00100000:0.0:1789395191.217931:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231863168:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395191.217952:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395191.218425:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d6d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210652f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395191.218453:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395191.218459:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395191.218543:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231863168:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 615us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395191.218552:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1397 00000100:00100000:1.0:1789395191.219518:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863040 00000100:00100000:1.0:1789395191.219532:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863040 00000100:00100000:1.0:1789395191.219603:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23817 00000100:00100000:1.0:1789395191.219613:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20787:x1876316231863040:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395191.219641:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395191.219665:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316d6e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106536 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.219709:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d6ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.219725:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.219743:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.219925:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56400/0xff35729af316d6e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106536 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.219943:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d6ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106536 expref: 17 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.219952:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:1.0:1789395191.219956:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395191.219959:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57e00, rc 0) 00000100:00100000:1.0:1789395191.220026:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20787:x1876316231863040:12345-192.168.203.54@tcp:101:dd.0 Request processed in 413us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395191.220033:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23817 00000100:00100000:3.0:1789395191.229765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395191.229855:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863424 00000100:00100000:2.0:1789395191.229868:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863424 00000100:00100000:2.0:1789395191.229952:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23818 00000100:00100000:2.0:1789395191.229965:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20787:x1876316231863424:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:2.0:1789395191.230048:0:21735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395191.230082:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ae00/0xff35729af316d6ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210651a expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.230105:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395191.230112:0:21735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395191.230594:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.230614:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.230628:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395191.230698:0:21735:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984085 00000004:00010000:2.0:1789395191.230724:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d62b96d7 reply state 00000000c2b87172 transno 4294984086 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.230738:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395191.230745:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395191.230748:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395191.230751:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395191.230924:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20787:x1876316231863424:12345-192.168.203.54@tcp:36:dd.0 Request processed in 960us (1170us total) trans 4294984086 rc 0/0 00000100:00100000:2.0:1789395191.230933:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23818 00000020:00080000:2.0:1789395191.230941:0:21735:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395191.238039:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395191.238137:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863552 00000100:00100000:1.0:1789395191.238151:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863552 00000100:00100000:1.0:1789395191.238223:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23819 00000100:00100000:1.0:1789395191.238234:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20787:x1876316231863552:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395191.238273:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395191.238299:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d6fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210653d expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.238377:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d6fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210653d expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.238432:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d6fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210653d expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395191.238456:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:1.0:1789395191.238460:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395191.238465:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56600, rc 0) 00000100:00100000:1.0:1789395191.238540:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20787:x1876316231863552:12345-192.168.203.54@tcp:101:dd.0 Request processed in 308us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395191.238548:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23819 00000100:00100000:1.0:1789395191.360552:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395191.361893:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863680 00000100:00100000:3.0:1789395191.361915:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863680 00002000:00010000:3.0:1789395191.362014:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1789395191.362020:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9048e00 with x1876316231863680 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395191.362036:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9048e00. 00000100:00100000:3.0:1789395191.362093:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 21 00000100:00100000:3.0:1789395191.362106:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2398:x1876316231863680:12345-192.168.203.54@tcp:10:dd.0 00000100:00080000:2.0:1789395191.362413:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789395191.403902:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395191.403915:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1789395191 00002000:00010000:3.0:1789395191.403919:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395191.403921:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1789395191 00002000:00010000:3.0:1789395191.403925:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395191.404052:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231863680:12345-192.168.203.54@tcp:10:dd.0 Request processed in 41941us (43507us total) trans 4294969954 rc 0/0 00000100:00100000:3.0:1789395191.404065:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 21 00002000:00010000:3.0:1789395191.404072:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1789395191.404076:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9048e00 with x1876316231863680 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395191.404085:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9048e00. 00010000:00010000:1.0:1789395191.537753:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395192.563362:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395192.882951:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395192.883072:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863808 00000100:00100000:2.0:1789395192.883086:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863808 00002000:00100000:2.0:1789395192.883233:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3cadc7100 x1876316231863808/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:658/0 lens 488/0 e 0 to 0 dl 1789395203 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395192.883246:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc7100 with x1876316231863808 ext(0->4194303) 00002000:00010000:2.0:1789395192.883253:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadc7100 00000100:00100000:2.0:1789395192.883298:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 22 00000100:00100000:2.0:1789395192.883309:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231863808:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395193.007036:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2398:x1876316231863808:12345-192.168.203.54@tcp:4:dd.0 Request processed in 123710us (124082us total) trans 4294969955 rc 0/0 00000100:00100000:0.0:1789395193.007056:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 22 00002000:00100000:0.0:1789395193.007075:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3cadc7100 x1876316231863808/t4294969955(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:658/0 lens 488/448 e 0 to 0 dl 1789395203 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395193.007089:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc7100 with x1876316231863808 ext(0->4194303) 00002000:00010000:0.0:1789395193.007098:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadc7100 00000001:00080000:2.0:1789395193.024083:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969955 is committed 00000100:00100000:1.0:1789395193.411119:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395193.411716:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231863936 00000100:00100000:1.0:1789395193.411729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395193.411735:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231863936 00000100:00100000:2.0:1789395193.412698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231864064 00000100:00100000:2.0:1789395193.412710:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231864064 00000100:00100000:2.0:1789395193.412799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 683 00000100:00100000:2.0:1789395193.412812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231864064:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395193.412880:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 459 00000100:00100000:0.0:1789395193.412894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231863936:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395193.412915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231864064:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 103us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395193.412925:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 683 00000100:00100000:0.0:1789395193.412968:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231863936:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 75us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395193.412977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 459 00000100:00080000:1.0:1789395193.413055:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395193.423764:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395193.423813:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395193.423901:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231864320 00000100:00100000:3.0:1789395193.423913:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231864192 00000100:00100000:0.0:1789395193.423919:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231864320 00000100:00100000:3.0:1789395193.423925:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231864192 00000100:00100000:3.0:1789395193.424068:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 684 00000100:00100000:3.0:1789395193.424080:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231864192:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395193.424177:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231864192:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395193.424184:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 684 00000100:00100000:0.0:1789395193.425939:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 463 00000100:00100000:0.0:1789395193.425960:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231864320:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395193.426062:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231864320:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 110us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395193.426071:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 463 00000100:00080000:1.0:1789395193.428169:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395193.428179:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789395193.585973:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395194.537244:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395194.537417:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231864448 00000100:00100000:0.0:1789395194.537434:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231864448 00002000:00100000:0.0:1789395194.537519:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a4fef28380 x1876316231864448/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:660/0 lens 488/0 e 0 to 0 dl 1789395205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395194.537531:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fef28380 with x1876316231864448 ext(4194304->8388607) 00002000:00010000:0.0:1789395194.537537:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4fef28380 00000100:00100000:0.0:1789395194.537566:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23 00000100:00100000:0.0:1789395194.537575:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231864448:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:1.0:1789395194.537782:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395194.546207:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239764096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395194.546267:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395194.546378:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764096 00000100:00100000:0.0:1789395194.546406:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764096 00000100:00100000:0.0:1789395194.546454:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560 00000100:00100000:0.0:1789395194.546461:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239764096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395194.546501:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395194.546547:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239764096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395194.546554:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560 00000100:00100000:1.0:1789395194.546641:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239764096:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789395194.609858:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395194.633299:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231864448:12345-192.168.203.54@tcp:4:dd.0 Request processed in 95708us (96054us total) trans 4294969956 rc 0/0 00000100:00100000:1.0:1789395194.633316:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23 00002000:00100000:1.0:1789395194.633334:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a4fef28380 x1876316231864448/t4294969956(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:660/0 lens 488/448 e 0 to 0 dl 1789395205 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395194.633358:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fef28380 with x1876316231864448 ext(4194304->8388607) 00002000:00010000:1.0:1789395194.633366:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4fef28380 00000100:00100000:2.0:1789395195.573577:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239764224:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.573670:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.573720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239764736:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.573749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.573766:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239765248:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.573788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395195.573996:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764224 00000100:00100000:3.0:1789395195.574008:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764224 00000100:00100000:3.0:1789395195.574065:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1789395195.574074:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239764224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395195.574131:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239764224:12345-0@lo:400:kworker.0 Request processed in 57us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395195.574139:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1789395195.574412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239765760:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574494:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239764224:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574515:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789395195.574522:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239764608:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574550:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574572:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239765120:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574593:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574610:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239765632:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574664:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239764352:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574687:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574703:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239764864:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574735:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239765376:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574753:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574769:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789395195.574775:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239764480:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574796:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574811:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239764992:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574844:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239765504:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395195.574888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764736 00000100:00100000:2.0:1789395195.574894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764736 00000100:00100000:2.0:1789395195.574921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764480 00000100:00100000:2.0:1789395195.574924:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764480 00000100:00100000:2.0:1789395195.574942:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561 00000100:00100000:2.0:1789395195.574948:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239764736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.574989:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239764736:12345-0@lo:400:kworker.0 Request processed in 41us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.574996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561 00000100:00100000:2.0:1789395195.575008:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562 00000100:00100000:2.0:1789395195.575013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239764480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575039:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239764480:12345-0@lo:400:kworker.0 Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562 00000100:00100000:2.0:1789395195.575060:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764608 00000100:00100000:2.0:1789395195.575063:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764608 00000100:00100000:2.0:1789395195.575080:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764352 00000100:00100000:2.0:1789395195.575082:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764352 00000100:00100000:2.0:1789395195.575090:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1789395195.575095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239764608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239764608:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575127:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1789395195.575135:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764864 00000100:00100000:2.0:1789395195.575137:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764864 00000100:00100000:2.0:1789395195.575157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765376 00000100:00100000:2.0:1789395195.575160:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765376 00000100:00100000:2.0:1789395195.575245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239764992 00000100:00100000:2.0:1789395195.575248:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239764992 00000100:00100000:2.0:1789395195.575260:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765504 00000100:00100000:2.0:1789395195.575262:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765504 00000100:00100000:2.0:1789395195.575274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1789395195.575280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239764352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239764352:12345-0@lo:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1789395195.575324:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1789395195.575330:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239764864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239764864:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575363:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1789395195.575374:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1789395195.575379:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239765376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575425:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239765376:12345-0@lo:400:kworker.0 Request processed in 46us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575431:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1789395195.575443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1789395195.575448:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239764992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575471:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239764992:12345-0@lo:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575488:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1789395195.575498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1789395195.575503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239765504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239765504:12345-0@lo:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.575535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:2.0:1789395195.575560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395195.575565:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395195.575586:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239764480:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575598:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239764992:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575607:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239765504:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575617:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239764352:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575627:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239764864:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575636:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239765376:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575895:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239764608:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.575907:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239764736:0@lo:400:kworker.0 00000100:00100000:2.0:1789395195.576050:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765248 00000100:00100000:2.0:1789395195.576056:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765248 00000100:00100000:2.0:1789395195.576089:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765760 00000100:00100000:2.0:1789395195.576092:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765760 00000100:00100000:2.0:1789395195.576107:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765120 00000100:00100000:2.0:1789395195.576109:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765120 00000100:00100000:2.0:1789395195.576122:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765632 00000100:00100000:2.0:1789395195.576124:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765632 00000100:00100000:2.0:1789395195.576141:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789395195.576147:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239765248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395195.576328:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1789395195.576338:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395195.576494:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239765760:12345-0@lo:400:kworker.0 Request processed in 158us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395195.576501:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1789395195.576516:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789395195.576521:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395195.576547:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239765120:12345-0@lo:400:kworker.0 Request processed in 26us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395195.576553:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789395195.576561:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789395195.576565:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239765632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395195.576585:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239765632:12345-0@lo:400:kworker.0 Request processed in 20us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395195.576590:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789395195.576659:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239765120:0@lo:400:kworker.0 00000100:00100000:0.0:1789395195.576669:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239765632:0@lo:400:kworker.0 00000100:00100000:0.0:1789395195.576679:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239765760:0@lo:400:kworker.0 00000100:00080000:0.0:1789395195.577725:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395195.577733:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395195.578708:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239765248:12345-0@lo:400:kworker.0 Request processed in 2550us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395195.578725:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789395195.586540:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239765248:0@lo:400:kworker.0 00010000:00010000:1.0:1789395195.640199:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395196.081836:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239765888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395196.081933:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395196.082042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239765888 00000100:00100000:3.0:1789395196.082052:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239765888 00000100:00100000:3.0:1789395196.082104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563 00000100:00100000:3.0:1789395196.082114:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239765888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789395196.082159:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1789395196.082220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239765888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395196.082227:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563 00000100:00100000:3.0:1789395196.082280:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239765888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395196.082654:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239766016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395196.082729:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395196.082778:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766016 00000100:00100000:1.0:1789395196.082782:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766016 00000100:00100000:1.0:1789395196.082817:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789395196.082824:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239766016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395196.082847:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395196.082887:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239766016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395196.082894:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789395196.082935:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239766016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395196.083282:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239766144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395196.083315:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395196.083425:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766144 00000100:00100000:2.0:1789395196.083430:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766144 00000100:00100000:2.0:1789395196.083472:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789395196.083488:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239766144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789395196.083501:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395196.083540:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239766144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395196.083547:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789395196.083580:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239766144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395196.084287:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239766272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395196.084332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395196.084446:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766272 00000100:00100000:0.0:1789395196.084453:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766272 00000100:00100000:0.0:1789395196.084506:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789395196.084515:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239766272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395196.084540:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 111302336 pending 4218880 free 3915100160 avail 3683577856 00000100:00100000:0.0:1789395196.084602:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239766272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395196.084618:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789395196.084668:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239766272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395196.087568:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239766400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395196.088064:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395196.088304:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766400 00000100:00100000:0.0:1789395196.088315:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766400 00000100:00100000:0.0:1789395196.088407:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789395196.088418:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239766400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395196.088447:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 111302336 pending 4218880 free 3915100160 avail 3683577856 00000100:00100000:0.0:1789395196.088892:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239766400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 474us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395196.088901:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789395196.089044:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239766400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395196.221710:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395196.221942:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231864704 00000100:00100000:1.0:1789395196.221959:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231864704 00000100:00100000:1.0:1789395196.222092:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5203 00000100:00100000:1.0:1789395196.222103:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20787:x1876316231864704:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:1.0:1789395196.222420:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984087 00000100:00100000:1.0:1789395196.222546:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20787:x1876316231864704:12345-192.168.203.54@tcp:35:dd.0 Request processed in 445us (843us total) trans 4294984088 rc 0/0 00000100:00100000:1.0:1789395196.222555:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5203 00000020:00080000:1.0:1789395196.222560:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789395196.223059:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789395196.228429:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984088 is committed 00010000:00010000:2.0:1789395196.228514:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.228529:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.228538:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.228544:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395196.228549:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.228557:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.228576:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395196.228580:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395196.228585:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.228597:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d6f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395196.659523:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395197.225158:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395197.229159:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231864832 00000100:00100000:0.0:1789395197.229174:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231864832 00000100:00100000:0.0:1789395197.229442:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23820 00000100:00100000:0.0:1789395197.229462:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20791:x1876316231864832:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395197.229494:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395197.229514:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106544 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.229578:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.229592:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.232108:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395197.232176:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:0.0:1789395197.232181:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395197.232208:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.232372:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106544 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.232415:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106544 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.232424:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395197.232427:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789395197.232431:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c200, rc 0) 00000100:00100000:0.0:1789395197.232577:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20791:x1876316231864832:12345-192.168.203.54@tcp:101:dd.0 Request processed in 3125us (7427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395197.232596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23820 00000100:00100000:2.0:1789395197.264324:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395197.264414:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865088 00000100:00100000:3.0:1789395197.264424:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865088 00000100:00100000:3.0:1789395197.264493:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23821 00000100:00100000:3.0:1789395197.264505:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20791:x1876316231865088:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395197.264527:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395197.264530:0:21735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395197.264560:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d709 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106544 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264582:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395197.264587:0:21735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395197.264602:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d710 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210654b expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264840:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264854:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264865:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264884:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264892:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.264898:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.265033:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.265043:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.265051:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395197.265061:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 12443648 00010000:00010000:3.0:1789395197.267121:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267138:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267147:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267153:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395197.267157:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267169:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267185:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395197.267189:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395197.267193:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267198:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267211:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267218:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267223:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267228:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395197.267230:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267236:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267243:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8812e00) 00010000:00010000:3.0:1789395197.267246:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395197.267249:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267258:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d71e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267317:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d710 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210654b expref: 19 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267332:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210654b expref: 18 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395197.267340:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395197.267342:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395197.267344:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51bc00, rc 0) 00000100:00100000:3.0:1789395197.267501:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20791:x1876316231865088:12345-192.168.203.54@tcp:101:dd.0 Request processed in 2997us (3187us total) trans 4294984089 rc 0/0 00000100:00100000:3.0:1789395197.267509:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23821 00000100:00100000:1.0:1789395197.283625:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395197.283785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865344 00000100:00100000:0.0:1789395197.283796:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865344 00000100:00100000:0.0:1789395197.283856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23822 00000100:00100000:0.0:1789395197.283867:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20791:x1876316231865344:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:0.0:1789395197.283923:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395197.283949:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51bc00/0xff35729af316d725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210654b expref: 18 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.283970:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395197.283975:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395197.284157:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.284169:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.284178:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395197.284215:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984090 00000004:00010000:0.0:1789395197.284233:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f99ef867 reply state 000000003fc55411 transno 4294984091 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.284244:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395197.284249:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395197.284737:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395197.284744:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395197.285657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20791:x1876316231865344:12345-192.168.203.54@tcp:36:dd.0 Request processed in 1786us (2035us total) trans 4294984091 rc 0/0 00000100:00100000:2.0:1789395197.285668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23822 00000020:00080000:2.0:1789395197.285673:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395197.464926:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395197.465275:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865472 00000100:00100000:2.0:1789395197.465285:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865472 00002000:00010000:2.0:1789395197.465349:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395197.465355:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db1c00 with x1876316231865472 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395197.465367:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db1c00. 00000100:00100000:2.0:1789395197.465435:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24 00000100:00100000:2.0:1789395197.465446:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231865472:12345-192.168.203.54@tcp:10:dd.0 00000100:00080000:0.0:1789395197.467892:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789395197.486537:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395197.486547:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395191 -> 1789395197 00002000:00010000:2.0:1789395197.486551:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395197.486553:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395191 -> 1789395197 00002000:00010000:2.0:1789395197.486555:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395197.486640:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231865472:12345-192.168.203.54@tcp:10:dd.0 Request processed in 21191us (21717us total) trans 4294969957 rc 0/0 00000100:00100000:2.0:1789395197.486651:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24 00002000:00010000:2.0:1789395197.486656:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395197.486660:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db1c00 with x1876316231865472 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395197.486667:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db1c00. 00010000:00010000:2.0:1789395197.681987:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395198.517089:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395198.517145:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395198.517172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395198.517202:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395198.517356:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865856 00000100:00100000:2.0:1789395198.517370:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865856 00000100:00100000:2.0:1789395198.517497:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865728 00000100:00100000:2.0:1789395198.517501:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865728 00000100:00100000:2.0:1789395198.517531:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 691 00000100:00100000:2.0:1789395198.517542:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231865856:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395198.517632:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231865856:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 92us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395198.517641:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 691 00000100:00100000:2.0:1789395198.517660:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 692 00000100:00100000:2.0:1789395198.517667:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231865728:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395198.517700:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231865728:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 34us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395198.517707:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 692 00000100:00080000:2.0:1789395198.517968:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395198.517973:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395198.518055:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395198.519174:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231866112 00000100:00100000:3.0:1789395198.519192:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231866112 00000100:00100000:3.0:1789395198.519269:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865984 00000100:00100000:3.0:1789395198.519272:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865984 00000100:00100000:3.0:1789395198.519299:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 468 00000100:00100000:3.0:1789395198.519308:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231866112:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395198.519369:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231866112:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 60us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395198.519377:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 468 00000100:00100000:3.0:1789395198.519423:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 469 00000100:00100000:3.0:1789395198.519430:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231865984:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395198.519468:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231865984:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 28us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395198.519484:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 469 00000100:00080000:0.0:1789395198.519985:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395198.520218:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231865600 00000100:00100000:1.0:1789395198.520234:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231865600 00000100:00100000:1.0:1789395198.520283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 461 00000100:00100000:1.0:1789395198.520292:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231865600:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395198.520338:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231865600:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 48us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395198.520345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 461 00010000:00010000:3.0:1789395198.708619:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395199.461549:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395199.461762:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231866240 00000100:00100000:3.0:1789395199.461772:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231866240 00002000:00100000:3.0:1789395199.461885:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3ca141500 x1876316231866240/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:665/0 lens 488/0 e 0 to 0 dl 1789395210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395199.461896:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca141500 with x1876316231866240 ext(0->4194303) 00002000:00010000:3.0:1789395199.461902:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca141500 00000100:00100000:3.0:1789395199.462989:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 25 00000100:00100000:3.0:1789395199.463006:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231866240:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:0.0:1789395199.467832:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395199.535035:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231866240:12345-192.168.203.54@tcp:4:dd.0 Request processed in 72025us (73485us total) trans 4294969958 rc 0/0 00000100:00100000:3.0:1789395199.535059:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 25 00002000:00100000:3.0:1789395199.535073:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3ca141500 x1876316231866240/t4294969958(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:665/0 lens 488/448 e 0 to 0 dl 1789395210 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395199.535085:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca141500 with x1876316231866240 ext(0->4194303) 00002000:00010000:3.0:1789395199.535091:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca141500 00000100:00100000:1.0:1789395199.667506:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239766528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395199.667587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395199.667682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766528 00000100:00100000:2.0:1789395199.667692:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766528 00000100:00100000:2.0:1789395199.667742:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564 00000100:00100000:2.0:1789395199.667752:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239766528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789395199.667790:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:1.0:1789395199.667999:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239766528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395199.668243:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239766528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395199.668252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564 00000001:00080000:3.0:1789395199.674376:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969958 is committed 00010000:00010000:1.0:1789395199.729872:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395200.690370:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239766656:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.690373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239766912:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.690491:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239766784:0@lo:400:kworker.0 00000100:00100000:3.0:1789395200.690595:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239767040:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.691903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395200.691962:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239767424:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.691993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395200.692010:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239767936:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.692027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395200.692071:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767424 00000100:00100000:2.0:1789395200.692077:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767424 00000100:00100000:2.0:1789395200.692124:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767936 00000100:00100000:2.0:1789395200.692127:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767936 00000100:00100000:2.0:1789395200.692144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1789395200.692151:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239767424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.692209:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239767424:12345-0@lo:400:kworker.0 Request processed in 58us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395200.692216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1789395200.692230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1789395200.692235:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239767936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.692255:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239767936:12345-0@lo:400:kworker.0 Request processed in 21us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395200.692260:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1789395200.692293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239767424:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.692301:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239767936:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.692349:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766912 00000100:00100000:2.0:1789395200.692352:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766912 00000100:00100000:2.0:1789395200.692374:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565 00000100:00100000:2.0:1789395200.692379:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239766912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.692434:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239766912:12345-0@lo:400:kworker.0 Request processed in 55us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395200.692452:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565 00000100:00100000:2.0:1789395200.692477:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239766912:0@lo:400:kworker.0 00000100:00080000:2.0:1789395200.692500:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395200.702861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395200.702933:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239767296:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.702973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395200.703002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239767808:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.703024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395200.703071:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766784 00000100:00100000:0.0:1789395200.703079:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766784 00000100:00100000:0.0:1789395200.703129:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767296 00000100:00100000:2.0:1789395200.703141:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767808 00000100:00100000:0.0:1789395200.703143:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767296 00000100:00100000:2.0:1789395200.703149:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767808 00000100:00100000:0.0:1789395200.703197:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1789395200.703210:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1789395200.703217:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239766784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.703223:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239767296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.703288:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239766784:12345-0@lo:400:kworker.0 Request processed in 82us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395200.703291:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239767296:12345-0@lo:400:kworker.0 Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395200.703303:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1789395200.703311:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1789395200.703326:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1789395200.703336:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239767808:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789395200.703344:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395200.703377:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239767808:12345-0@lo:400:kworker.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395200.703410:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1789395200.705081:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239766784:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.705111:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239767296:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.705122:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239767808:0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.705350:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395200.705420:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239767168:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.707179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239766656 00000100:00100000:0.0:1789395200.707189:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239766656 00000100:00100000:0.0:1789395200.707258:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789395200.707266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239766656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.707809:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239766656:12345-0@lo:400:kworker.0 Request processed in 542us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395200.707817:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789395200.708359:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395200.708417:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239767680:0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.708466:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395200.708488:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239768192:0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.708508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395200.708546:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239766656:0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.708647:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767680 00000100:00100000:1.0:1789395200.708653:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767680 00000100:00100000:1.0:1789395200.708697:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768192 00000100:00100000:1.0:1789395200.708701:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768192 00000100:00100000:1.0:1789395200.708725:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789395200.708737:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789395200.708738:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239767680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.708754:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239768192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.708794:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239767680:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395200.708802:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789395200.708807:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239768192:12345-0@lo:400:kworker.0 Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395200.708816:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00080000:1.0:1789395200.708823:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395200.708833:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395200.708870:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239767680:0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.708884:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239768192:0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.708956:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767168 00000100:00100000:0.0:1789395200.708960:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767168 00000100:00100000:0.0:1789395200.708996:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3566 00000100:00100000:0.0:1789395200.709003:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239767168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.709050:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239767168:12345-0@lo:400:kworker.0 Request processed in 47us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395200.709056:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3566 00000100:00100000:1.0:1789395200.709117:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239767168:0@lo:400:kworker.0 00000100:00100000:3.0:1789395200.716087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395200.716144:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239767552:0@lo:400:kworker.0 00000100:00100000:3.0:1789395200.716198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395200.716226:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239768064:0@lo:400:kworker.0 00000100:00100000:3.0:1789395200.716247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395200.716346:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767552 00000100:00100000:0.0:1789395200.716346:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768064 00000100:00100000:1.0:1789395200.716355:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767552 00000100:00100000:0.0:1789395200.716355:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768064 00000100:00100000:2.0:1789395200.716433:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239767040 00000100:00100000:2.0:1789395200.716448:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239767040 00000100:00100000:0.0:1789395200.716453:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1789395200.716474:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239768064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.716484:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1789395200.716493:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239767040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395200.716539:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239768064:12345-0@lo:400:kworker.0 Request processed in 68us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395200.716547:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239767040:12345-0@lo:400:kworker.0 Request processed in 54us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395200.716552:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789395200.716573:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1789395200.718847:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239767040:0@lo:400:kworker.0 00000100:00100000:2.0:1789395200.718867:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239768064:0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.721298:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00080000:3.0:1789395200.721524:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789395200.721698:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395200.724019:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239767552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395200.724122:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239767552:12345-0@lo:400:kworker.0 Request processed in 2813us (7922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395200.724132:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789395200.724267:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239767552:0@lo:400:kworker.0 00010000:00010000:2.0:1789395200.754800:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395201.201599:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239768320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395201.201680:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395201.201751:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768320 00000100:00100000:3.0:1789395201.201760:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768320 00000100:00100000:3.0:1789395201.201807:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789395201.201817:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239768320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789395201.201845:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 229376 granted 107222720 pending 0 free 3919294464 avail 3687772160 00000100:00100000:0.0:1789395201.202534:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239768704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395201.203497:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395201.203743:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239768320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395201.203836:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239768448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395201.203939:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239768320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2121us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395201.203941:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395201.203949:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395201.203955:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239768832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395201.203959:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789395201.203980:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789395201.203990:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768704 00000100:00100000:1.0:1789395201.203992:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239768576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395201.203998:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768704 00000100:00100000:0.0:1789395201.203999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395201.204028:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768448 00000100:00100000:3.0:1789395201.204032:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768448 00000100:00100000:1.0:1789395201.204038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395201.204049:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768832 00000100:00100000:0.0:1789395201.204055:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768832 00000100:00100000:3.0:1789395201.204057:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789395201.204067:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239768704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395201.204085:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00002000:00000024:3.0:1789395201.204093:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789395201.204096:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239768448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395201.204114:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 229376 granted 107222720 pending 0 free 3919294464 avail 3687772160 00000100:00100000:3.0:1789395201.204141:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239768704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395201.204150:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789395201.204163:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239768448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395201.204167:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789395201.204179:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789395201.204180:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239768832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789395201.204193:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395201.204222:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239768832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395201.204229:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789395201.204609:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239768448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395201.205344:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768576 00000100:00100000:0.0:1789395201.205351:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768576 00000100:00100000:0.0:1789395201.205492:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567 00000100:00100000:0.0:1789395201.205502:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239768576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395201.205532:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395201.206199:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239768576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 697us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395201.206207:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567 00000100:00100000:1.0:1789395201.206533:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239768576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395201.206562:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239768832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395201.206592:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239768704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395201.318301:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395201.320431:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231866368 00000100:00100000:3.0:1789395201.320454:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231866368 00002000:00100000:3.0:1789395201.320523:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a501db0380 x1876316231866368/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:667/0 lens 488/0 e 0 to 0 dl 1789395212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395201.320534:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0380 with x1876316231866368 ext(4194304->8388607) 00002000:00010000:3.0:1789395201.320540:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db0380 00000100:00100000:3.0:1789395201.320582:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00100000:3.0:1789395201.320591:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231866368:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:0.0:1789395201.323670:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395201.417089:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231866368:12345-192.168.203.54@tcp:4:dd.0 Request processed in 96487us (98787us total) trans 4294969959 rc 0/0 00000100:00100000:2.0:1789395201.417105:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 26 00002000:00100000:2.0:1789395201.417119:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a501db0380 x1876316231866368/t4294969959(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:667/0 lens 488/448 e 0 to 0 dl 1789395212 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395201.417260:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0380 with x1876316231866368 ext(4194304->8388607) 00002000:00010000:2.0:1789395201.417268:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db0380 00010000:00010000:2.0:1789395201.777936:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395202.247893:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395202.250958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231866624 00000100:00100000:3.0:1789395202.250974:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231866624 00000100:00100000:3.0:1789395202.251104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5204 00000100:00100000:3.0:1789395202.251115:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20791:x1876316231866624:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:3.0:1789395202.251316:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984092 00000100:00100000:3.0:1789395202.251494:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20791:x1876316231866624:12345-192.168.203.54@tcp:35:dd.0 Request processed in 381us (3609us total) trans 4294984093 rc 0/0 00000100:00100000:3.0:1789395202.251503:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5204 00000020:00080000:3.0:1789395202.251508:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789395202.252263:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789395202.741014:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984093 is committed 00010000:00010000:2.0:1789395202.741087:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395202.741100:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395202.741108:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395202.741114:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395202.741129:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395202.741138:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395202.741156:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395202.741160:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395202.741165:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395202.741171:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c600/0xff35729af316d733 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395202.801963:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395203.266022:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395203.266312:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231866752 00000100:00100000:2.0:1789395203.266322:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231866752 00000100:00100000:2.0:1789395203.266555:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23823 00000100:00100000:2.0:1789395203.266565:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20795:x1876316231866752:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395203.266588:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395203.266613:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d73a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106552 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.266709:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.266723:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.266736:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395203.266774:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:2.0:1789395203.266777:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395203.266796:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.266824:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d73a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106552 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.266846:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106552 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.266856:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395203.266859:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395203.266861:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395203.266914:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20795:x1876316231866752:12345-192.168.203.54@tcp:101:dd.0 Request processed in 351us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395203.266921:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23823 00000100:00100000:2.0:1789395203.277474:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395203.277575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867008 00000100:00100000:0.0:1789395203.277585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867008 00000100:00100000:0.0:1789395203.277651:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23824 00000100:00100000:0.0:1789395203.277661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20795:x1876316231867008:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395203.277683:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395203.277686:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789395203.277709:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106552 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277727:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395203.277732:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395203.277744:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316d748 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106559 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277848:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277861:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277869:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277882:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277889:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277895:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277951:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316d75d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277964:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316d75d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.277971:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316d75d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395203.277980:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 10592256 00010000:00010000:0.0:1789395203.278070:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278079:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278086:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278093:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278099:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395203.278104:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278111:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278120:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395203.278123:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395203.278126:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d000/0xff35729af316d74f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278143:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278150:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278156:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278161:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395203.278164:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278169:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278175:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395203.278177:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395203.278180:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278187:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d400/0xff35729af316d756 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278221:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c000/0xff35729af316d748 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106559 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278233:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316d75d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106559 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395203.278502:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395203.278504:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395203.278507:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c400, rc 0) 00000100:00100000:0.0:1789395203.278612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20795:x1876316231867008:12345-192.168.203.54@tcp:101:dd.0 Request processed in 952us (1145us total) trans 4294984094 rc 0/0 00000100:00100000:0.0:1789395203.278620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23824 00000100:00100000:1.0:1789395203.288305:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395203.288409:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867264 00000100:00100000:2.0:1789395203.288428:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867264 00000100:00100000:2.0:1789395203.288496:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23825 00000100:00100000:2.0:1789395203.288506:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20795:x1876316231867264:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:2.0:1789395203.288561:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395203.288585:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c400/0xff35729af316d75d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106559 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.288605:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395203.288609:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395203.288774:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.288789:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.288799:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395203.288837:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984095 00000004:00010000:2.0:1789395203.288856:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004678d723 reply state 000000006657647b transno 4294984096 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.288868:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395203.288875:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395203.288878:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395203.288880:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395203.288974:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20795:x1876316231867264:12345-192.168.203.54@tcp:36:dd.0 Request processed in 469us (677us total) trans 4294984096 rc 0/0 00000100:00100000:2.0:1789395203.288982:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23825 00000020:00080000:2.0:1789395203.288987:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395203.464309:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395203.464478:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867392 00000100:00100000:0.0:1789395203.464488:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867392 00002000:00010000:0.0:1789395203.464583:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1789395203.464588:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db3100 with x1876316231867392 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395203.464602:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db3100. 00000100:00100000:0.0:1789395203.464771:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 27 00000100:00100000:0.0:1789395203.464781:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231867392:12345-192.168.203.54@tcp:10:dd.0 00000100:00080000:1.0:1789395203.466702:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789395203.472344:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789395203.472353:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395197 -> 1789395203 00002000:00010000:0.0:1789395203.472356:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789395203.472358:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395197 -> 1789395203 00002000:00010000:0.0:1789395203.472360:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789395203.472739:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231867392:12345-192.168.203.54@tcp:10:dd.0 Request processed in 7953us (8432us total) trans 4294969960 rc 0/0 00000100:00100000:0.0:1789395203.472750:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 27 00002000:00010000:0.0:1789395203.472755:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1789395203.472759:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db3100 with x1876316231867392 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395203.472766:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db3100. 00000100:00100000:3.0:1789395203.634451:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395203.634480:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395203.634516:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395203.634667:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867520 00000100:00100000:0.0:1789395203.634677:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867520 00000100:00100000:0.0:1789395203.634724:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 463 00000100:00100000:0.0:1789395203.634732:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231867520:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395203.634819:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231867520:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 87us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395203.634826:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 463 00000100:00100000:1.0:1789395203.634934:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867776 00000100:00100000:1.0:1789395203.634940:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867776 00000100:00100000:1.0:1789395203.634985:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 474 00000100:00100000:1.0:1789395203.635057:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231867776:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:0.0:1789395203.635068:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395203.635177:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231867776:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 183us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395203.635184:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 474 00000100:00100000:2.0:1789395203.639517:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867648 00000100:00100000:2.0:1789395203.639532:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867648 00000100:00100000:2.0:1789395203.639669:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 699 00000100:00100000:2.0:1789395203.639680:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231867648:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395203.639761:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231867648:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 83us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395203.639768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 699 00000100:00080000:0.0:1789395203.639926:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789395203.827695:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395204.785793:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239768960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395204.785908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395204.786114:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239768960 00000100:00100000:0.0:1789395204.786124:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239768960 00000100:00100000:0.0:1789395204.786171:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568 00000100:00100000:0.0:1789395204.786180:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239768960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395204.786212:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395204.786286:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239768960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395204.786293:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568 00000100:00100000:1.0:1789395204.786582:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239768960:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395204.849717:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395205.489118:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395205.490667:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231867904 00000100:00100000:2.0:1789395205.490680:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231867904 00000100:00080000:0.0:1789395205.490888:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1789395205.490965:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3ca3e3800 x1876316231867904/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:671/0 lens 488/0 e 0 to 0 dl 1789395216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395205.490976:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e3800 with x1876316231867904 ext(0->4194303) 00002000:00010000:2.0:1789395205.490983:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca3e3800 00000100:00100000:2.0:1789395205.491017:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 28 00000100:00100000:2.0:1789395205.491027:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231867904:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395205.566617:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231867904:12345-192.168.203.54@tcp:4:dd.0 Request processed in 75582us (77498us total) trans 4294969961 rc 0/0 00000100:00100000:2.0:1789395205.566632:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 28 00002000:00100000:2.0:1789395205.566646:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3ca3e3800 x1876316231867904/t4294969961(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:671/0 lens 488/448 e 0 to 0 dl 1789395216 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395205.566657:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e3800 with x1876316231867904 ext(0->4194303) 00002000:00010000:2.0:1789395205.566663:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca3e3800 00000100:00100000:0.0:1789395205.812156:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239769088:0@lo:400:kworker.0 00000100:00100000:3.0:1789395205.812222:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239769216:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.812242:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395205.812307:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239769600:0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.812330:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239769344:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.812338:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395205.812360:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395205.812369:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239770112:0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.812381:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239769856:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.812427:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395205.812453:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239770624:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.812455:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769600 00000100:00100000:2.0:1789395205.812463:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769600 00000100:00100000:1.0:1789395205.812487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395205.812491:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395205.812509:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769344 00000100:00100000:2.0:1789395205.812513:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3569 00000100:00100000:2.0:1789395205.812523:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239769600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395205.812526:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769344 00000100:00100000:3.0:1789395205.812563:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570 00000100:00100000:3.0:1789395205.812570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239769344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.813678:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789395205.813690:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239769472:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.813784:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239769600:12345-0@lo:400:kworker.0 Request processed in 1261us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395205.813785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239770368:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.813793:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3569 00000100:00100000:1.0:1789395205.813817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395205.813838:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769088 00000100:00100000:2.0:1789395205.813843:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769088 00000100:00100000:2.0:1789395205.813869:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789395205.813875:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239769088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395205.813885:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239769344:12345-0@lo:400:kworker.0 Request processed in 1313us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395205.813894:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570 00000100:00100000:2.0:1789395205.813913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239769088:12345-0@lo:400:kworker.0 Request processed in 37us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395205.813921:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1789395205.813946:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395205.813947:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769856 00000100:00100000:3.0:1789395205.813952:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769856 00000100:00100000:0.0:1789395205.813974:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239769984:0@lo:400:kworker.0 00000100:00100000:3.0:1789395205.813992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770368 00000100:00100000:3.0:1789395205.813996:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770368 00000100:00100000:0.0:1789395205.814003:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395205.814028:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239770496:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814030:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770112 00000100:00100000:2.0:1789395205.814037:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770112 00000100:00100000:0.0:1789395205.814056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395205.814082:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769472 00000100:00100000:3.0:1789395205.814086:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769472 00000100:00100000:1.0:1789395205.814099:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239769344:0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814113:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789395205.814119:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239769728:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814142:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770624 00000100:00100000:1.0:1789395205.814142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395205.814146:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770624 00000100:00100000:1.0:1789395205.814161:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239770240:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814167:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769984 00000100:00100000:2.0:1789395205.814170:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769984 00000100:00100000:3.0:1789395205.814175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769728 00000100:00100000:3.0:1789395205.814181:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769728 00000100:00100000:1.0:1789395205.814185:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395205.814196:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789395205.814203:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239770112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395205.814209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770240 00000100:00100000:3.0:1789395205.814214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770240 00000100:00100000:1.0:1789395205.814215:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1789395205.814226:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239769856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814238:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239770112:12345-0@lo:400:kworker.0 Request processed in 36us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395205.814244:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1789395205.814256:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239769856:12345-0@lo:400:kworker.0 Request processed in 34us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395205.814257:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789395205.814262:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814262:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1789395205.814275:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1789395205.814280:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239770368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814286:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239770624:12345-0@lo:400:kworker.0 Request processed in 24us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395205.814291:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789395205.814301:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789395205.814301:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239770368:12345-0@lo:400:kworker.0 Request processed in 21us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395205.814311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1789395205.814312:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239769984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814319:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1789395205.814327:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239769472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814333:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1789395205.814340:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239769984:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395205.814340:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239769728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814346:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1789395205.814366:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1789395205.814373:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239770240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395205.814378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239769472:12345-0@lo:400:kworker.0 Request processed in 53us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395205.814379:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239769728:12345-0@lo:400:kworker.0 Request processed in 40us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395205.814421:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1789395205.814432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1789395205.814459:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239770240:12345-0@lo:400:kworker.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395205.814460:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239769728:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814466:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1789395205.814471:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239770240:0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814481:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239769856:0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814491:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239770368:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.814522:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789395205.814559:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395205.814564:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395205.814567:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395205.814569:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395205.814666:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239769216 00000100:00100000:1.0:1789395205.814671:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239769216 00000100:00100000:1.0:1789395205.814699:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1789395205.814704:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239769216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395205.814750:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239769216:12345-0@lo:400:kworker.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395205.814756:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1789395205.814822:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239769216:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.815491:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770496 00000100:00100000:2.0:1789395205.815496:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770496 00000100:00100000:2.0:1789395205.815550:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789395205.815553:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239769600:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.815560:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.815572:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239770112:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.815587:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239770624:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.815598:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239769088:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.815799:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239769472:0@lo:400:kworker.0 00000100:00100000:0.0:1789395205.815807:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239769984:0@lo:400:kworker.0 00000100:00100000:2.0:1789395205.815900:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239770496:12345-0@lo:400:kworker.0 Request processed in 341us (1842us total) trans 0 rc 0/0 00000100:00080000:3.0:1789395205.815902:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789395205.815911:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789395205.816830:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239770496:0@lo:400:kworker.0 00010000:00010000:2.0:1789395205.874022:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395206.321841:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239770752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395206.321914:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395206.322443:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239771008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395206.322487:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395206.322507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395206.322535:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395206.322567:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239770880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395206.322595:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395206.322690:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770752 00000100:00100000:2.0:1789395206.322698:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770752 00000100:00100000:2.0:1789395206.322744:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771008 00000100:00100000:2.0:1789395206.322747:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771008 00000100:00100000:2.0:1789395206.322760:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771136 00000100:00100000:2.0:1789395206.322762:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771136 00000100:00100000:2.0:1789395206.322776:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239770880 00000100:00100000:2.0:1789395206.322778:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239770880 00000100:00100000:2.0:1789395206.322795:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789395206.322804:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239770752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395206.322810:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789395206.322822:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239771008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395206.322838:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00002000:00000024:0.0:1789395206.322838:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 121870016 pending 8437760 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395206.322894:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239770752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395206.322903:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789395206.322914:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239771008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395206.322922:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789395206.322931:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239771136:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395206.322937:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00002000:00000024:2.0:1789395206.322954:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 121870016 pending 8437760 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395206.322957:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789395206.322968:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239770880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395206.322980:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395206.322995:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239771136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395206.323004:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789395206.323029:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239770880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395206.323093:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239771008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395206.323137:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395206.323167:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239770880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395206.323304:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395206.323337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395206.323378:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239770752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395206.326145:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771264 00000100:00100000:2.0:1789395206.326161:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771264 00000100:00100000:2.0:1789395206.326234:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571 00000100:00100000:2.0:1789395206.326244:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239771264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395206.326281:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395206.326378:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239771264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395206.326428:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571 00000100:00100000:1.0:1789395206.326546:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395206.326656:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000001:00080000:3.0:1789395206.835806:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969961 is committed 00000100:00100000:1.0:1789395206.886618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395206.886735:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868032 00000100:00100000:3.0:1789395206.886744:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868032 00002000:00100000:3.0:1789395206.886796:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3ca15c000 x1876316231868032/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:672/0 lens 488/0 e 0 to 0 dl 1789395217 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395206.886807:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15c000 with x1876316231868032 ext(4194304->8388607) 00002000:00010000:3.0:1789395206.886813:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca15c000 00000100:00100000:3.0:1789395206.886947:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 29 00000100:00100000:3.0:1789395206.886958:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231868032:12345-192.168.203.54@tcp:4:dd.0 00010000:00010000:2.0:1789395206.898165:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395206.974378:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231868032:12345-192.168.203.54@tcp:4:dd.0 Request processed in 87412us (87760us total) trans 4294969962 rc 0/0 00000100:00100000:2.0:1789395206.974431:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 29 00002000:00100000:2.0:1789395206.974444:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3ca15c000 x1876316231868032/t4294969962(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:672/0 lens 488/448 e 0 to 0 dl 1789395217 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395206.974454:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15c000 with x1876316231868032 ext(4194304->8388607) 00002000:00010000:2.0:1789395206.974460:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca15c000 00010000:00010000:1.0:1789395207.922771:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395208.279716:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395208.279839:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868288 00000100:00100000:2.0:1789395208.279855:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868288 00000100:00100000:2.0:1789395208.279967:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5205 00000100:00100000:2.0:1789395208.279977:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20795:x1876316231868288:12345-192.168.203.54@tcp:35:dd.0 00000100:00080000:3.0:1789395208.286313:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789395208.292443:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984097 00000100:00100000:2.0:1789395208.292655:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20795:x1876316231868288:12345-192.168.203.54@tcp:35:dd.0 Request processed in 12673us (12941us total) trans 4294984098 rc 0/0 00000100:00100000:2.0:1789395208.292665:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5205 00000020:00080000:2.0:1789395208.292671:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1789395208.293959:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984097 is committed 00010000:00010000:2.0:1789395208.294029:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395208.294042:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395208.294051:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395208.294057:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395208.294061:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395208.294070:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395208.294096:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395208.294100:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395208.294105:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395208.294111:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d76b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395208.753357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395208.753464:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395208.753670:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868544 00000100:00100000:3.0:1789395208.753679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868544 00000100:00100000:3.0:1789395208.753761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 706 00000100:00100000:3.0:1789395208.753771:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231868544:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395208.753861:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231868544:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 92us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395208.753869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 706 00000100:00100000:1.0:1789395208.754173:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868800 00000100:00100000:1.0:1789395208.754178:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868800 00000100:00100000:1.0:1789395208.754218:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 479 00000100:00100000:1.0:1789395208.754226:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231868800:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395208.754255:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231868800:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395208.754262:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 479 00000100:00080000:0.0:1789395208.754972:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395208.754979:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395208.762576:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395208.762684:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395208.763325:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868672 00000100:00100000:3.0:1789395208.763335:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868672 00000100:00100000:3.0:1789395208.763458:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 480 00000100:00100000:3.0:1789395208.763470:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231868672:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395208.763559:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231868672:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 92us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395208.763571:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 480 00000100:00080000:0.0:1789395208.764244:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395208.764407:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868416 00000100:00100000:2.0:1789395208.764413:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868416 00000100:00100000:2.0:1789395208.764484:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 465 00000100:00100000:2.0:1789395208.764499:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231868416:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395208.764546:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231868416:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 48us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395208.764553:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 465 00010000:00010000:2.0:1789395208.947331:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395209.290862:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395209.290976:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231868928 00000100:00100000:3.0:1789395209.290987:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231868928 00000100:00100000:3.0:1789395209.291065:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23826 00000100:00100000:3.0:1789395209.291075:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:20799:x1876316231868928:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395209.291102:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395209.291123:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106560 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.291186:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d779 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.291201:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.291220:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395209.291274:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395209.291279:0:10512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395209.291308:0:10512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.291334:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106560 expref: 19 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.291350:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106560 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.291361:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395209.291363:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395209.291366:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a400, rc 0) 00000100:00100000:3.0:1789395209.291523:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20799:x1876316231868928:12345-192.168.203.54@tcp:101:dd.0 Request processed in 448us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395209.291530:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23826 00000100:00100000:1.0:1789395209.306723:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395209.307034:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231869184 00000100:00100000:3.0:1789395209.307044:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231869184 00000100:00100000:3.0:1789395209.307096:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23827 00000100:00100000:3.0:1789395209.307103:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20799:x1876316231869184:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395209.307123:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395209.307126:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395209.307154:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d779 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106560 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307175:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395209.307180:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395209.307194:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d780 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106567 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307342:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307355:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307365:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307482:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307490:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307496:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307552:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307560:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307567:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395209.307575:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 12337152 00010000:00010000:3.0:1789395209.307652:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307659:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307665:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307672:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307677:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395209.307682:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307690:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307704:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395209.307707:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395209.307711:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307717:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307727:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307732:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307738:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307743:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395209.307747:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307752:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307760:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8812d00) 00010000:00010000:3.0:1789395209.307762:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395209.307765:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307770:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d78e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307812:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d780 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106567 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307824:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106567 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.307831:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395209.307833:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395209.307835:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51aa00, rc 0) 00000100:00100000:3.0:1789395209.307909:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20799:x1876316231869184:12345-192.168.203.54@tcp:101:dd.0 Request processed in 805us (1194us total) trans 4294984099 rc 0/0 00000100:00100000:3.0:1789395209.307917:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23827 00000100:00100000:1.0:1789395209.312108:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395209.313210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231869440 00000100:00100000:3.0:1789395209.313223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231869440 00000100:00100000:3.0:1789395209.313364:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23828 00000100:00100000:3.0:1789395209.313403:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20799:x1876316231869440:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:3.0:1789395209.313468:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395209.313495:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106567 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.313515:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395209.313519:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395209.313697:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.313713:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.313724:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395209.313771:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984100 00000004:00010000:3.0:1789395209.313793:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da9ea92c reply state 0000000060b28595 transno 4294984101 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.313806:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395209.313813:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395209.313816:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395209.313818:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395209.313925:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:20799:x1876316231869440:12345-192.168.203.54@tcp:36:dd.0 Request processed in 550us (1826us total) trans 4294984101 rc 0/0 00000100:00100000:3.0:1789395209.313933:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23828 00000020:00080000:3.0:1789395209.313939:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395209.473019:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395209.473552:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231869568 00000100:00100000:0.0:1789395209.473570:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231869568 00002000:00010000:0.0:1789395209.473621:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1789395209.473627:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259f80 with x1876316231869568 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395209.473639:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c8259f80. 00000100:00100000:0.0:1789395209.473685:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:0.0:1789395209.473696:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231869568:12345-192.168.203.54@tcp:10:dd.0 00002000:00010000:0.0:1789395209.506891:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789395209.506901:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395203 -> 1789395209 00002000:00010000:0.0:1789395209.506906:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789395209.506909:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395203 -> 1789395209 00002000:00010000:0.0:1789395209.506912:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789395209.507064:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231869568:12345-192.168.203.54@tcp:10:dd.0 Request processed in 33364us (34056us total) trans 4294969963 rc 0/0 00000100:00100000:0.0:1789395209.507076:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 30 00002000:00010000:0.0:1789395209.507082:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1789395209.507085:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259f80 with x1876316231869568 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395209.507093:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c8259f80. 00000100:00100000:1.0:1789395209.905772:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239771392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395209.905851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395209.906045:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771392 00000100:00100000:2.0:1789395209.906065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771392 00000100:00100000:2.0:1789395209.906156:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572 00000100:00100000:2.0:1789395209.906168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239771392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789395209.906227:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:2.0:1789395209.906325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239771392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395209.906333:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572 00000100:00100000:1.0:1789395209.906431:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239771392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395209.969724:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395210.931716:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239771520:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.931803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.931861:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239772032:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.932256:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876316239771648:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.932352:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395210.932438:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239772160:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.932461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395210.932479:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239772672:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.932500:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395210.932541:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771648 00000100:00100000:2.0:1789395210.932548:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771648 00000100:00100000:1.0:1789395210.933357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933418:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239772544:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933469:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239773056:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933532:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772544 00000100:00100000:1.0:1789395210.933538:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772544 00000100:00100000:1.0:1789395210.933581:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773056 00000100:00100000:1.0:1789395210.933585:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773056 00000100:00100000:1.0:1789395210.933607:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789395210.933617:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239772544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933668:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239772544:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.933675:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789395210.933692:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1789395210.933698:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239773056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933727:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239773056:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.933732:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1789395210.933752:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239771904:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933797:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239772416:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933833:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239772928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933854:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933873:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789395210.933879:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239771776:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933917:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239772288:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.933957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239772800:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.933979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395210.934003:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772416 00000100:00100000:1.0:1789395210.934007:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772416 00000100:00100000:1.0:1789395210.934032:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772928 00000100:00100000:1.0:1789395210.934035:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772928 00000100:00100000:1.0:1789395210.934054:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789395210.934060:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239772416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934096:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239772416:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.934105:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789395210.934117:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789395210.934123:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239772928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934150:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239772928:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.934156:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789395210.934173:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772160 00000100:00100000:1.0:1789395210.934177:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772160 00000100:00100000:1.0:1789395210.934196:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772672 00000100:00100000:1.0:1789395210.934200:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772672 00000100:00100000:1.0:1789395210.934212:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771904 00000100:00100000:1.0:1789395210.934215:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771904 00000100:00100000:1.0:1789395210.934226:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772288 00000100:00100000:1.0:1789395210.934228:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772288 00000100:00100000:1.0:1789395210.934243:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772800 00000100:00100000:1.0:1789395210.934245:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772800 00000100:00100000:1.0:1789395210.934264:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1789395210.934271:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239772160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934309:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239772160:12345-0@lo:400:kworker.0 Request processed in 39us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.934317:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1789395210.934324:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1789395210.934339:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239772672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934339:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1789395210.934352:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934410:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239772672:12345-0@lo:400:kworker.0 Request processed in 77us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395210.934419:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1789395210.934434:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239771904:12345-0@lo:400:kworker.0 Request processed in 85us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395210.934438:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1789395210.934448:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1789395210.934452:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239772288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934470:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1789395210.934482:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876316239771648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934488:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239772288:12345-0@lo:400:kworker.0 Request processed in 39us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395210.934496:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1789395210.934513:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1789395210.934521:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239772800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934527:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876316239771648:12345-0@lo:400:kworker.0 Request processed in 46us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.934536:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1789395210.934558:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239772800:12345-0@lo:400:kworker.0 Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395210.934565:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1789395210.934585:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239772288:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934590:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239772032 00000100:00100000:2.0:1789395210.934595:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239772032 00000100:00100000:1.0:1789395210.934602:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239772800:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934617:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239771904:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934627:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771776 00000100:00100000:1.0:1789395210.934631:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239772416:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934633:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771776 00000100:00100000:1.0:1789395210.934644:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239772928:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934657:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573 00000100:00100000:2.0:1789395210.934666:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239772032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934693:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239772544:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934708:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239772032:12345-0@lo:400:kworker.0 Request processed in 43us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395210.934713:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239773056:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934720:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573 00000100:00100000:2.0:1789395210.934741:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574 00000100:00100000:1.0:1789395210.934743:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239772032:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934752:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934793:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239771776:12345-0@lo:400:kworker.0 Request processed in 44us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395210.934800:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574 00000100:00100000:1.0:1789395210.934828:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876316239771648:0@lo:400:kworker.0 00000100:00100000:2.0:1789395210.934841:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239771776:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934846:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239772160:0@lo:400:kworker.0 00000100:00100000:1.0:1789395210.934861:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239772672:0@lo:400:kworker.0 00000100:00100000:0.0:1789395210.935415:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239771520 00000100:00100000:0.0:1789395210.935421:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239771520 00000100:00100000:0.0:1789395210.935464:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789395210.935472:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e68e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395210.935521:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e68e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239771520:12345-0@lo:400:kworker.0 Request processed in 51us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395210.935528:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00080000:0.0:1789395210.935560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789395210.935564:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789395210.935567:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395210.935569:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395210.944808:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239771520:0@lo:400:kworker.0 00010000:00010000:2.0:1789395210.993653:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395211.442179:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239773184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395211.442273:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395211.442380:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773184 00000100:00100000:1.0:1789395211.442403:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773184 00000100:00100000:1.0:1789395211.442448:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789395211.442458:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239773184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395211.442523:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395211.442569:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239773184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395211.442575:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789395211.442639:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c825bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239773184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395211.442957:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395211.442970:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395211.443003:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395211.443078:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239773440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395211.443104:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395211.443132:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773440 00000100:00100000:2.0:1789395211.443136:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773440 00000100:00100000:2.0:1789395211.443166:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3575 00000100:00100000:2.0:1789395211.443173:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239773440:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395211.444018:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773312 00000100:00100000:3.0:1789395211.444028:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773312 00000100:00100000:3.0:1789395211.444074:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789395211.444083:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239773312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789395211.444348:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 121870016 pending 4218880 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395211.444465:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239773312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 383us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395211.444474:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789395211.444543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395211.448031:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239773696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395211.448106:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395211.448180:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789395211.448187:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239773568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395211.448212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395211.448248:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773696 00000100:00100000:1.0:1789395211.448256:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773696 00000100:00100000:1.0:1789395211.448296:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773568 00000100:00100000:1.0:1789395211.448299:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773568 00000100:00100000:1.0:1789395211.448427:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789395211.448439:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239773696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395211.448461:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 121870016 pending 4218880 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395211.448507:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239773696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395211.448513:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789395211.448532:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789395211.448538:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239773568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395211.448551:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395211.448578:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239773568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395211.448584:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789395211.448625:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239773568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395211.448644:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239773696:0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1789395211.448794:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395211.448840:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239773440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5667us (5733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395211.448848:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3575 00000100:00100000:3.0:1789395211.449068:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c8258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239773440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395211.508343:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395211.508512:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231869696 00000100:00100000:0.0:1789395211.508522:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231869696 00002000:00100000:0.0:1789395211.508647:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3c93e5c00 x1876316231869696/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:677/0 lens 488/0 e 0 to 0 dl 1789395222 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395211.508659:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c93e5c00 with x1876316231869696 ext(0->4194303) 00002000:00010000:0.0:1789395211.508665:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c93e5c00 00000100:00100000:0.0:1789395211.508709:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 31 00000100:00100000:0.0:1789395211.508720:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231869696:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:2.0:1789395211.510037:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395211.600685:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2397:x1876316231869696:12345-192.168.203.54@tcp:4:dd.0 Request processed in 91948us (92333us total) trans 4294969964 rc 0/0 00000100:00100000:1.0:1789395211.600700:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 31 00002000:00100000:1.0:1789395211.600715:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3c93e5c00 x1876316231869696/t4294969964(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:677/0 lens 488/448 e 0 to 0 dl 1789395222 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395211.600725:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c93e5c00 with x1876316231869696 ext(0->4194303) 00002000:00010000:1.0:1789395211.600731:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c93e5c00 00010000:00010000:1.0:1789395212.017629:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789395212.981336:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969964 is committed 00010000:00010000:2.0:1789395213.041648:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395213.129840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395213.129933:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231869824 00000100:00100000:1.0:1789395213.129942:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231869824 00002000:00100000:1.0:1789395213.130012:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3c825b800 x1876316231869824/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:679/0 lens 488/0 e 0 to 0 dl 1789395224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395213.130023:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825b800 with x1876316231869824 ext(4194304->8388607) 00002000:00010000:1.0:1789395213.130029:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c825b800 00000100:00100000:1.0:1789395213.130060:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 32 00000100:00100000:1.0:1789395213.130070:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231869824:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:2.0:1789395213.131625:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395213.200534:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231869824:12345-192.168.203.54@tcp:4:dd.0 Request processed in 70454us (70691us total) trans 4294969965 rc 0/0 00000100:00100000:1.0:1789395213.200562:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 32 00002000:00100000:1.0:1789395213.200576:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3c825b800 x1876316231869824/t4294969965(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:679/0 lens 488/448 e 0 to 0 dl 1789395224 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395213.200587:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825b800 with x1876316231869824 ext(4194304->8388607) 00002000:00010000:1.0:1789395213.200593:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c825b800 00000100:00100000:3.0:1789395213.875330:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395213.875845:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231869952 00000100:00100000:1.0:1789395213.875856:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231869952 00000100:00100000:1.0:1789395213.875924:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 467 00000100:00100000:1.0:1789395213.875934:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231869952:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395213.876746:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231869952:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 810us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395213.876756:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 467 00000100:00100000:1.0:1789395213.884429:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395213.888709:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231870080 00000100:00100000:2.0:1789395213.888795:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231870080 00000100:00100000:2.0:1789395213.889016:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 713 00000100:00100000:2.0:1789395213.889027:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231870080:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395213.889128:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231870080:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 103us (4706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395213.889136:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 713 00000100:00080000:0.0:1789395213.889200:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395213.894327:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395213.894379:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395213.894491:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395213.894589:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231870208 00000100:00100000:1.0:1789395213.894598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231870208 00000100:00100000:1.0:1789395213.894665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 714 00000100:00100000:1.0:1789395213.894676:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231870208:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395213.894797:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231870208:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 123us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395213.894815:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 714 00000100:00080000:0.0:1789395213.895006:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395213.903148:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231870336 00000100:00100000:3.0:1789395213.903163:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231870336 00000100:00100000:3.0:1789395213.904572:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231870464 00000100:00100000:3.0:1789395213.904582:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231870464 00000100:00100000:3.0:1789395213.904648:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 485 00000100:00100000:3.0:1789395213.904661:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231870336:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395213.905998:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231870336:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 1333us (11611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395213.906011:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 485 00000100:00100000:3.0:1789395213.906062:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 486 00000100:00100000:3.0:1789395213.906073:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231870464:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395213.906101:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231870464:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 31us (11609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395213.906106:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 486 00000100:00080000:2.0:1789395213.906701:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789395214.002967:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984101 is committed 00010000:00010000:2.0:1789395214.004969:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.004989:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.004996:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.005001:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395214.005006:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.005014:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.005034:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395214.005037:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395214.005041:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.005048:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a600/0xff35729af316d7a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395214.065566:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395214.293826:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395214.296012:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231870720 00000100:00100000:2.0:1789395214.296026:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231870720 00000100:00100000:2.0:1789395214.296083:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5206 00000100:00100000:2.0:1789395214.296093:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20799:x1876316231870720:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:2.0:1789395214.296300:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984102 00000100:00100000:2.0:1789395214.296442:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20799:x1876316231870720:12345-192.168.203.54@tcp:35:dd.0 Request processed in 349us (2624us total) trans 4294984103 rc 0/0 00000100:00100000:2.0:1789395214.296452:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5206 00000020:00080000:2.0:1789395214.296457:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395215.026031:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239773824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395215.026102:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395215.026461:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773824 00000100:00100000:0.0:1789395215.026471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773824 00000100:00100000:0.0:1789395215.026523:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576 00000100:00100000:0.0:1789395215.026533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239773824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395215.026568:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395215.026794:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239773824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 261us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395215.026802:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576 00000100:00100000:2.0:1789395215.026897:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239773824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395215.089724:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395215.327594:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395215.327868:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231870848 00000100:00100000:3.0:1789395215.327879:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231870848 00000100:00100000:3.0:1789395215.328051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23829 00000100:00100000:3.0:1789395215.328062:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20803:x1876316231870848:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395215.328084:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395215.328137:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210656e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.328206:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d7b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.328220:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.328232:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395215.328285:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395215.328290:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395215.328309:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.328343:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210656e expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.328360:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210656e expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.328368:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395215.328371:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395215.328375:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b600, rc 0) 00000100:00100000:3.0:1789395215.328487:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20803:x1876316231870848:12345-192.168.203.54@tcp:101:dd.0 Request processed in 427us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395215.328495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23829 00000100:00080000:2.0:1789395215.329044:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395215.335326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395215.335447:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231871104 00000100:00100000:3.0:1789395215.335458:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231871104 00000100:00100000:3.0:1789395215.335519:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23830 00000100:00100000:3.0:1789395215.335539:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20803:x1876316231871104:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395215.335560:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395215.335564:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395215.335587:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d7b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210656e expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.335606:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395215.335611:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395215.335624:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d7b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106575 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339219:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339245:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339258:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339277:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339284:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339291:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339377:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d7cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339404:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d7cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339411:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d7cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395215.339423:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 11337728 00010000:00010000:3.0:1789395215.339523:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339530:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339535:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339542:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339548:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395215.339553:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339561:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339575:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395215.339578:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395215.339582:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339589:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d7bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339602:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339607:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339612:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339617:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395215.339620:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339626:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339633:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8812700) 00010000:00010000:3.0:1789395215.339636:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395215.339639:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339645:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d7c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339697:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d7b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106575 expref: 21 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339976:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d7cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106575 expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395215.339990:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395215.339993:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395215.339996:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a400, rc 0) 00000100:00100000:3.0:1789395215.340104:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20803:x1876316231871104:12345-192.168.203.54@tcp:101:dd.0 Request processed in 4575us (4785us total) trans 4294984104 rc 0/0 00000100:00100000:3.0:1789395215.340113:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23830 00000100:00100000:1.0:1789395215.348557:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395215.348780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231871360 00000100:00100000:2.0:1789395215.348791:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231871360 00000100:00100000:2.0:1789395215.349167:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23831 00000100:00100000:2.0:1789395215.349177:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20803:x1876316231871360:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:2.0:1789395215.349233:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395215.349259:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a400/0xff35729af316d7cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106575 expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395215.349274:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395215.349277:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395215.350017:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395215.350031:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395215.350039:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395215.350130:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984105 00000004:00010000:2.0:1789395215.350154:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d19d30d reply state 00000000932bb5c1 transno 4294984106 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395215.350165:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395215.350172:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395215.350174:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395215.350177:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395215.350312:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20803:x1876316231871360:12345-192.168.203.54@tcp:36:dd.0 Request processed in 1134us (1763us total) trans 4294984106 rc 0/0 00000100:00100000:2.0:1789395215.350319:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23831 00000020:00080000:2.0:1789395215.350324:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395215.434984:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395215.435049:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231871488 00000100:00100000:3.0:1789395215.435058:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231871488 00002000:00010000:3.0:1789395215.435165:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1789395215.435170:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c904a300 with x1876316231871488 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395215.435181:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c904a300. 00000100:00100000:3.0:1789395215.435211:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 33 00000100:00100000:3.0:1789395215.435221:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231871488:12345-192.168.203.54@tcp:10:dd.0 00000100:00080000:2.0:1789395215.436004:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789395215.442991:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789395215.443000:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395209 -> 1789395215 00002000:00010000:0.0:1789395215.443004:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789395215.443006:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395209 -> 1789395215 00002000:00010000:0.0:1789395215.443008:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789395215.443086:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231871488:12345-192.168.203.54@tcp:10:dd.0 Request processed in 7861us (8106us total) trans 4294969966 rc 0/0 00000100:00100000:0.0:1789395215.443097:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 33 00002000:00010000:0.0:1789395215.443103:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1789395215.443106:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c904a300 with x1876316231871488 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395215.443114:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c904a300. 00000100:00100000:2.0:1789395216.049585:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239773952:0@lo:400:kworker.0 00000100:00100000:2.0:1789395216.049652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395216.049750:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239773952 00000100:00100000:1.0:1789395216.049757:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239773952 00000100:00100000:1.0:1789395216.049816:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1789395216.049824:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239773952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050168:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239774336:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050200:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.050234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774336 00000100:00100000:3.0:1789395216.050238:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774336 00000100:00100000:3.0:1789395216.050263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1789395216.050269:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239774336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050303:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239774336:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.050309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1789395216.050355:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239774336:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050378:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239774080:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.050439:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789395216.050444:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239774208:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.050482:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774208 00000100:00100000:3.0:1789395216.050485:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774208 00000100:00100000:3.0:1789395216.050508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577 00000100:00100000:3.0:1789395216.050513:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239774208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050541:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239774208:12345-0@lo:400:kworker.0 Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.050547:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577 00000100:00100000:3.0:1789395216.050565:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239774208:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050598:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774080 00000100:00100000:3.0:1789395216.050601:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774080 00000100:00100000:3.0:1789395216.050620:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1789395216.050625:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239774080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.050650:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239774080:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.050655:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1789395216.050675:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239774080:0@lo:400:kworker.0 00000100:00100000:2.0:1789395216.051973:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239773952:0@lo:400:kworker.0 00000100:00100000:1.0:1789395216.052006:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239773952:12345-0@lo:400:kworker.0 Request processed in 2178us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395216.052016:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1789395216.062916:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239774720:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.062956:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239774464:0@lo:400:kworker.0 00000100:00100000:0.0:1789395216.062990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.062999:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395216.063030:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239775232:0@lo:400:kworker.0 00000100:00100000:1.0:1789395216.063069:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239774848:0@lo:400:kworker.0 00000100:00100000:2.0:1789395216.063122:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774464 00000100:00100000:2.0:1789395216.063130:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774464 00000100:00100000:3.0:1789395216.063196:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239774976:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063223:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.063240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239775488:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.063417:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774720 00000100:00100000:3.0:1789395216.063422:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774720 00000100:00100000:3.0:1789395216.063456:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1789395216.063474:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239774720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063522:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239774720:12345-0@lo:400:kworker.0 Request processed in 58us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.063529:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1789395216.063554:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239774592:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063576:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.063593:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239775104:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063612:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395216.063638:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774592 00000100:00100000:3.0:1789395216.063642:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774592 00000100:00100000:3.0:1789395216.063664:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775104 00000100:00100000:3.0:1789395216.063667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775104 00000100:00100000:3.0:1789395216.063686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1789395216.063692:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239774592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239774592:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.063744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1789395216.063756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1789395216.063761:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239775104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063785:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239775104:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.063791:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1789395216.063831:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239774592:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063840:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239775104:0@lo:400:kworker.0 00000100:00080000:3.0:1789395216.063869:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395216.063873:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395216.063894:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774976 00000100:00100000:3.0:1789395216.063897:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774976 00000100:00100000:3.0:1789395216.063920:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775488 00000100:00100000:3.0:1789395216.063923:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775488 00000100:00100000:3.0:1789395216.063938:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1789395216.063944:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239774976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.063975:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239774976:12345-0@lo:400:kworker.0 Request processed in 32us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.063981:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1789395216.063992:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1789395216.063997:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239775488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.064020:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239775488:12345-0@lo:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.064026:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00080000:3.0:1789395216.064043:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395216.064046:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395216.065370:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3578 00000100:00100000:2.0:1789395216.065404:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239774464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395216.065468:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239774464:12345-0@lo:400:kworker.0 Request processed in 88us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395216.065475:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3578 00000100:00100000:0.0:1789395216.066217:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395216.066493:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239774720:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.066763:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239774976:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.066785:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239775488:0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.066806:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239774464:0@lo:400:kworker.0 00000100:00100000:1.0:1789395216.067182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395216.067188:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775232 00000100:00100000:2.0:1789395216.067197:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775232 00000100:00100000:2.0:1789395216.067266:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1789395216.067273:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239775360:0@lo:400:kworker.0 00000100:00100000:2.0:1789395216.067278:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239775232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395216.067312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395216.067348:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239775232:12345-0@lo:400:kworker.0 Request processed in 73us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395216.067356:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00080000:3.0:1789395216.067366:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395216.070812:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239775232:0@lo:400:kworker.0 00000100:00100000:0.0:1789395216.072320:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239774848 00000100:00100000:0.0:1789395216.073145:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239774848 00000100:00100000:0.0:1789395216.073299:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775360 00000100:00100000:0.0:1789395216.073304:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775360 00000100:00100000:3.0:1789395216.073396:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1789395216.073407:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239774848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.073510:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239774848:12345-0@lo:400:kworker.0 Request processed in 105us (6329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.073518:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1789395216.073534:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1789395216.073540:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239775360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395216.073566:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239775360:12345-0@lo:400:kworker.0 Request processed in 27us (6255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395216.073571:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00080000:1.0:1789395216.073619:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395216.073623:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395216.073658:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239774848:0@lo:400:kworker.0 00000100:00100000:1.0:1789395216.073670:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239775360:0@lo:400:kworker.0 00010000:00010000:1.0:1789395216.113600:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395216.562828:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239775616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395216.562897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395216.563022:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775616 00000100:00100000:2.0:1789395216.563029:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775616 00000100:00100000:2.0:1789395216.563078:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579 00000100:00100000:2.0:1789395216.563087:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239775616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395216.563119:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395216.563165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239775616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395216.563172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579 00000100:00100000:2.0:1789395216.563213:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239775616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395216.563367:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395216.563376:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239775744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395216.563422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395216.563453:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775744 00000100:00100000:1.0:1789395216.563457:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775744 00000100:00100000:1.0:1789395216.563482:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789395216.563489:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239775744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789395216.563518:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 126334656 pending 4218880 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395216.563550:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239775744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395216.563557:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789395216.563588:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239775744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395216.563604:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239775872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395216.563626:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395216.563795:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239775872 00000100:00100000:0.0:1789395216.563799:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239775872 00000100:00100000:0.0:1789395216.563825:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789395216.563831:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239775872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789395216.563847:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789395216.563878:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239775872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395216.563883:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789395216.564146:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239776000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395216.564192:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395216.564270:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776000 00000100:00100000:2.0:1789395216.564274:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776000 00000100:00100000:2.0:1789395216.564305:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789395216.564312:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239776000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789395216.564332:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395216.564364:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239776000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395216.564369:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789395216.564420:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239776000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395216.564613:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239775872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395216.567682:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395216.567707:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239776128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395216.567784:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395216.568097:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776128 00000100:00100000:2.0:1789395216.568106:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776128 00000100:00100000:2.0:1789395216.568160:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789395216.568169:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239776128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395216.568194:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 126334656 pending 4218880 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395216.568247:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239776128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395216.568254:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789395216.568350:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239776128:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789395217.138529:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395217.210253:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395217.214774:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231871616 00000100:00100000:0.0:1789395217.214791:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231871616 00002000:00100000:0.0:1789395217.214938:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a4f6505500 x1876316231871616/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:683/0 lens 488/0 e 0 to 0 dl 1789395228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395217.214950:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6505500 with x1876316231871616 ext(0->4194303) 00002000:00010000:0.0:1789395217.214956:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6505500 00000100:00100000:0.0:1789395217.214992:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:0.0:1789395217.215003:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231871616:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:1.0:1789395217.222881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395217.278340:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231871616:12345-192.168.203.54@tcp:4:dd.0 Request processed in 63314us (68071us total) trans 4294969967 rc 0/0 00000100:00100000:1.0:1789395217.278355:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 34 00002000:00100000:1.0:1789395217.278368:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a4f6505500 x1876316231871616/t4294969967(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:683/0 lens 488/448 e 0 to 0 dl 1789395228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395217.278378:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6505500 with x1876316231871616 ext(0->4194303) 00002000:00010000:1.0:1789395217.278847:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6505500 00010000:00010000:2.0:1789395218.161622:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395218.581809:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395218.581882:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231871744 00000100:00100000:0.0:1789395218.581893:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231871744 00002000:00100000:0.0:1789395218.581943:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->7995391) req@ffff89a4f6507100 x1876316231871744/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:684/0 lens 488/0 e 0 to 0 dl 1789395229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395218.581956:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6507100 with x1876316231871744 ext(4194304->7995391) 00002000:00010000:0.0:1789395218.581962:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6507100 00000100:00100000:0.0:1789395218.581997:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 35 00000100:00100000:0.0:1789395218.582007:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231871744:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395218.595813:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395218.595868:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231871872 00000100:00100000:3.0:1789395218.595877:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231871872 00002000:00100000:3.0:1789395218.595921:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (7995392->8191999) req@ffff89a4f6509880 x1876316231871872/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:684/0 lens 488/0 e 0 to 0 dl 1789395229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395218.595933:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6509880 with x1876316231871872 ext(7995392->8191999) 00002000:00010000:3.0:1789395218.595938:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6509880 00000100:00100000:3.0:1789395218.595965:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00100000:3.0:1789395218.595974:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231871872:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395218.598892:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395218.602544:0:20964:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789395218.602560:0:20964:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789395218.603727:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872000 00000100:00100000:0.0:1789395218.603738:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872000 00002000:00100000:0.0:1789395218.603803:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (8192000->8208383) req@ffff89a4f6505f80 x1876316231872000/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:684/0 lens 16872/0 e 0 to 0 dl 1789395229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395218.603814:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6505f80 with x1876316231872000 ext(8192000->8208383) 00002000:00010000:0.0:1789395218.603821:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6505f80 00000100:00100000:1.0:1789395218.608973:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 37 00000100:00100000:1.0:1789395218.608994:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231872000:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395218.611894:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231872000:12345-192.168.203.54@tcp:4:dd.0 Request processed in 2897us (13000us total) trans 4294969968 rc 0/0 00000100:00100000:1.0:1789395218.611908:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 37 00002000:00100000:1.0:1789395218.611920:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (8192000->8208383) req@ffff89a4f6505f80 x1876316231872000/t4294969968(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:684/0 lens 16872/448 e 0 to 0 dl 1789395229 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395218.611931:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6505f80 with x1876316231872000 ext(8192000->8208383) 00002000:00010000:1.0:1789395218.611937:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6505f80 00000001:00080000:3.0:1789395218.612538:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969967 is committed 00000100:00100000:2.0:1789395218.639935:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231871872:12345-192.168.203.54@tcp:4:dd.0 Request processed in 43949us (44118us total) trans 4294969969 rc 0/0 00000100:00100000:2.0:1789395218.639951:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 36 00002000:00100000:2.0:1789395218.639966:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (7995392->8191999) req@ffff89a4f6509880 x1876316231871872/t4294969969(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:684/0 lens 488/448 e 0 to 0 dl 1789395229 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395218.639976:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6509880 with x1876316231871872 ext(7995392->8191999) 00002000:00010000:2.0:1789395218.639982:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6509880 00000100:00100000:2.0:1789395218.657965:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231871744:12345-192.168.203.54@tcp:4:dd.0 Request processed in 75949us (76155us total) trans 4294969970 rc 0/0 00000100:00100000:2.0:1789395218.657979:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 35 00002000:00100000:2.0:1789395218.657994:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->7995391) req@ffff89a4f6507100 x1876316231871744/t4294969970(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:684/0 lens 488/448 e 0 to 0 dl 1789395229 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395218.658003:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6507100 with x1876316231871744 ext(4194304->7995391) 00002000:00010000:2.0:1789395218.658010:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6507100 00000100:00100000:1.0:1789395218.993693:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395218.993743:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395218.993791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395218.993804:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872384 00000100:00100000:0.0:1789395218.993819:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872384 00000100:00100000:1.0:1789395218.993827:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395218.993862:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395218.993903:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872640 00000100:00100000:0.0:1789395218.993903:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872256 00000100:00100000:1.0:1789395218.993920:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872640 00000100:00100000:0.0:1789395218.993924:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872256 00000100:00100000:0.0:1789395218.993980:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 721 00000100:00100000:0.0:1789395218.993993:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231872384:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395218.993999:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872512 00000100:00100000:1.0:1789395218.994006:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872512 00000100:00100000:1.0:1789395218.994033:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 491 00000100:00100000:1.0:1789395218.994046:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231872640:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395218.994085:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231872384:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395218.994094:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 721 00000100:00100000:1.0:1789395218.994112:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231872640:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 66us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395218.994121:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 722 00000100:00100000:1.0:1789395218.994126:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 491 00000100:00100000:0.0:1789395218.994135:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231872256:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395218.994155:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 492 00000100:00100000:1.0:1789395218.994167:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231872512:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395218.994185:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231872256:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395218.994194:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 722 00000100:00100000:1.0:1789395218.994213:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231872512:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 43us (343us total) trans 0 rc 0/0 00000100:00080000:0.0:1789395218.994221:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395218.994222:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 492 00000100:00080000:0.0:1789395218.994232:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395218.994238:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395218.995436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872128 00000100:00100000:2.0:1789395218.995446:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872128 00000100:00100000:2.0:1789395218.995499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 469 00000100:00100000:2.0:1789395218.995510:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231872128:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395218.995559:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231872128:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 51us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395218.995567:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 469 00010000:00010000:2.0:1789395219.186412:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395220.072540:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395220.072928:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231872768 00000100:00100000:2.0:1789395220.072941:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231872768 00002000:00100000:2.0:1789395220.073067:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (8388608->12582911) req@ffff89a4f6587b80 x1876316231872768/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:686/0 lens 488/0 e 0 to 0 dl 1789395231 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395220.073078:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6587b80 with x1876316231872768 ext(8388608->12582911) 00002000:00010000:2.0:1789395220.073086:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6587b80 00000100:00100000:2.0:1789395220.073127:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 38 00000100:00100000:2.0:1789395220.073138:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2397:x1876316231872768:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:0.0:1789395220.073644:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395220.146051:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239776256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395220.146153:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395220.146242:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776256 00000100:00100000:0.0:1789395220.146254:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776256 00000100:00100000:0.0:1789395220.146330:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580 00000100:00100000:0.0:1789395220.146341:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239776256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395220.146418:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395220.146480:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239776256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395220.146488:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580 00000100:00100000:3.0:1789395220.146536:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239776256:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789395220.148967:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984106 is committed 00010000:00010000:2.0:1789395220.149057:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395220.149081:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395220.149089:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395220.149096:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395220.149101:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395220.149114:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395220.149135:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395220.149138:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395220.149144:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395220.149150:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d7db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395220.153523:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2397:x1876316231872768:12345-192.168.203.54@tcp:4:dd.0 Request processed in 80374us (80985us total) trans 4294969971 rc 0/0 00000100:00100000:3.0:1789395220.153540:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 38 00002000:00100000:3.0:1789395220.153556:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (8388608->12582911) req@ffff89a4f6587b80 x1876316231872768/t4294969971(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:686/0 lens 488/448 e 0 to 0 dl 1789395231 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395220.153567:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6587b80 with x1876316231872768 ext(8388608->12582911) 00002000:00010000:3.0:1789395220.153574:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6587b80 00010000:00010000:1.0:1789395220.209572:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395220.330491:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395220.330593:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231873024 00000100:00100000:0.0:1789395220.330605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231873024 00000100:00080000:1.0:1789395220.330678:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395220.330685:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5207 00000100:00100000:0.0:1789395220.330701:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20803:x1876316231873024:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:0.0:1789395220.330993:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984107 00000100:00100000:0.0:1789395220.331110:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20803:x1876316231873024:12345-192.168.203.54@tcp:35:dd.0 Request processed in 415us (629us total) trans 4294984108 rc 0/0 00000100:00100000:0.0:1789395220.331118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5207 00000020:00080000:0.0:1789395220.331122:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395221.171437:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239776640:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.171512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395221.171573:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239777152:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.171600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395221.171628:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239777664:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.171649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395221.171677:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789395221.171683:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239776768:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.171739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395221.171758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239777280:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.171782:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395221.171805:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239777792:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.171825:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395221.171858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776640 00000100:00100000:3.0:1789395221.171878:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776640 00000100:00100000:2.0:1789395221.172092:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777152 00000100:00100000:2.0:1789395221.172097:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777152 00000100:00100000:2.0:1789395221.172145:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777664 00000100:00100000:2.0:1789395221.172149:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777664 00000100:00100000:2.0:1789395221.172165:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776768 00000100:00100000:2.0:1789395221.172168:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776768 00000100:00100000:2.0:1789395221.172185:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1789395221.172193:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239777152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.172247:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239777152:12345-0@lo:400:kworker.0 Request processed in 54us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.172255:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1789395221.172272:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1789395221.172278:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239777664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.172315:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239777664:12345-0@lo:400:kworker.0 Request processed in 38us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.172321:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1789395221.172333:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1789395221.172338:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239776768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.172362:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239776768:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.172368:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1789395221.172432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239776768:0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.172443:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239777152:0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.172451:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239777664:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.172528:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239776384:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.172562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395221.172586:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239776896:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.172609:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395221.172642:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239776512:0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.172687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395221.172717:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239777024:0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.172739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395221.172755:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239777536:0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.172773:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395221.172795:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776512 00000100:00100000:0.0:1789395221.172799:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776512 00000100:00100000:0.0:1789395221.172818:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777024 00000100:00100000:0.0:1789395221.172820:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777024 00000100:00100000:0.0:1789395221.172831:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777536 00000100:00100000:0.0:1789395221.172834:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777536 00000100:00100000:0.0:1789395221.172846:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1789395221.172853:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239776512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.172888:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239776512:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395221.172895:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1789395221.172908:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1789395221.172914:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239777024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.172937:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239777024:12345-0@lo:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395221.172958:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1789395221.172969:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1789395221.172975:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239777536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.173002:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777280 00000100:00100000:2.0:1789395221.173007:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777280 00000100:00100000:0.0:1789395221.173026:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239777536:12345-0@lo:400:kworker.0 Request processed in 48us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395221.173034:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1789395221.173039:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777792 00000100:00100000:2.0:1789395221.173043:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777792 00000100:00100000:2.0:1789395221.173069:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1789395221.173077:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239777280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.173083:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239776512:0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.173096:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239777024:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.173291:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776896 00000100:00100000:3.0:1789395221.173295:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776896 00000100:00100000:3.0:1789395221.173321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:3.0:1789395221.173327:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239776640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.173791:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239777536:0@lo:400:kworker.0 00000100:00100000:0.0:1789395221.173911:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239776384 00000100:00100000:0.0:1789395221.173917:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239776384 00000100:00100000:2.0:1789395221.174015:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239777280:12345-0@lo:400:kworker.0 Request processed in 938us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.174024:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1789395221.174038:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1789395221.174045:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239777792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.174075:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239777792:12345-0@lo:400:kworker.0 Request processed in 31us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.174080:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1789395221.174123:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239777280:0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.174132:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239777792:0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.174167:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582 00000100:00100000:2.0:1789395221.174174:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239776896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395221.174208:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239776896:12345-0@lo:400:kworker.0 Request processed in 35us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.174213:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:1.0:1789395221.174451:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239776896:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.174461:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239777408:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.174490:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395221.174510:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239777920:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.174532:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395221.174577:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777408 00000100:00100000:1.0:1789395221.174582:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777408 00000100:00100000:1.0:1789395221.174623:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239777920 00000100:00100000:1.0:1789395221.174626:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239777920 00000100:00100000:1.0:1789395221.174648:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1789395221.174654:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239777408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.174688:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239777408:12345-0@lo:400:kworker.0 Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395221.174706:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1789395221.174719:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789395221.174725:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239777920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.174754:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239777920:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395221.174760:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789395221.174797:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239777408:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.174806:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239777920:0@lo:400:kworker.0 00000100:00100000:3.0:1789395221.175302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239776640:12345-0@lo:400:kworker.0 Request processed in 1972us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395221.175310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1789395221.175826:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789395221.175841:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239776384:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789395221.175856:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395221.175873:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789395221.175877:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395221.175881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395221.175900:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239776384:12345-0@lo:400:kworker.0 Request processed in 63us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395221.175907:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789395221.175927:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239776640:0@lo:400:kworker.0 00000100:00100000:1.0:1789395221.176439:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239776384:0@lo:400:kworker.0 00010000:00010000:2.0:1789395221.233740:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395221.353349:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395221.353541:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231873152 00000100:00100000:0.0:1789395221.353550:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231873152 00000100:00100000:0.0:1789395221.353618:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23832 00000100:00100000:0.0:1789395221.353629:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20807:x1876316231873152:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395221.353651:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395221.353682:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d7e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210657c expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.353754:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d7e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.353768:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.353780:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395221.353821:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:0.0:1789395221.353824:0:21735:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395221.353843:0:21735:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.353866:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d7e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210657c expref: 20 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.353890:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210657c expref: 19 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.353898:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395221.353901:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789395221.353904:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:0.0:1789395221.353965:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20807:x1876316231873152:12345-192.168.203.54@tcp:101:dd.0 Request processed in 338us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395221.353973:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23832 00000100:00100000:1.0:1789395221.358168:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395221.358300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231873408 00000100:00100000:0.0:1789395221.358314:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231873408 00000100:00100000:0.0:1789395221.358423:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23833 00000100:00100000:0.0:1789395221.358433:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20807:x1876316231873408:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395221.358453:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395221.358456:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789395221.358481:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d7e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210657c expref: 19 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358500:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395221.358504:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395221.358517:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316d7f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106583 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358690:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358715:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358729:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358743:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358750:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358756:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358813:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358822:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358829:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395221.358838:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 13385728 00010000:00010000:0.0:1789395221.358918:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358926:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358933:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358941:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358948:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395221.358952:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358958:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358967:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395221.358970:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395221.358974:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358986:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316d7f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.358996:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359002:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359008:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359013:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395221.359016:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359026:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359034:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a4cbc0e900) 00010000:00010000:0.0:1789395221.359037:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395221.359039:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359045:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316d7fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359084:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10da00/0xff35729af316d7f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106583 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359098:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106583 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.359106:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395221.359108:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395221.359110:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d200, rc 0) 00000100:00100000:0.0:1789395221.359181:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20807:x1876316231873408:12345-192.168.203.54@tcp:101:dd.0 Request processed in 749us (1027us total) trans 4294984109 rc 0/0 00000100:00100000:0.0:1789395221.359188:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23833 00000100:00100000:3.0:1789395221.364464:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395221.364583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231873664 00000100:00100000:0.0:1789395221.364597:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231873664 00000100:00100000:0.0:1789395221.364691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23834 00000100:00100000:0.0:1789395221.364704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20807:x1876316231873664:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:0.0:1789395221.364798:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395221.364832:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106583 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.364858:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395221.364865:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395221.365352:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.365370:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.365382:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395221.365454:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984110 00000004:00010000:0.0:1789395221.365479:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ccd88ce reply state 000000002e4650bf transno 4294984111 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.365492:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395221.365499:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:0.0:1789395221.365502:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395221.365504:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395221.365607:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20807:x1876316231873664:12345-192.168.203.54@tcp:36:dd.0 Request processed in 904us (1157us total) trans 4294984111 rc 0/0 00000100:00100000:0.0:1789395221.365615:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23834 00000020:00080000:0.0:1789395221.365621:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395221.412877:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395221.413018:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231873792 00000100:00100000:2.0:1789395221.413030:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231873792 00002000:00010000:2.0:1789395221.413156:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395221.413162:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6507800 with x1876316231873792 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395221.413176:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6507800. 00000100:00100000:2.0:1789395221.413290:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 39 00000100:00100000:2.0:1789395221.413304:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231873792:12345-192.168.203.54@tcp:10:dd.0 00002000:00010000:2.0:1789395221.434775:0:22628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395221.434800:0:22628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395215 -> 1789395221 00002000:00010000:2.0:1789395221.434804:0:22628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395221.434807:0:22628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395215 -> 1789395221 00002000:00010000:2.0:1789395221.434810:0:22628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395221.434917:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231873792:12345-192.168.203.54@tcp:10:dd.0 Request processed in 21608us (22044us total) trans 4294969972 rc 0/0 00000100:00100000:2.0:1789395221.434934:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 39 00002000:00010000:2.0:1789395221.434942:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395221.434945:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6507800 with x1876316231873792 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395221.434954:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6507800. 00000100:00100000:1.0:1789395221.681680:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239778048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395221.681805:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395221.681912:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778048 00000100:00100000:1.0:1789395221.681922:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778048 00000100:00100000:1.0:1789395221.681995:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789395221.682005:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239778048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395221.682046:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395221.682098:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239778048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395221.682106:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789395221.682160:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239778048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395221.682621:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239778176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395221.682658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395221.682684:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395221.682690:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239778304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395221.682718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395221.682744:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778176 00000100:00100000:2.0:1789395221.682749:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778176 00000100:00100000:2.0:1789395221.682782:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789395221.682789:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239778176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395221.682804:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 434176 granted 157112000 pending 8306688 free 3915280384 avail 3683758080 00000100:00100000:2.0:1789395221.682840:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239778176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.682848:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789395221.682867:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778304 00000100:00100000:2.0:1789395221.682871:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778304 00000100:00100000:2.0:1789395221.682899:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583 00000100:00100000:2.0:1789395221.682905:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239778304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395221.682934:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1789395221.683101:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395221.683109:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239778432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395221.683136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395221.683161:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778432 00000100:00100000:1.0:1789395221.683165:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778432 00000100:00100000:1.0:1789395221.683189:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789395221.683195:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239778432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395221.683206:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395221.683238:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239778432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395221.683247:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789395221.683289:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239778432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395221.683345:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239778176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395221.683466:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239778304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 561us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395221.683474:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583 00000100:00100000:3.0:1789395221.683672:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395221.683685:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239778560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395221.683720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395221.684165:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778560 00000100:00100000:0.0:1789395221.684174:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778560 00000100:00100000:0.0:1789395221.684222:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789395221.684230:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239778560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395221.684246:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 434176 granted 157112000 pending 8306688 free 3915280384 avail 3683758080 00000100:00100000:0.0:1789395221.684306:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239778560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395221.684313:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789395221.684414:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239778560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395221.684499:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239778304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789395222.258623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395223.281939:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395223.320865:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395223.321011:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231873920 00000100:00100000:2.0:1789395223.321025:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231873920 00002000:00100000:2.0:1789395223.321119:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a5009daa00 x1876316231873920/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:689/0 lens 488/0 e 0 to 0 dl 1789395234 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395223.321132:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a5009daa00 with x1876316231873920 ext(0->4194303) 00002000:00010000:2.0:1789395223.321139:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a5009daa00 00000100:00100000:2.0:1789395223.321178:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 40 00000100:00100000:2.0:1789395223.321189:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2397:x1876316231873920:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:1.0:1789395223.321951:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395223.413345:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231873920:12345-192.168.203.54@tcp:4:dd.0 Request processed in 92145us (92492us total) trans 4294969973 rc 0/0 00000100:00100000:0.0:1789395223.413361:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 40 00002000:00100000:0.0:1789395223.413374:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a5009daa00 x1876316231873920/t4294969973(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:689/0 lens 488/448 e 0 to 0 dl 1789395234 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395223.413415:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a5009daa00 with x1876316231873920 ext(0->4194303) 00002000:00010000:0.0:1789395223.413423:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a5009daa00 00000001:00080000:3.0:1789395223.732808:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969973 is committed 00000100:00100000:3.0:1789395224.112872:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395224.113083:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874176 00000100:00100000:0.0:1789395224.113094:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874176 00000100:00100000:0.0:1789395224.113176:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 729 00000100:00100000:0.0:1789395224.113186:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231874176:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395224.113280:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231874176:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 94us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395224.113287:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 729 00000100:00100000:3.0:1789395224.114232:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00080000:1.0:1789395224.114467:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395224.114613:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874432 00000100:00100000:2.0:1789395224.114621:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874432 00000100:00100000:2.0:1789395224.114670:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 497 00000100:00100000:2.0:1789395224.114680:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231874432:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395224.124290:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395224.124325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395224.124376:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395224.124428:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874560 00000100:00100000:3.0:1789395224.124436:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874560 00000100:00100000:3.0:1789395224.124492:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 498 00000100:00100000:3.0:1789395224.124502:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231874560:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395224.124588:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231874560:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395224.124596:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 498 00000100:00080000:3.0:1789395224.124621:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789395224.124764:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874048 00000100:00100000:0.0:1789395224.124769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874048 00000100:00100000:0.0:1789395224.124809:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 471 00000100:00100000:0.0:1789395224.124817:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231874048:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395224.125216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874304 00000100:00100000:1.0:1789395224.125222:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874304 00000100:00100000:1.0:1789395224.125281:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 730 00000100:00100000:1.0:1789395224.125291:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231874304:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395224.125311:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231874048:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 493us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395224.125320:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 471 00000100:00100000:1.0:1789395224.125330:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231874304:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 40us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395224.125337:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 730 00000100:00080000:3.0:1789395224.125648:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395224.129191:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231874432:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 14501us (16253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395224.129207:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 497 00010000:00010000:1.0:1789395224.305559:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395225.027063:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395225.027360:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874688 00000100:00100000:0.0:1789395225.027374:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874688 00002000:00100000:0.0:1789395225.027495:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3c9e1ad80 x1876316231874688/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:691/0 lens 488/0 e 0 to 0 dl 1789395236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395225.027509:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9e1ad80 with x1876316231874688 ext(4194304->8388607) 00002000:00010000:0.0:1789395225.027516:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9e1ad80 00000100:00100000:0.0:1789395225.027562:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 41 00000100:00100000:0.0:1789395225.027574:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231874688:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:3.0:1789395225.028318:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395225.137346:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231874688:12345-192.168.203.54@tcp:4:dd.0 Request processed in 109763us (110285us total) trans 4294969974 rc 0/0 00000100:00100000:3.0:1789395225.137362:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 41 00002000:00100000:3.0:1789395225.137375:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3c9e1ad80 x1876316231874688/t4294969974(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:691/0 lens 488/448 e 0 to 0 dl 1789395236 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395225.137444:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9e1ad80 with x1876316231874688 ext(4194304->8388607) 00002000:00010000:3.0:1789395225.137452:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9e1ad80 00000100:00100000:3.0:1789395225.266110:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395225.266142:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239778688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395225.271707:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395225.280877:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778688 00000100:00100000:1.0:1789395225.280901:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778688 00000100:00100000:1.0:1789395225.281005:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:1.0:1789395225.281019:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239778688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789395225.281071:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:1.0:1789395225.281336:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239778688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 309us (9625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395225.281351:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:0.0:1789395225.281496:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239778688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395225.331784:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789395225.779966:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984111 is committed 00010000:00010000:3.0:1789395225.780320:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395225.780338:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395225.780347:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395225.780355:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395225.780361:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395225.780372:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395225.780417:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395225.780422:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395225.780428:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395225.780441:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d813 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395226.290125:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239779072:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290305:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239778816:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290468:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239779328:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290494:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290514:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239779840:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290537:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290555:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239780352:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290575:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290611:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789395226.290619:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239779200:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290657:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290676:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239779712:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290713:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239780224:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290732:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.290761:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779840 00000100:00100000:3.0:1789395226.290767:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779840 00000100:00100000:3.0:1789395226.290813:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780352 00000100:00100000:3.0:1789395226.290816:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780352 00000100:00100000:3.0:1789395226.290830:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779712 00000100:00100000:3.0:1789395226.290832:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779712 00000100:00100000:3.0:1789395226.290846:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780224 00000100:00100000:3.0:1789395226.290848:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780224 00000100:00100000:3.0:1789395226.290865:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1789395226.290872:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239779840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290925:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239779840:12345-0@lo:400:kworker.0 Request processed in 53us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.290932:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1789395226.290948:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789395226.290954:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239780352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.290981:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239780352:12345-0@lo:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.290987:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789395226.291010:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1789395226.291016:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239779712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.291045:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239779712:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.291050:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1789395226.291062:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789395226.291067:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239780224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.291093:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239780224:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.291098:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789395226.291120:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779200 00000100:00100000:3.0:1789395226.291124:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779200 00000100:00100000:3.0:1789395226.291150:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1789395226.291157:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.291262:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239778944:0@lo:400:kworker.0 00000100:00100000:1.0:1789395226.291406:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779328 00000100:00100000:1.0:1789395226.291412:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779328 00000100:00100000:1.0:1789395226.291462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:1.0:1789395226.291470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239779328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.299352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395226.299428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239779456:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299449:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239779200:12345-0@lo:400:kworker.0 Request processed in 8288us (8787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.299464:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1789395226.299474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395226.299496:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239779968:0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.299516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395226.299572:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778944 00000100:00100000:2.0:1789395226.299579:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778944 00000100:00100000:2.0:1789395226.299620:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779456 00000100:00100000:2.0:1789395226.299623:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779456 00000100:00100000:2.0:1789395226.299640:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779968 00000100:00100000:2.0:1789395226.299643:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779968 00000100:00100000:2.0:1789395226.299658:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1789395226.299665:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239778944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299714:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1789395226.299721:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239778944:12345-0@lo:400:kworker.0 Request processed in 55us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.299726:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239779456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.299732:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1789395226.299750:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1789395226.299758:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239779968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299773:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239779456:12345-0@lo:400:kworker.0 Request processed in 51us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.299780:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1789395226.299800:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239779968:12345-0@lo:400:kworker.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395226.299807:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00080000:3.0:1789395226.299808:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395226.299814:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395226.299817:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395226.299853:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239779200:0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.299855:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239778944:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299874:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239779712:0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.299877:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239779456:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299892:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239780224:0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.299897:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239779968:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299911:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239779840:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299926:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239780352:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.299978:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239778816 00000100:00100000:3.0:1789395226.299983:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239778816 00000100:00100000:3.0:1789395226.300011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1789395226.300017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239778816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.300121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239778816:12345-0@lo:400:kworker.0 Request processed in 104us (9741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.300127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1789395226.300665:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395226.300699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239779584:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.300720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779072 00000100:00100000:3.0:1789395226.300727:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779072 00000100:00100000:0.0:1789395226.300732:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395226.300752:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239780096:0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.300765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586 00000100:00100000:3.0:1789395226.300774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239779072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395226.300779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.300827:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239779072:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.300834:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586 00000100:00100000:3.0:1789395226.300866:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239779584 00000100:00100000:3.0:1789395226.300870:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239779584 00000100:00100000:3.0:1789395226.300898:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780096 00000100:00100000:3.0:1789395226.300901:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780096 00000100:00100000:3.0:1789395226.300921:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1789395226.300927:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239779584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.300955:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239779584:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.300961:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1789395226.300972:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1789395226.300978:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239780096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395226.301000:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239780096:12345-0@lo:400:kworker.0 Request processed in 23us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.301005:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00080000:3.0:1789395226.301018:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395226.309776:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239779328:12345-0@lo:400:kworker.0 Request processed in 18294us (19267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395226.309793:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:0.0:1789395226.319104:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239779072:0@lo:400:kworker.0 00000100:00100000:0.0:1789395226.319124:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239779584:0@lo:400:kworker.0 00000100:00100000:0.0:1789395226.319134:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239780096:0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.319303:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239778816:0@lo:400:kworker.0 00000100:00100000:2.0:1789395226.319319:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239779328:0@lo:400:kworker.0 00010000:00010000:2.0:1789395226.353988:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395226.360000:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395226.360519:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231874944 00000100:00100000:3.0:1789395226.360533:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231874944 00000100:00100000:3.0:1789395226.360675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5208 00000100:00100000:3.0:1789395226.360687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20807:x1876316231874944:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:3.0:1789395226.361257:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984112 00000100:00100000:3.0:1789395226.361603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20807:x1876316231874944:12345-192.168.203.54@tcp:35:dd.0 Request processed in 913us (1613us total) trans 4294984113 rc 0/0 00000100:00100000:3.0:1789395226.361628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5208 00000020:00080000:3.0:1789395226.361635:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789395226.365537:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395226.801624:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239780480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395226.801706:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395226.801759:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780480 00000100:00100000:1.0:1789395226.801777:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780480 00000100:00100000:1.0:1789395226.801844:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789395226.801856:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239780480:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395226.801860:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239780736:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395226.801883:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 160429760 pending 4218880 free 3919294464 avail 3687772160 00000100:00100000:0.0:1789395226.801962:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239780608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395226.802077:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239780864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395226.809505:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.809604:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780736 00000100:00100000:3.0:1789395226.809615:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780736 00000100:00100000:3.0:1789395226.809683:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789395226.809693:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239780736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789395226.809720:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 160429760 pending 4218880 free 3919294464 avail 3687772160 00000100:00100000:3.0:1789395226.810979:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239780736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1281us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.810990:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789395226.811059:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239780736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395226.811159:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239780992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395226.811193:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395226.811261:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780992 00000100:00100000:3.0:1789395226.811266:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780992 00000100:00100000:3.0:1789395226.811298:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789395226.811306:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239780992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789395226.811332:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395226.811368:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239780992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.811374:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789395226.811426:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239780992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395226.811886:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395226.812755:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239780480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10898us (11045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395226.812778:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789395226.812983:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239780480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395226.813134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395226.813239:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780864 00000100:00100000:0.0:1789395226.813257:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780864 00000100:00100000:3.0:1789395226.813367:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239780608 00000100:00100000:3.0:1789395226.813372:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239780608 00000100:00100000:3.0:1789395226.813430:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3587 00000100:00100000:3.0:1789395226.813438:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239780608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789395226.813508:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1789395226.813559:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239780608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395226.813566:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3587 00000100:00100000:0.0:1789395226.814877:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789395226.814896:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239780864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395226.814922:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789395226.814983:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239780864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395226.814991:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789395226.815101:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239780864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395226.818415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239780608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789395227.377676:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395227.397431:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395227.397713:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231875072 00000100:00100000:0.0:1789395227.397725:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231875072 00000100:00100000:0.0:1789395227.397803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23835 00000100:00100000:0.0:1789395227.397815:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20811:x1876316231875072:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395227.397841:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395227.397876:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d81a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210658a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395227.397955:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d821 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395227.397969:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395227.397981:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395227.398038:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:0.0:1789395227.398043:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395227.398067:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395227.398095:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d81a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210658a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395227.398114:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210658a expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395227.398124:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395227.398127:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789395227.398131:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10dc00, rc 0) 00000100:00100000:0.0:1789395227.398207:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20811:x1876316231875072:12345-192.168.203.54@tcp:101:dd.0 Request processed in 394us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395227.398215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23835 00000100:00100000:2.0:1789395227.411575:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395227.411837:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231875328 00000100:00100000:3.0:1789395227.412021:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231875328 00000100:00100000:3.0:1789395227.412101:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23836 00000100:00100000:3.0:1789395227.412111:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3d8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20811:x1876316231875328:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395227.412133:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395227.412136:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395227.412289:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d821 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210658a expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.412308:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395227.412314:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395227.412330:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d828 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106591 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.412873:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.412890:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.412900:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.413039:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.413049:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.413056:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.413120:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d83d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.413129:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.413135:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d83d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395227.413144:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 11419648 00010000:00010000:3.0:1789395227.414911:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414927:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414933:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414949:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414955:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395227.414960:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414969:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414985:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395227.414988:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395227.414993:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.414999:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d82f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415014:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415020:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415025:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415029:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395227.415032:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415037:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415044:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8b1d400) 00010000:00010000:3.0:1789395227.415046:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395227.415049:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415055:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d836 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415111:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d828 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106591 expref: 21 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415125:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d83d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106591 expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.415133:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395227.415136:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395227.415138:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b600, rc 0) 00000100:00100000:3.0:1789395227.415251:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3d8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20811:x1876316231875328:12345-192.168.203.54@tcp:101:dd.0 Request processed in 3140us (3684us total) trans 4294984114 rc 0/0 00000100:00100000:3.0:1789395227.415260:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23836 00000100:00100000:1.0:1789395227.420127:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395227.420266:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231875584 00000100:00100000:3.0:1789395227.420275:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231875584 00000100:00100000:3.0:1789395227.420337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23837 00000100:00100000:3.0:1789395227.420347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20811:x1876316231875584:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:3.0:1789395227.420638:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395227.420669:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d83d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106591 expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.420690:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395227.420696:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395227.421253:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.421270:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.421281:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395227.421320:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984115 00000004:00010000:3.0:1789395227.421343:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142eb7ab reply state 000000004a9b990e transno 4294984116 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.421355:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395227.421361:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395227.421364:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395227.421367:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395227.421728:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20811:x1876316231875584:12345-192.168.203.54@tcp:36:dd.0 Request processed in 1380us (1608us total) trans 4294984116 rc 0/0 00000100:00100000:3.0:1789395227.421735:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23837 00000020:00080000:3.0:1789395227.421740:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395227.568838:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395227.568967:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231875712 00000100:00100000:1.0:1789395227.568977:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231875712 00002000:00010000:1.0:1789395227.569043:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:1.0:1789395227.569048:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6509c00 with x1876316231875712 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395227.569062:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6509c00. 00000100:00100000:1.0:1789395227.569093:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 42 00000100:00100000:1.0:1789395227.569102:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231875712:12345-192.168.203.54@tcp:10:dd.0 00000100:00080000:0.0:1789395227.569473:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789395227.583700:0:22628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395227.583709:0:22628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395221 -> 1789395227 00002000:00010000:1.0:1789395227.583762:0:22628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395227.583766:0:22628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395221 -> 1789395227 00002000:00010000:1.0:1789395227.583769:0:22628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395227.583849:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231875712:12345-192.168.203.54@tcp:10:dd.0 Request processed in 14742us (15014us total) trans 4294969975 rc 0/0 00000100:00100000:1.0:1789395227.583860:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 42 00002000:00010000:1.0:1789395227.583866:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:1.0:1789395227.583870:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6509c00 with x1876316231875712 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395227.583879:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6509c00. 00010000:00010000:1.0:1789395228.401629:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395229.234854:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395229.234890:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395229.234920:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395229.234936:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395229.234966:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395229.234994:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876224 00000100:00100000:1.0:1789395229.234994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231875968 00000100:00100000:3.0:1789395229.235005:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876224 00000100:00100000:1.0:1789395229.235005:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231875968 00000100:00100000:1.0:1789395229.235063:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876096 00000100:00100000:1.0:1789395229.235067:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876096 00000100:00100000:2.0:1789395229.235082:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 737 00000100:00100000:0.0:1789395229.235118:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876352 00000100:00100000:0.0:1789395229.235122:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876352 00000100:00100000:2.0:1789395229.235152:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231875968:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395229.235238:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231875968:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 88us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395229.235246:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 737 00000100:00100000:2.0:1789395229.235364:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231875840 00000100:00100000:2.0:1789395229.235367:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231875840 00000100:00100000:2.0:1789395229.235425:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 473 00000100:00100000:2.0:1789395229.235440:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231875840:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395229.235476:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231875840:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 37us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395229.235482:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 473 00000100:00100000:1.0:1789395229.237201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 738 00000100:00100000:1.0:1789395229.237215:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231876096:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395229.237306:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231876096:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 96us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395229.237313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 738 00000100:00100000:3.0:1789395229.238369:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 503 00000100:00100000:3.0:1789395229.238380:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231876224:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395229.238471:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231876224:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 94us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395229.238477:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 503 00000100:00100000:0.0:1789395229.238926:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 504 00000100:00100000:0.0:1789395229.238935:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231876352:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395229.238975:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231876352:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 41us (4007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395229.238981:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 504 00000100:00080000:2.0:1789395229.240063:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395229.240070:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395229.240072:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789395229.240075:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789395229.251522:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395229.254714:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876480 00000100:00100000:0.0:1789395229.258427:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876480 00002000:00100000:0.0:1789395229.258516:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a4f6508380 x1876316231876480/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:695/0 lens 488/0 e 0 to 0 dl 1789395240 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395229.258529:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6508380 with x1876316231876480 ext(0->4194303) 00002000:00010000:0.0:1789395229.258534:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6508380 00000100:00100000:0.0:1789395229.258580:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 43 00000100:00100000:0.0:1789395229.258589:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231876480:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395229.364337:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231876480:12345-192.168.203.54@tcp:4:dd.0 Request processed in 105738us (112815us total) trans 4294969976 rc 0/0 00000100:00100000:2.0:1789395229.364351:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 43 00002000:00100000:2.0:1789395229.364364:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a4f6508380 x1876316231876480/t4294969976(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:695/0 lens 488/448 e 0 to 0 dl 1789395240 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395229.364380:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6508380 with x1876316231876480 ext(0->4194303) 00002000:00010000:2.0:1789395229.364417:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6508380 00010000:00010000:2.0:1789395229.425757:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395230.385634:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239781120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395230.385704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395230.385894:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781120 00000100:00100000:2.0:1789395230.385902:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781120 00000100:00100000:2.0:1789395230.385973:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588 00000100:00100000:2.0:1789395230.385983:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239781120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789395230.386023:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:2.0:1789395230.387111:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239781120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1123us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395230.387122:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588 00000100:00100000:1.0:1789395230.387194:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239781120:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395230.449642:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789395230.911269:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969976 is committed 00000100:00100000:3.0:1789395230.998133:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395230.998262:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876608 00000100:00100000:0.0:1789395230.998278:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876608 00002000:00100000:0.0:1789395230.998346:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3cadd1c00 x1876316231876608/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:696/0 lens 488/0 e 0 to 0 dl 1789395241 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395230.998357:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadd1c00 with x1876316231876608 ext(4194304->8388607) 00002000:00010000:0.0:1789395230.998364:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadd1c00 00000100:00100000:0.0:1789395230.998455:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 44 00000100:00100000:0.0:1789395230.998466:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231876608:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395231.084090:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231876608:12345-192.168.203.54@tcp:4:dd.0 Request processed in 85606us (85954us total) trans 4294969977 rc 0/0 00000100:00100000:2.0:1789395231.084110:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 44 00002000:00100000:2.0:1789395231.084130:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3cadd1c00 x1876316231876608/t4294969977(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:696/0 lens 488/448 e 0 to 0 dl 1789395241 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395231.084141:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadd1c00 with x1876316231876608 ext(4194304->8388607) 00002000:00010000:2.0:1789395231.084151:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadd1c00 00000100:00100000:1.0:1789395231.410277:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239781632:0@lo:400:kworker.0 00000100:00100000:1.0:1789395231.410372:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395231.410461:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239782144:0@lo:400:kworker.0 00000100:00100000:1.0:1789395231.410487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395231.410510:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239782656:0@lo:400:kworker.0 00000100:00100000:1.0:1789395231.410528:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395231.410650:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239781504:0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.410687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395231.410716:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239782016:0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.410738:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395231.410751:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239782528:0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.410769:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395231.410821:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782144 00000100:00100000:0.0:1789395231.410831:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782144 00000100:00100000:0.0:1789395231.410885:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782656 00000100:00100000:0.0:1789395231.410888:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782656 00000100:00100000:0.0:1789395231.410909:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1789395231.410920:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239782144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.410971:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239782144:12345-0@lo:400:kworker.0 Request processed in 53us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395231.410979:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1789395231.410998:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789395231.411004:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239782656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.411033:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239782656:12345-0@lo:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395231.411038:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1789395231.411236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239781248:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411275:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411310:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239781760:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411350:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239782272:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411407:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239782784:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411451:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789395231.411458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239781376:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411482:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411498:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239781888:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411538:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239782400:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411561:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.411592:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782272 00000100:00100000:3.0:1789395231.411597:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782272 00000100:00100000:3.0:1789395231.411628:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782784 00000100:00100000:3.0:1789395231.411632:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782784 00000100:00100000:3.0:1789395231.411656:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789395231.411664:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239782272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411818:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239782272:12345-0@lo:400:kworker.0 Request processed in 154us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.411827:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789395231.411844:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1789395231.411851:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239782784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.411882:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239782784:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.411888:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1789395231.411913:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781504 00000100:00100000:3.0:1789395231.411917:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781504 00000100:00100000:3.0:1789395231.411942:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781760 00000100:00100000:3.0:1789395231.411945:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781760 00000100:00100000:3.0:1789395231.411964:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589 00000100:00100000:3.0:1789395231.411970:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239781504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412006:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239781504:12345-0@lo:400:kworker.0 Request processed in 36us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412013:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589 00000100:00100000:3.0:1789395231.412026:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590 00000100:00100000:3.0:1789395231.412031:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239781760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412059:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239781760:12345-0@lo:400:kworker.0 Request processed in 28us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412065:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590 00000100:00100000:3.0:1789395231.412082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781632 00000100:00100000:3.0:1789395231.412087:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781632 00000100:00100000:3.0:1789395231.412107:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782016 00000100:00100000:3.0:1789395231.412109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782016 00000100:00100000:3.0:1789395231.412123:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782528 00000100:00100000:3.0:1789395231.412125:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782528 00000100:00100000:3.0:1789395231.412136:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781376 00000100:00100000:3.0:1789395231.412139:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781376 00000100:00100000:3.0:1789395231.412148:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781888 00000100:00100000:3.0:1789395231.412150:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781888 00000100:00100000:3.0:1789395231.412162:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782400 00000100:00100000:3.0:1789395231.412165:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782400 00000100:00100000:3.0:1789395231.412178:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1789395231.412185:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239781632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412226:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239781632:12345-0@lo:400:kworker.0 Request processed in 41us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412232:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1789395231.412244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1789395231.412250:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239782016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412274:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239782016:12345-0@lo:400:kworker.0 Request processed in 26us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412279:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1789395231.412289:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1789395231.412293:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239782528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412315:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239782528:12345-0@lo:400:kworker.0 Request processed in 22us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412321:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1789395231.412329:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1789395231.412334:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239781376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412358:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239781376:12345-0@lo:400:kworker.0 Request processed in 24us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1789395231.412375:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1789395231.412380:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239781888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412428:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239781888:12345-0@lo:400:kworker.0 Request processed in 48us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412433:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1789395231.412443:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1789395231.412449:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239782400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412472:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239782400:12345-0@lo:400:kworker.0 Request processed in 24us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.412478:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1789395231.412523:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239781376:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412533:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239781888:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412542:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239782400:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412552:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239781760:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412560:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239782272:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.412570:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239782784:0@lo:400:kworker.0 00000100:00080000:2.0:1789395231.412748:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395231.412754:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395231.412757:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395231.412760:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395231.412978:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239781632:0@lo:400:kworker.0 00000100:00100000:1.0:1789395231.412991:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239782144:0@lo:400:kworker.0 00000100:00100000:1.0:1789395231.413002:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239782656:0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.413086:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239781248 00000100:00100000:0.0:1789395231.413093:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239781248 00000100:00100000:0.0:1789395231.413142:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789395231.413149:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239781248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.413217:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239781248:12345-0@lo:400:kworker.0 Request processed in 58us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395231.413224:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789395231.413274:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239781504:0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.413287:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239782016:0@lo:400:kworker.0 00000100:00100000:0.0:1789395231.413299:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239782528:0@lo:400:kworker.0 00000100:00100000:3.0:1789395231.413493:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239781248:0@lo:400:kworker.0 00010000:00010000:2.0:1789395231.474215:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395231.921807:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789395231.921849:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239782912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395231.921947:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395231.924381:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239782912 00000100:00100000:2.0:1789395231.924413:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239782912 00000100:00100000:0.0:1789395231.926462:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239783040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395231.926535:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395231.928554:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789395231.928567:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239783168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395231.928629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395231.929903:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783040 00000100:00100000:1.0:1789395231.929912:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783040 00000100:00100000:3.0:1789395231.930917:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239783296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789395231.930941:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783168 00000100:00100000:2.0:1789395231.930949:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783168 00000100:00100000:3.0:1789395231.930989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395231.931089:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789395231.931090:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783296 00000100:00100000:0.0:1789395231.931096:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783296 00000100:00100000:3.0:1789395231.931103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239783424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395231.931547:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789395231.931558:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239782912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395231.931584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789395231.931589:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395231.931616:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783424 00000100:00100000:3.0:1789395231.931622:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783424 00000100:00100000:1.0:1789395231.931638:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239782912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (9691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395231.931644:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789395231.931662:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789395231.931668:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239783040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395231.931679:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 180224 granted 165811904 pending 4218880 free 3919294464 avail 3687772160 00000100:00100000:1.0:1789395231.931710:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239783040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395231.931716:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789395231.931903:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239783040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395231.933798:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591 00000100:00100000:3.0:1789395231.933810:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239783424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789395231.933848:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1789395231.933912:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239783424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395231.933920:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591 00000100:00100000:3.0:1789395231.933982:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239783424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395231.934001:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239782912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395231.939793:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789395231.939810:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239783168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395231.939838:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 180224 granted 165811904 pending 4218880 free 3919294464 avail 3687772160 00000100:00100000:2.0:1789395231.939913:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239783168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (11284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395231.939920:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789395231.943097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239783168:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789395231.943578:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984116 is committed 00010000:00010000:2.0:1789395231.943714:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395231.943727:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395231.943735:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395231.943741:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395231.943746:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395231.943754:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395231.943773:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395231.943776:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395231.943783:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395231.943790:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51ac00/0xff35729af316d84b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395231.946991:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789395231.947015:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239783296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395231.947046:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789395231.947148:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239783296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (16159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395231.947155:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789395231.947266:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239783296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395232.386100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395232.386216:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876736 00000100:00100000:2.0:1789395232.386227:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876736 00002000:00100000:2.0:1789395232.386312:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (8388608->12582911) req@ffff89a3cadb6a00 x1876316231876736/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:698/0 lens 488/0 e 0 to 0 dl 1789395243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395232.386322:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadb6a00 with x1876316231876736 ext(8388608->12582911) 00002000:00010000:2.0:1789395232.386329:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadb6a00 00000100:00100000:2.0:1789395232.386361:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 45 00000100:00100000:2.0:1789395232.386372:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231876736:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:3.0:1789395232.386910:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395232.392659:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395232.392827:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231876992 00000100:00100000:3.0:1789395232.392837:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231876992 00000100:00100000:3.0:1789395232.392906:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5209 00000100:00100000:3.0:1789395232.392916:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a4a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20811:x1876316231876992:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:3.0:1789395232.393172:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984117 00000100:00100000:3.0:1789395232.393338:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a4a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20811:x1876316231876992:12345-192.168.203.54@tcp:35:dd.0 Request processed in 423us (686us total) trans 4294984118 rc 0/0 00000100:00100000:3.0:1789395232.393346:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5209 00000020:00080000:3.0:1789395232.393351:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789395232.393747:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395232.466119:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2397:x1876316231876736:12345-192.168.203.54@tcp:4:dd.0 Request processed in 79730us (80009us total) trans 4294969978 rc 0/0 00000100:00100000:3.0:1789395232.466134:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 45 00002000:00100000:3.0:1789395232.466149:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (8388608->12582911) req@ffff89a3cadb6a00 x1876316231876736/t4294969978(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:698/0 lens 488/448 e 0 to 0 dl 1789395243 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395232.466160:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadb6a00 with x1876316231876736 ext(8388608->12582911) 00002000:00010000:3.0:1789395232.466166:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadb6a00 00010000:00010000:1.0:1789395232.497504:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395233.412234:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395233.412337:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231877120 00000100:00100000:3.0:1789395233.412348:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231877120 00000100:00100000:3.0:1789395233.412446:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23838 00000100:00100000:3.0:1789395233.412457:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20815:x1876316231877120:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395233.412491:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395233.412538:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106598 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395233.412613:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395233.412630:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395233.412643:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395233.413450:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395233.413455:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395233.413487:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395233.413520:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106598 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395233.413539:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106598 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395233.413549:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395233.413552:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395233.413556:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b400, rc 0) 00000100:00100000:3.0:1789395233.414264:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20815:x1876316231877120:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1804us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395233.414274:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23838 00000100:00100000:2.0:1789395233.425619:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395233.426583:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231877376 00000100:00100000:3.0:1789395233.426595:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231877376 00000100:00100000:2.0:1789395233.426791:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23839 00000100:00100000:2.0:1789395233.426802:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20815:x1876316231877376:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395233.426827:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395233.426831:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789395233.426858:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316d859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106598 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.426889:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395233.426894:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395233.426909:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d860 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210659f expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427059:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427077:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427088:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427102:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427110:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427116:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427167:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427175:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427181:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395233.427189:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 12804096 00010000:00010000:2.0:1789395233.427574:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427583:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427590:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427598:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427605:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dea00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395233.427609:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427617:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427626:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395233.427628:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395233.427632:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427638:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427649:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427656:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427662:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427666:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395233.427668:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427677:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427684:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395233.427686:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395233.427689:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427693:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3de400/0xff35729af316d86e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427731:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d860 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210659f expref: 21 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427743:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210659f expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.427749:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395233.427752:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395233.427754:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:2.0:1789395233.427844:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20815:x1876316231877376:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1044us (2235us total) trans 4294984119 rc 0/0 00000100:00100000:2.0:1789395233.427852:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23839 00000100:00100000:1.0:1789395233.437919:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395233.438701:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231877632 00000100:00100000:2.0:1789395233.438711:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231877632 00000100:00100000:2.0:1789395233.438780:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23840 00000100:00100000:2.0:1789395233.438791:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20815:x1876316231877632:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:2.0:1789395233.438855:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395233.438882:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210659f expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.438902:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395233.438908:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395233.439075:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.439090:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.439100:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395233.439139:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984120 00000004:00010000:2.0:1789395233.439159:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033663fe4 reply state 00000000fdc9dbc6 transno 4294984121 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.439170:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395233.439176:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395233.439178:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395233.439181:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395233.440836:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20815:x1876316231877632:12345-192.168.203.54@tcp:36:dd.0 Request processed in 2039us (2918us total) trans 4294984121 rc 0/0 00000100:00100000:2.0:1789395233.440848:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23840 00000020:00080000:2.0:1789395233.440855:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395233.455898:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395233.456014:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231877760 00000100:00100000:2.0:1789395233.456028:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231877760 00002000:00010000:2.0:1789395233.456084:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395233.456090:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6504000 with x1876316231877760 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395233.456104:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6504000. 00000100:00100000:2.0:1789395233.456153:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 46 00000100:00100000:2.0:1789395233.456165:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231877760:12345-192.168.203.54@tcp:10:dd.0 00002000:00010000:2.0:1789395233.478884:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395233.478897:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395227 -> 1789395233 00002000:00010000:2.0:1789395233.478901:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395233.478903:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395227 -> 1789395233 00002000:00010000:2.0:1789395233.478905:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395233.479072:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231877760:12345-192.168.203.54@tcp:10:dd.0 Request processed in 22901us (23183us total) trans 4294969979 rc 0/0 00000100:00100000:2.0:1789395233.479086:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 46 00002000:00010000:2.0:1789395233.479093:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395233.479097:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6504000 with x1876316231877760 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395233.479106:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6504000. 00010000:00010000:2.0:1789395233.521769:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395234.351360:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395234.351513:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231877888 00000100:00100000:2.0:1789395234.351528:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231877888 00000100:00100000:2.0:1789395234.351610:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 475 00000100:00100000:2.0:1789395234.351622:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231877888:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395234.351736:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231877888:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395234.351745:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 475 00000100:00100000:1.0:1789395234.360590:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395234.360646:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395234.360675:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395234.360713:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395234.360749:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878400 00000100:00100000:1.0:1789395234.360761:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878400 00000100:00100000:2.0:1789395234.360797:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878144 00000100:00100000:2.0:1789395234.360804:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878144 00000100:00100000:1.0:1789395234.360839:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878272 00000100:00100000:1.0:1789395234.360843:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878272 00000100:00100000:2.0:1789395234.360870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878016 00000100:00100000:2.0:1789395234.360875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878016 00000100:00100000:1.0:1789395234.360880:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 509 00000100:00100000:1.0:1789395234.360892:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231878400:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395234.360924:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 745 00000100:00100000:2.0:1789395234.360934:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231878144:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395234.360981:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231878400:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395234.360986:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231878144:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 47us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395234.360995:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 509 00000100:00100000:2.0:1789395234.361002:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 745 00000100:00100000:2.0:1789395234.361026:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 746 00000100:00100000:1.0:1789395234.361036:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 510 00000100:00100000:2.0:1789395234.361037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231878016:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395234.361055:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231878272:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395234.361074:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231878016:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395234.361082:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 746 00000100:00100000:1.0:1789395234.361109:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231878272:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 59us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395234.361119:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 510 00000100:00080000:2.0:1789395234.361143:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395234.361150:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789395234.361153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395234.361155:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789395234.547415:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395235.300730:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395235.300813:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878528 00000100:00100000:2.0:1789395235.300830:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878528 00002000:00100000:2.0:1789395235.300903:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3cadd0000 x1876316231878528/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:701/0 lens 488/0 e 0 to 0 dl 1789395246 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395235.300916:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadd0000 with x1876316231878528 ext(0->4194303) 00002000:00010000:2.0:1789395235.300978:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadd0000 00000100:00100000:2.0:1789395235.301074:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 47 00000100:00100000:2.0:1789395235.301087:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231878528:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395235.405090:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2398:x1876316231878528:12345-192.168.203.54@tcp:4:dd.0 Request processed in 103987us (104351us total) trans 4294969980 rc 0/0 00000100:00100000:0.0:1789395235.405110:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 47 00002000:00100000:0.0:1789395235.405129:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a3cadd0000 x1876316231878528/t4294969980(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:701/0 lens 488/448 e 0 to 0 dl 1789395246 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395235.405141:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadd0000 with x1876316231878528 ext(0->4194303) 00002000:00010000:0.0:1789395235.405149:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadd0000 00000100:00100000:2.0:1789395235.507339:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395235.507375:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239783552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395235.507533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395235.508291:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783552 00000100:00100000:0.0:1789395235.508303:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783552 00000100:00100000:0.0:1789395235.508380:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:0.0:1789395235.508414:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239783552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395235.508459:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395235.508537:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239783552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395235.508549:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:1.0:1789395235.508721:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239783552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395235.570569:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395236.530267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239783680:0@lo:400:kworker.0 00000100:00100000:1.0:1789395236.530368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395236.530431:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239783808:0@lo:400:kworker.0 00000100:00100000:2.0:1789395236.530589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395236.530611:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783680 00000100:00100000:0.0:1789395236.530622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783680 00000100:00100000:0.0:1789395236.530683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789395236.530695:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.530767:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239783680:12345-0@lo:400:kworker.0 Request processed in 74us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.530776:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1789395236.530879:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783808 00000100:00100000:1.0:1789395236.530885:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783808 00000100:00100000:1.0:1789395236.530919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1789395236.530926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239783808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.530985:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239783680:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.531033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239783936:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.531065:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395236.531110:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239783936 00000100:00100000:0.0:1789395236.531114:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239783936 00000100:00100000:0.0:1789395236.531139:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:0.0:1789395236.531159:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239783936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.531204:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239783936:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.531210:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:0.0:1789395236.531237:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239783936:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.533364:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239784064:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.533467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395236.533518:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239784576:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.533555:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239784192:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.533561:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395236.533586:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239785088:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.533621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.533652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.533699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239784704:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.533738:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395236.533739:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784192 00000100:00100000:0.0:1789395236.533748:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784192 00000100:00100000:3.0:1789395236.533765:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239785216:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.533797:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.533855:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784576 00000100:00100000:3.0:1789395236.533864:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784576 00000100:00100000:0.0:1789395236.533864:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1789395236.533882:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239784192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.533926:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785088 00000100:00100000:3.0:1789395236.533932:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785088 00000100:00100000:0.0:1789395236.533958:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239784192:12345-0@lo:400:kworker.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.533967:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1789395236.534012:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239784192:0@lo:400:kworker.0 00000100:00080000:0.0:1789395236.534147:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395236.534165:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784704 00000100:00100000:0.0:1789395236.534183:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784704 00000100:00100000:3.0:1789395236.534205:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785216 00000100:00100000:3.0:1789395236.534214:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785216 00000100:00100000:0.0:1789395236.534233:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1789395236.534247:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239784576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.534266:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1789395236.534283:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239785088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.534302:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239784576:12345-0@lo:400:kworker.0 Request processed in 57us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.534311:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1789395236.534335:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1789395236.534349:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239784704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.534358:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239785088:12345-0@lo:400:kworker.0 Request processed in 79us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395236.534368:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1789395236.534427:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1789395236.534434:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239784704:12345-0@lo:400:kworker.0 Request processed in 89us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395236.534442:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239785216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.534449:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1789395236.534500:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239785216:12345-0@lo:400:kworker.0 Request processed in 63us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.534504:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239784576:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.534518:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1789395236.534531:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239785088:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.534572:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239784704:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.534584:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239785216:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.534605:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784064 00000100:00100000:0.0:1789395236.534609:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784064 00000100:00080000:3.0:1789395236.535102:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395236.535109:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789395236.535304:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239784448:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.535348:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.535379:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239784960:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.535428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.535451:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789395236.535910:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784448 00000100:00100000:0.0:1789395236.535921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784448 00000100:00100000:0.0:1789395236.535973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784960 00000100:00100000:0.0:1789395236.535976:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784960 00000100:00100000:0.0:1789395236.535997:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1789395236.536004:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.536071:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239784064:12345-0@lo:400:kworker.0 Request processed in 67us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.536078:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1789395236.536096:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1789395236.536102:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239784448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.536134:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239784448:12345-0@lo:400:kworker.0 Request processed in 32us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.536140:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1789395236.536152:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789395236.536157:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239784960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.536195:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239784960:12345-0@lo:400:kworker.0 Request processed in 38us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395236.536201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789395236.536246:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239784064:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.536313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239784320:0@lo:400:kworker.0 00000100:00100000:1.0:1789395236.536406:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239783808:12345-0@lo:400:kworker.0 Request processed in 5477us (5815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395236.536416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00080000:1.0:1789395236.536606:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395236.537160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.537208:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239784832:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.537232:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395236.537265:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784320 00000100:00100000:3.0:1789395236.537272:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784320 00000100:00100000:3.0:1789395236.537327:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239784832 00000100:00100000:3.0:1789395236.537330:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239784832 00000100:00100000:3.0:1789395236.537355:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1789395236.537364:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239784320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.537436:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239784320:12345-0@lo:400:kworker.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395236.537444:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1789395236.538117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1789395236.538140:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239784832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.538196:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239784448:0@lo:400:kworker.0 00000100:00100000:3.0:1789395236.538218:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239784960:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.538248:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239784832:12345-0@lo:400:kworker.0 Request processed in 119us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395236.538262:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239784320:0@lo:400:kworker.0 00000100:00100000:2.0:1789395236.538328:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239783808:0@lo:400:kworker.0 00000100:00080000:2.0:1789395236.538409:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395236.538501:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239784832:0@lo:400:kworker.0 00000100:00100000:0.0:1789395236.540289:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00010000:00010000:1.0:1789395236.593716:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395236.684534:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395236.684714:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878656 00000100:00100000:3.0:1789395236.684727:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878656 00002000:00100000:3.0:1789395236.684811:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a4f650b480 x1876316231878656/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:702/0 lens 488/0 e 0 to 0 dl 1789395247 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395236.684825:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f650b480 with x1876316231878656 ext(4194304->8388607) 00002000:00010000:3.0:1789395236.684833:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f650b480 00000100:00100000:3.0:1789395236.684935:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 48 00000100:00100000:3.0:1789395236.684948:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231878656:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:2.0:1789395236.687367:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789395236.774126:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969980 is committed 00000100:00100000:0.0:1789395236.778236:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231878656:12345-192.168.203.54@tcp:4:dd.0 Request processed in 93280us (93707us total) trans 4294969981 rc 0/0 00000100:00100000:0.0:1789395236.778250:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 48 00002000:00100000:0.0:1789395236.778264:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a4f650b480 x1876316231878656/t4294969981(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:702/0 lens 488/448 e 0 to 0 dl 1789395247 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395236.778273:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f650b480 with x1876316231878656 ext(4194304->8388607) 00002000:00010000:0.0:1789395236.778280:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f650b480 00000100:00100000:3.0:1789395237.041949:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395237.041973:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239785344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395237.042042:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395237.042087:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785344 00000100:00100000:3.0:1789395237.042094:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785344 00000100:00100000:3.0:1789395237.042140:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789395237.042150:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239785344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789395237.042192:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395237.042233:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239785344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395237.042254:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789395237.042335:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239785344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395237.043237:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395237.043255:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239785472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789395237.043295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395237.043424:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785472 00000100:00100000:0.0:1789395237.043431:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785472 00000100:00100000:0.0:1789395237.043471:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1789395237.043480:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239785472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789395237.043497:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789395237.043540:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239785472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395237.043548:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789395237.043571:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239785472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395237.044101:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239785728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395237.044130:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395237.044149:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395237.044154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395237.044192:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395237.044192:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395237.044205:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239785856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395237.044224:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785600 00000100:00100000:0.0:1789395237.044229:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785600 00000100:00100000:1.0:1789395237.044240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395237.044269:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1789395237.044277:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239785600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395237.044305:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395237.044356:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239785600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395237.044363:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:2.0:1789395237.044523:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785728 00000100:00100000:2.0:1789395237.044528:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785728 00000100:00100000:2.0:1789395237.044553:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785856 00000100:00100000:2.0:1789395237.044556:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785856 00000100:00100000:2.0:1789395237.044573:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1789395237.044579:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239785728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395237.044594:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 178222784 pending 4218880 free 3915100160 avail 3683577856 00000100:00100000:2.0:1789395237.044622:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239785728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395237.044628:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1789395237.044640:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789395237.044645:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239785856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395237.044654:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 178222784 pending 4218880 free 3915100160 avail 3683577856 00000100:00100000:2.0:1789395237.044678:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239785856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395237.044684:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789395237.044873:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395237.044886:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239785728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395237.044917:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239785856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789395237.617865:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789395238.070850:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984121 is committed 00010000:00010000:3.0:1789395238.070997:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395238.071010:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395238.071017:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395238.071024:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395238.071028:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395238.071036:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395238.071056:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395238.071059:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395238.071065:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395238.071072:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d883 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395238.426440:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395238.427075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231878912 00000100:00100000:1.0:1789395238.427086:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231878912 00000100:00100000:1.0:1789395238.427172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5210 00000100:00100000:1.0:1789395238.427184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20815:x1876316231878912:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:1.0:1789395238.427446:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984122 00000100:00100000:1.0:1789395238.427556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20815:x1876316231878912:12345-192.168.203.54@tcp:35:dd.0 Request processed in 373us (1177us total) trans 4294984123 rc 0/0 00000100:00100000:1.0:1789395238.427563:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5210 00000020:00080000:1.0:1789395238.427568:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789395238.427640:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789395238.641679:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395239.457926:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395239.458051:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231879040 00000100:00100000:1.0:1789395239.458065:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231879040 00000100:00100000:1.0:1789395239.458158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23841 00000100:00100000:1.0:1789395239.458169:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20819:x1876316231879040:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395239.458197:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395239.458220:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d88a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.458283:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.458300:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.458314:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395239.458357:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:1.0:1789395239.458361:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395239.458381:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.458436:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d88a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065a6 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.458456:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065a6 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.458464:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395239.458467:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395239.458471:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56c00, rc 0) 00000100:00100000:1.0:1789395239.458672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20819:x1876316231879040:12345-192.168.203.54@tcp:101:dd.0 Request processed in 504us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395239.458680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23841 00000100:00100000:0.0:1789395239.464061:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395239.464250:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231879296 00000100:00100000:3.0:1789395239.464260:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231879296 00000100:00100000:3.0:1789395239.464373:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23842 00000100:00100000:3.0:1789395239.464412:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20819:x1876316231879296:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395239.464436:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395239.464440:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395239.464466:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065a6 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464487:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395239.464493:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395239.464507:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d898 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065ad expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464617:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464633:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464643:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464657:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464664:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464671:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464728:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d8ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464738:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d8ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464745:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d8ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395239.464754:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 12533760 00010000:00010000:3.0:1789395239.464836:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464844:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464850:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464857:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464863:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395239.464868:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464876:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464900:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395239.464903:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395239.464907:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464914:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d89f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464924:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464929:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464935:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464940:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395239.464942:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464948:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464954:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a3c8b1d900) 00010000:00010000:3.0:1789395239.464957:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395239.464960:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.464965:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d8a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.465010:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d898 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065ad expref: 21 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.465023:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d8ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065ad expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395239.465031:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:3.0:1789395239.465033:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395239.465035:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b000, rc 0) 00000100:00100000:3.0:1789395239.465098:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20819:x1876316231879296:12345-192.168.203.54@tcp:101:dd.0 Request processed in 715us (1046us total) trans 4294984124 rc 0/0 00000100:00100000:3.0:1789395239.465106:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23842 00000100:00100000:3.0:1789395239.474294:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395239.474331:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395239.474419:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231879680 00000100:00100000:1.0:1789395239.474428:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231879680 00000100:00100000:1.0:1789395239.474491:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 515 00000100:00100000:1.0:1789395239.474502:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231879680:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395239.474568:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231879680:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395239.474576:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 515 00000100:00080000:2.0:1789395239.480478:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395239.480599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231879424 00000100:00100000:0.0:1789395239.480611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231879424 00000100:00100000:0.0:1789395239.480673:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 477 00000100:00100000:0.0:1789395239.480683:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231879424:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395239.480758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2395:x1876316231879424:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 75us (6472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395239.480766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 477 00000100:00100000:1.0:1789395239.488171:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395239.488216:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231879552 00000100:00100000:1.0:1789395239.488226:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231879552 00000100:00080000:2.0:1789395239.488261:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395239.488299:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 753 00000100:00100000:1.0:1789395239.488309:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231879552:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395239.488376:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231879552:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395239.488411:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 753 00000100:00100000:1.0:1789395239.488476:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395239.488527:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395239.488543:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880064 00000100:00100000:1.0:1789395239.488546:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880064 00000100:00100000:1.0:1789395239.488581:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23843 00000100:00100000:1.0:1789395239.488589:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20819:x1876316231880064:12345-192.168.203.54@tcp:36:dd.0 00000100:00100000:2.0:1789395239.488590:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231879808 00000100:00100000:2.0:1789395239.488594:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231879808 00000100:00100000:2.0:1789395239.488626:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 516 00000100:00100000:2.0:1789395239.488632:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231879808:12345-192.168.203.54@tcp:400:kworker.0 00010000:00010000:1.0:1789395239.488637:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789395239.488660:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231879808:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395239.488665:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 516 00010000:00010000:1.0:1789395239.488665:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316d8ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065ad expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789395239.488681:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789395239.488681:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:1.0:1789395239.488687:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395239.494679:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.494703:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.494716:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395239.494770:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984125 00000004:00010000:1.0:1789395239.494793:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000adc8cce reply state 000000002bffd9e5 transno 4294984126 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.494806:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395239.494814:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:1.0:1789395239.494817:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395239.494821:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395239.496540:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:20819:x1876316231880064:12345-192.168.203.54@tcp:36:dd.0 Request processed in 7940us (8001us total) trans 4294984126 rc 0/0 00000100:00100000:1.0:1789395239.496550:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23843 00000020:00080000:1.0:1789395239.496557:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395239.658292:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395239.658538:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880192 00000100:00100000:2.0:1789395239.658548:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880192 00002000:00010000:2.0:1789395239.658591:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395239.658596:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadb5180 with x1876316231880192 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395239.658610:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadb5180. 00000100:00100000:2.0:1789395239.658643:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 49 00000100:00100000:2.0:1789395239.658653:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231880192:12345-192.168.203.54@tcp:10:dd.0 00010000:00010000:3.0:1789395239.676494:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789395239.683796:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395239.683805:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1789395233 -> 1789395239 00002000:00010000:2.0:1789395239.683808:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395239.683810:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1789395233 -> 1789395239 00002000:00010000:2.0:1789395239.683814:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395239.683900:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231880192:12345-192.168.203.54@tcp:10:dd.0 Request processed in 25243us (25610us total) trans 4294969982 rc 0/0 00000100:00100000:2.0:1789395239.683911:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 49 00002000:00010000:2.0:1789395239.683917:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1789395239.683921:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadb5180 with x1876316231880192 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395239.683929:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadb5180. 00000100:00100000:2.0:1789395240.626895:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789395240.626919:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239785984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395240.626991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395240.627132:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239785984 00000100:00100000:0.0:1789395240.627152:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239785984 00000100:00100000:0.0:1789395240.627205:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:0.0:1789395240.627214:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239785984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395240.627250:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395240.627300:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239785984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395240.627308:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:3.0:1789395240.627471:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239785984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789395240.690561:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395241.215002:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395241.215124:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880320 00000100:00100000:0.0:1789395241.215143:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880320 00002000:00100000:0.0:1789395241.215210:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a5009d8380 x1876316231880320/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:707/0 lens 488/0 e 0 to 0 dl 1789395252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395241.215227:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a5009d8380 with x1876316231880320 ext(0->4194303) 00002000:00010000:0.0:1789395241.215242:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a5009d8380 00000100:00100000:0.0:1789395241.215274:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 50 00000100:00100000:0.0:1789395241.215283:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231880320:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:2.0:1789395241.215401:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395241.294041:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2397:x1876316231880320:12345-192.168.203.54@tcp:4:dd.0 Request processed in 78740us (79031us total) trans 4294969983 rc 0/0 00000100:00100000:2.0:1789395241.294060:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 50 00002000:00100000:2.0:1789395241.294078:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff89a5009d8380 x1876316231880320/t4294969983(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:707/0 lens 488/448 e 0 to 0 dl 1789395252 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395241.294089:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a5009d8380 with x1876316231880320 ext(0->4194303) 00002000:00010000:2.0:1789395241.294097:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a5009d8380 00000100:00100000:3.0:1789395241.649805:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239786496:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.649805:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239786368:0@lo:400:kworker.0 00000100:00100000:3.0:1789395241.649880:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395241.649944:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239787008:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.649967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395241.649985:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395241.650025:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239786880:0@lo:400:kworker.0 00000100:00100000:3.0:1789395241.650033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239787520:0@lo:400:kworker.0 00000100:00100000:3.0:1789395241.650054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395241.650089:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787008 00000100:00100000:3.0:1789395241.650096:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787008 00000100:00100000:2.0:1789395241.650155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395241.650164:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787520 00000100:00100000:3.0:1789395241.650169:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787520 00000100:00100000:2.0:1789395241.650194:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239787392:0@lo:400:kworker.0 00000100:00100000:3.0:1789395241.650202:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1789395241.650215:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239787008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.650236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395241.650291:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239787008:12345-0@lo:400:kworker.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395241.650303:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789395241.650308:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786496 00000100:00100000:2.0:1789395241.650318:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786496 00000100:00100000:3.0:1789395241.650330:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1789395241.650344:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239787520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.650378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786880 00000100:00100000:3.0:1789395241.650381:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239787520:12345-0@lo:400:kworker.0 Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395241.650416:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786880 00000100:00100000:3.0:1789395241.650429:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789395241.650455:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787392 00000100:00080000:3.0:1789395241.650458:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395241.650461:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787392 00000100:00080000:3.0:1789395241.650465:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395241.650470:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789395241.650476:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395241.650500:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1789395241.650510:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239786496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395241.650539:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876316239786496:12345-0@lo:400:kworker.0 Request processed in 32us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395241.650607:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239786240:0@lo:400:kworker.0 00000100:00100000:1.0:1789395241.650609:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239786112:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.650676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395241.650678:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395241.650708:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239786752:0@lo:400:kworker.0 00000100:00100000:1.0:1789395241.650727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239786624:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.650750:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395241.650774:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395241.650780:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239787264:0@lo:400:kworker.0 00000100:00100000:1.0:1789395241.650809:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239787136:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.650822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395241.650847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395241.650873:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787136 00000100:00100000:1.0:1789395241.650877:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239787648:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.650881:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787136 00000100:00100000:1.0:1789395241.650905:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395241.650943:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787648 00000100:00100000:0.0:1789395241.650949:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787648 00000100:00100000:1.0:1789395241.650964:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1789395241.650977:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239787136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.650992:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789395241.651007:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239787648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395241.651027:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239787136:12345-0@lo:400:kworker.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395241.651036:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1789395241.651073:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786240 00000100:00100000:0.0:1789395241.651081:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239787648:12345-0@lo:400:kworker.0 Request processed in 74us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395241.651083:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786240 00000100:00100000:0.0:1789395241.651097:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789395241.651126:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786112 00000100:00100000:0.0:1789395241.651141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786112 00000100:00100000:0.0:1789395241.651172:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789395241.651179:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239786112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651212:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239786112:12345-0@lo:400:kworker.0 Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395241.651218:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789395241.651252:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786368 00000100:00100000:0.0:1789395241.651256:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786368 00000100:00100000:0.0:1789395241.651283:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786624 00000100:00100000:0.0:1789395241.651286:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786624 00000100:00100000:0.0:1789395241.651307:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597 00000100:00100000:0.0:1789395241.651314:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239786368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651355:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239786368:12345-0@lo:400:kworker.0 Request processed in 42us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395241.651362:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597 00000100:00100000:0.0:1789395241.651375:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598 00000100:00100000:0.0:1789395241.651381:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239786624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651431:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239786624:12345-0@lo:400:kworker.0 Request processed in 50us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395241.651437:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598 00000100:00080000:0.0:1789395241.651462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395241.651467:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395241.651524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239786368:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651606:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239786112:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651619:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239786624:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651633:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239787136:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651644:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239787648:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.651689:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239786752 00000100:00100000:0.0:1789395241.651693:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239786752 00000100:00100000:2.0:1789395241.652185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1789395241.652199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239786880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652255:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239786880:12345-0@lo:400:kworker.0 Request processed in 62us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395241.652263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1789395241.652281:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787264 00000100:00100000:2.0:1789395241.652286:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787264 00000100:00100000:2.0:1789395241.652309:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1789395241.652316:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239787392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239787392:12345-0@lo:400:kworker.0 Request processed in 33us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395241.652356:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1789395241.652367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1789395241.652373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239787264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652421:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239787264:12345-0@lo:400:kworker.0 Request processed in 48us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395241.652427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1789395241.652476:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239787264:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652506:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239786880:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652520:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239787392:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652568:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876316239786496:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652583:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239787008:0@lo:400:kworker.0 00000100:00100000:2.0:1789395241.652597:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239787520:0@lo:400:kworker.0 00000100:00100000:3.0:1789395241.654720:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00080000:2.0:1789395241.655048:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395241.656265:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1789395241.656288:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239786240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395241.656424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239786240:12345-0@lo:400:kworker.0 Request processed in 148us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395241.656433:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1789395241.656663:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239786240:0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.661757:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1789395241.661791:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239786752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395241.662672:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239786752:12345-0@lo:400:kworker.0 Request processed in 896us (11919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395241.662684:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1789395241.662833:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239786752:0@lo:400:kworker.0 00010000:00010000:2.0:1789395241.716052:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395242.161892:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239787776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395242.161968:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395242.162067:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789395242.162079:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239788160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395242.162118:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395242.162243:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787776 00000100:00100000:3.0:1789395242.162251:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787776 00000100:00100000:3.0:1789395242.162312:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788160 00000100:00100000:3.0:1789395242.162316:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788160 00000100:00100000:3.0:1789395242.162346:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1789395242.162357:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239787776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789395242.162422:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 180224 granted 182490816 pending 8437760 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395242.162441:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1789395242.162466:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239788160:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789395242.162481:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239787776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395242.162489:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00002000:00000024:2.0:1789395242.162492:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 180224 granted 182490816 pending 8437760 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395242.162572:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239788032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789395242.162578:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239788160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395242.162591:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1789395242.162635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395242.162638:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239788288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395242.162663:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395242.162676:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239787904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395242.162687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395242.162744:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239788160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395242.162762:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239787776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395242.162816:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788032 00000100:00100000:2.0:1789395242.162822:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788032 00000100:00100000:3.0:1789395242.162842:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395242.162870:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239787904 00000100:00100000:2.0:1789395242.162875:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239787904 00000100:00100000:2.0:1789395242.162903:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789395242.162916:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239788032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395242.162917:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1789395242.162937:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239787904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395242.162948:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00002000:00000024:3.0:1789395242.162954:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395242.163016:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239788032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395242.163025:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789395242.163075:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788288 00000100:00100000:0.0:1789395242.163082:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788288 00000100:00100000:0.0:1789395242.163118:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:0.0:1789395242.163137:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239788288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395242.163165:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395242.163207:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239788288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395242.163214:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:0.0:1789395242.163264:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239788288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395242.163334:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239787904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 404us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395242.163341:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789395242.168530:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239787904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395242.168562:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239788032:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1789395242.678354:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969983 is committed 00010000:00010000:2.0:1789395242.737886:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395242.805887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395242.806006:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880448 00000100:00100000:0.0:1789395242.806019:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880448 00002000:00100000:0.0:1789395242.806089:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3c98f0a80 x1876316231880448/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:708/0 lens 488/0 e 0 to 0 dl 1789395253 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395242.806103:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c98f0a80 with x1876316231880448 ext(4194304->8388607) 00002000:00010000:0.0:1789395242.806110:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c98f0a80 00000100:00100000:0.0:1789395242.806165:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 51 00000100:00100000:0.0:1789395242.806177:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231880448:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395242.868319:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231880448:12345-192.168.203.54@tcp:4:dd.0 Request processed in 62128us (62431us total) trans 4294969984 rc 0/0 00000100:00100000:0.0:1789395242.868338:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 51 00002000:00100000:0.0:1789395242.868355:0:22628:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->8388607) req@ffff89a3c98f0a80 x1876316231880448/t4294969984(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:708/0 lens 488/448 e 0 to 0 dl 1789395253 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395242.868367:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c98f0a80 with x1876316231880448 ext(4194304->8388607) 00002000:00010000:0.0:1789395242.868374:0:22628:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c98f0a80 00000001:00080000:0.0:1789395243.701569:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984126 is committed 00010000:00010000:1.0:1789395243.701656:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395243.701672:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395243.701686:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395243.701693:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395243.701698:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395243.701708:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395243.701731:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:1.0:1789395243.701735:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395243.701741:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395243.701757:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56a00/0xff35729af316d8bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395243.761918:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395244.400242:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395244.400431:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880576 00000100:00100000:0.0:1789395244.400445:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880576 00002000:00100000:0.0:1789395244.400562:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (8388608->12582911) req@ffff89a4f6584700 x1876316231880576/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:710/0 lens 488/0 e 0 to 0 dl 1789395255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395244.400575:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6584700 with x1876316231880576 ext(8388608->12582911) 00002000:00010000:0.0:1789395244.400582:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6584700 00000100:00100000:0.0:1789395244.400626:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 52 00000100:00100000:0.0:1789395244.400637:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231880576:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:2.0:1789395244.404842:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395244.455256:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395244.455806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880832 00000100:00100000:1.0:1789395244.455817:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880832 00000100:00100000:1.0:1789395244.455943:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5211 00000100:00100000:1.0:1789395244.455954:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:20819:x1876316231880832:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:1.0:1789395244.456261:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984127 00000100:00100000:1.0:1789395244.458129:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20819:x1876316231880832:12345-192.168.203.54@tcp:35:dd.0 Request processed in 2156us (2861us total) trans 4294984128 rc 0/0 00000100:00100000:1.0:1789395244.458144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5211 00000020:00080000:1.0:1789395244.458152:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1789395244.458352:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395244.465874:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2397:x1876316231880576:12345-192.168.203.54@tcp:4:dd.0 Request processed in 65229us (65637us total) trans 4294969985 rc 0/0 00000100:00100000:3.0:1789395244.465890:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 52 00002000:00100000:3.0:1789395244.465903:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (8388608->12582911) req@ffff89a4f6584700 x1876316231880576/t4294969985(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:710/0 lens 488/448 e 0 to 0 dl 1789395255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395244.465913:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f6584700 with x1876316231880576 ext(8388608->12582911) 00002000:00010000:3.0:1789395244.465921:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4f6584700 00000100:00100000:2.0:1789395244.592719:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395244.592821:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395244.592903:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395244.593018:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881088 00000100:00100000:3.0:1789395244.593028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881088 00000100:00100000:3.0:1789395244.593103:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 760 00000100:00100000:3.0:1789395244.593128:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231881088:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395244.593202:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231881088:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 80us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395244.593210:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 760 00000100:00080000:2.0:1789395244.593556:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789395244.593705:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881216 00000100:00100000:1.0:1789395244.593711:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881216 00000100:00100000:3.0:1789395244.593878:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 521 00000100:00100000:3.0:1789395244.593888:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231881216:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395244.593938:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231881216:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 52us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395244.593945:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 521 00000100:00100000:0.0:1789395244.594131:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231880960 00000100:00100000:0.0:1789395244.594137:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231880960 00000100:00100000:0.0:1789395244.594175:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 479 00000100:00100000:0.0:1789395244.594183:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231880960:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395244.594226:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231880960:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 44us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395244.594233:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 479 00000100:00080000:2.0:1789395244.594474:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789395244.789624:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395245.472312:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395245.472417:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881344 00000100:00100000:1.0:1789395245.472429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881344 00000100:00100000:1.0:1789395245.472500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23844 00000100:00100000:1.0:1789395245.472510:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20823:x1876316231881344:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:1.0:1789395245.472537:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395245.472561:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d8c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065b4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.472638:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d8c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.472653:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.472668:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395245.472711:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:1.0:1789395245.472716:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395245.472740:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.472764:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d8c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065b4 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.472781:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065b4 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.472791:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395245.472794:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395245.472798:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57200, rc 0) 00000100:00100000:1.0:1789395245.472857:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20823:x1876316231881344:12345-192.168.203.54@tcp:101:rm.0 Request processed in 348us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395245.472864:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23844 00000100:00100000:3.0:1789395245.482118:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395245.482323:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881472 00000100:00100000:2.0:1789395245.482332:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881472 00000100:00100000:2.0:1789395245.482496:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23845 00000100:00100000:2.0:1789395245.482508:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20823:x1876316231881472:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1789395245.482528:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395245.482550:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065bb expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482612:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482629:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482641:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482660:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482668:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482674:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482746:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482755:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482762:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395245.482801:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 12926976 00000004:00200000:2.0:1789395245.482806:0:21735:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395245.482823:0:21735:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482835:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482845:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482851:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482862:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482868:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395245.482872:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482880:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482891:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395245.482894:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395245.482900:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482907:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482921:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482927:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482933:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482938:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395245.482942:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482953:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482960:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395245.482963:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395245.482966:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.482972:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.483002:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065bb expref: 21 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.483016:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065bb expref: 20 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.483023:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395245.483025:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395245.483028:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395245.483094:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20823:x1876316231881472:12345-192.168.203.54@tcp:101:rm.0 Request processed in 588us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395245.483112:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23845 00000100:00100000:3.0:1789395245.491461:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395245.492742:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881728 00000100:00100000:2.0:1789395245.492758:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881728 00000100:00100000:2.0:1789395245.492877:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23846 00000100:00100000:2.0:1789395245.492888:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:20823:x1876316231881728:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1789395245.492946:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789395245.492985:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d6fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210653d expref: 20 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493018:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d8e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065bb expref: 19 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493032:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57e00/0xff35729af316d6ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106536 expref: 18 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493044:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a3c8812200) 00010000:00010000:2.0:1789395245.493061:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d8c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065b4 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493069:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395245.493072:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395245.493093:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493117:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493127:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493142:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493149:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493156:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493227:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493236:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.493243:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789395245.494746:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2552, 64 off171520 00000004:00080000:2.0:1789395245.494758:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696548372518ns, next at 697548370124ns, rc = 0 00010000:00010000:2.0:1789395245.494813:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494828:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494837:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494844:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494850:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494855:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494884:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789395245.494903:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494910:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494916:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494921:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395245.494922:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395245.494926:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494927:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494933:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395245.494935:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494936:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494945:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494946:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395245.494949:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789395245.494954:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494961:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d8fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494963:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:1.0:1789395245.494966:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395245.494969:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494973:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d901 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494978:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494983:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395245.494986:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395245.494988:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395245.494990:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395245.494993:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.494999:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.495004:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395245.495007:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.495013:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.495021:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395245.495023:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395245.495026:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.495032:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d8ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395245.495041:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a9ac49c reply state 00000000ee003f86 transno 4294984129 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.495052:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395245.495058:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395245.495060:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395245.495063:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395245.495157:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20823:x1876316231881728:12345-192.168.203.54@tcp:36:rm.0 Request processed in 2269us (3700us total) trans 4294984129 rc 0/0 00000100:00100000:2.0:1789395245.495167:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23846 00000100:00100000:2.0:1789395245.745848:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239788416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395245.745935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395245.746147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788416 00000100:00100000:0.0:1789395245.746156:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788416 00000100:00100000:0.0:1789395245.746218:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:0.0:1789395245.746227:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239788416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395245.746266:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395245.746322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239788416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395245.746329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00100000:1.0:1789395245.746507:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239788416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395245.809750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395246.771355:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239788928:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.771582:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239788800:0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.772576:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239788544:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.775772:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395246.775840:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239789312:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.775879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395246.775901:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239789824:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.775922:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395246.775955:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789395246.775962:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239788672:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.775985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395246.776002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239789184:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776021:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395246.776042:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239789696:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776061:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395246.776107:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788800 00000100:00100000:0.0:1789395246.776115:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788800 00000100:00100000:0.0:1789395246.776158:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:0.0:1789395246.776166:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776223:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239788800:12345-0@lo:400:kworker.0 Request processed in 57us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395246.776230:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00100000:0.0:1789395246.776254:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789312 00000100:00100000:0.0:1789395246.776258:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789312 00000100:00100000:0.0:1789395246.776293:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789824 00000100:00100000:0.0:1789395246.776297:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789824 00000100:00100000:0.0:1789395246.776311:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788672 00000100:00100000:0.0:1789395246.776313:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788672 00000100:00100000:0.0:1789395246.776322:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789184 00000100:00100000:0.0:1789395246.776325:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789184 00000100:00100000:0.0:1789395246.776335:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789696 00000100:00100000:0.0:1789395246.776337:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789696 00000100:00100000:0.0:1789395246.776350:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1789395246.776356:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239789312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776406:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239789312:12345-0@lo:400:kworker.0 Request processed in 50us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395246.776412:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1789395246.776745:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1789395246.776754:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239789824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776786:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239789824:12345-0@lo:400:kworker.0 Request processed in 34us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395246.776792:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1789395246.776805:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1789395246.776811:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776837:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876316239788672:12345-0@lo:400:kworker.0 Request processed in 27us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395246.776844:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1789395246.776855:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1789395246.776861:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239789184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.776889:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876316239789184:12345-0@lo:400:kworker.0 Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395246.776898:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1789395246.776908:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1789395246.776914:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239789696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.777000:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876316239789696:12345-0@lo:400:kworker.0 Request processed in 86us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395246.777009:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1789395246.777052:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876316239788672:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.777061:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1876316239789184:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.777209:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1876316239789696:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.777224:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239788800:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.777233:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239789312:0@lo:400:kworker.0 00000100:00100000:0.0:1789395246.777241:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239789824:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.778020:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395246.778064:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239789440:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.778112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395246.778136:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239789952:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.778156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395246.778196:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788928 00000100:00100000:1.0:1789395246.778202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788928 00000100:00100000:1.0:1789395246.778237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1789395246.778243:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.778378:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395246.778418:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239789056:0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.778443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395246.778460:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239789568:0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.778478:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395246.778493:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239790080:0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.778513:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789395246.778549:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789395246.778554:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395246.778568:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789440 00000100:00100000:2.0:1789395246.778572:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789440 00000100:00100000:2.0:1789395246.778603:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789952 00000100:00100000:2.0:1789395246.778606:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789952 00000100:00100000:2.0:1789395246.778622:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789568 00000100:00100000:2.0:1789395246.778624:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789568 00000100:00100000:2.0:1789395246.778640:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790080 00000100:00100000:2.0:1789395246.778643:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790080 00000100:00100000:2.0:1789395246.778661:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789395246.778666:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239789440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.778697:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239789440:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395246.778707:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789395246.778721:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1789395246.778727:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239789952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.778750:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239789952:12345-0@lo:400:kworker.0 Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395246.778756:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1789395246.778945:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239788928:12345-0@lo:400:kworker.0 Request processed in 43us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395246.778954:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1789395246.778978:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789395246.778986:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239789568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.779022:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239789568:12345-0@lo:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395246.779028:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789395246.779040:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1789395246.779045:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239790080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.779069:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239790080:12345-0@lo:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395246.779075:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1789395246.779122:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239788928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.779134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239789440:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.779144:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239789952:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.779229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239789056 00000100:00100000:1.0:1789395246.779233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239789056 00000100:00100000:1.0:1789395246.779259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:1.0:1789395246.779265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239789056:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789395246.779447:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395246.779451:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395246.779484:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239789568:0@lo:400:kworker.0 00000100:00100000:2.0:1789395246.779495:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239790080:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.780034:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239789056:12345-0@lo:400:kworker.0 Request processed in 766us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395246.780042:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00100000:1.0:1789395246.780067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239788544 00000100:00100000:1.0:1789395246.780071:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239788544 00000100:00100000:1.0:1789395246.780114:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1789395246.780122:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239788544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.780155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239788544:12345-0@lo:400:kworker.0 Request processed in 35us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395246.780160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1789395246.780196:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239788544:0@lo:400:kworker.0 00000100:00100000:1.0:1789395246.780207:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239789056:0@lo:400:kworker.0 00010000:00010000:3.0:1789395246.844476:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789395247.281763:0:8904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698335375547ns, next at 699335372280ns, rc = 0 00000100:00100000:0.0:1789395247.281821:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239790336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395247.281887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395247.281950:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395247.281958:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239790208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395247.281984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395247.282045:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790336 00000100:00100000:0.0:1789395247.282053:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790336 00000100:00100000:0.0:1789395247.282108:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790208 00000100:00100000:0.0:1789395247.282112:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790208 00000100:00100000:0.0:1789395247.282137:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1789395247.282148:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239790336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395247.282180:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 190928576 pending 8437760 free 3910905856 avail 3679383552 00000100:00100000:0.0:1789395247.282233:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239790336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395247.282241:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1789395247.282264:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1789395247.282272:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239790208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789395247.282292:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789395247.282326:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239790208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395247.282332:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1789395247.282418:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239790208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395247.282440:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239790336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395247.282530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239790464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395247.282563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395247.282586:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789395247.282592:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239790592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395247.282615:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395247.282641:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790464 00000100:00100000:0.0:1789395247.282645:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790464 00000100:00100000:0.0:1789395247.282672:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603 00000100:00100000:0.0:1789395247.282679:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239790464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395247.282704:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395247.282742:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239790464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395247.282753:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603 00000100:00100000:0.0:1789395247.282794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239790464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395247.282816:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790592 00000100:00100000:0.0:1789395247.282819:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790592 00000100:00100000:0.0:1789395247.282843:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1789395247.282850:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239790592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395247.282861:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 190928576 pending 8437760 free 3910905856 avail 3679383552 00000100:00100000:0.0:1789395247.282899:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239790592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395247.282904:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1789395247.282975:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239790592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395247.283962:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239790720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395247.284007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395247.284050:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790720 00000100:00100000:1.0:1789395247.284055:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790720 00000100:00100000:1.0:1789395247.284099:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789395247.284107:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a500bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239790720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395247.284121:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395247.284157:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a500bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239790720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395247.284168:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789395247.284858:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239790720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789395247.859543:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395247.877381:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395247.879516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881856 00000100:00100000:2.0:1789395247.879529:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881856 00000100:00100000:2.0:1789395247.880245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23847 00000100:00100000:2.0:1789395247.880257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:20994:x1876316231881856:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395247.880282:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395247.880316:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065c2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395247.880406:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d90f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395247.880423:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395247.880436:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395247.880483:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:2.0:1789395247.880486:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395247.880506:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395247.880532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df400/0xff35729af316d908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065c2 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395247.880560:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d90f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065c2 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395247.880568:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395247.880571:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395247.880581:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395247.880668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20994:x1876316231881856:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 413us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395247.880676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23847 00000100:00080000:0.0:1789395247.883231:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395247.890354:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395247.890471:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231881984 00000100:00100000:2.0:1789395247.890484:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231881984 00000100:00100000:2.0:1789395247.890565:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23848 00000100:00100000:2.0:1789395247.890586:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20994:x1876316231881984:12345-192.168.203.54@tcp:41:lfs.0 00000004:00000024:2.0:1789395247.890636:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:2.0:1789395247.890731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:20994:x1876316231881984:12345-192.168.203.54@tcp:41:lfs.0 Request processed in 147us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395247.891112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23848 00000100:00100000:1.0:1789395247.894164:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395247.894272:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882112 00000100:00100000:0.0:1789395247.894282:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882112 00000100:00100000:0.0:1789395247.894361:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23849 00000100:00100000:0.0:1789395247.894371:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:20994:x1876316231882112:12345-192.168.203.54@tcp:41:lfs.0 00000004:00000024:0.0:1789395247.894448:0:10512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395247.894508:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:20994:x1876316231882112:12345-192.168.203.54@tcp:41:lfs.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395247.894515:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23849 00000100:00080000:2.0:1789395247.895578:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395247.904281:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395247.905164:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882240 00000100:00100000:0.0:1789395247.905176:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882240 00000100:00100000:0.0:1789395247.905371:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 414 00000100:00100000:0.0:1789395247.905398:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:20994:x1876316231882240:12345-192.168.203.54@tcp:13:lfs.0 00002000:00000024:0.0:1789395247.905429:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 190928576 pending 8437760 free 3910905856 avail 3679383552 00000100:00100000:0.0:1789395247.905503:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:20994:x1876316231882240:12345-192.168.203.54@tcp:13:lfs.0 Request processed in 123us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395247.905511:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 414 00000100:00080000:2.0:1789395247.905837:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395247.911173:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395247.911310:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882368 00000100:00100000:1.0:1789395247.911321:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882368 00000100:00100000:1.0:1789395247.911426:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 415 00000100:00100000:1.0:1789395247.911438:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:20994:x1876316231882368:12345-192.168.203.54@tcp:13:lfs.0 00002000:00000024:1.0:1789395247.911466:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395247.911533:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:20994:x1876316231882368:12345-192.168.203.54@tcp:13:lfs.0 Request processed in 97us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395247.911540:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 415 00000100:00080000:2.0:1789395247.911796:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789395248.823803:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969985 is committed 00010000:00010000:1.0:1789395248.882614:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395249.712305:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395249.712613:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882624 00000100:00100000:2.0:1789395249.712623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882624 00000100:00100000:2.0:1789395249.712707:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 767 00000100:00100000:2.0:1789395249.712717:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231882624:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395249.713842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231882624:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 1119us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395249.713854:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 767 00000100:00080000:3.0:1789395249.714349:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395249.718318:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395249.718369:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395249.718415:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395249.720222:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882880 00000100:00100000:3.0:1789395249.720235:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882880 00000100:00100000:3.0:1789395249.720306:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 526 00000100:00100000:3.0:1789395249.720317:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231882880:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395249.720419:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231882880:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 104us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395249.721017:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882752 00000100:00100000:2.0:1789395249.721023:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882752 00000100:00100000:2.0:1789395249.721062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 768 00000100:00100000:2.0:1789395249.721083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231882752:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395249.721128:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231882752:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 59us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395249.721134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 768 00000100:00100000:2.0:1789395249.721158:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231882496 00000100:00100000:2.0:1789395249.721162:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231882496 00000100:00100000:2.0:1789395249.721195:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 481 00000100:00100000:2.0:1789395249.721202:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231882496:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395249.721227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231882496:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 26us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395249.721234:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 481 00000100:00080000:2.0:1789395249.721287:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789395249.721292:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395249.721578:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 526 00000100:00100000:2.0:1789395249.724602:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395249.726645:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231883008 00000100:00100000:1.0:1789395249.726659:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231883008 00000100:00100000:1.0:1789395249.726749:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 527 00000100:00100000:1.0:1789395249.726759:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231883008:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395249.726851:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2396:x1876316231883008:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 93us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395249.726858:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 527 00000100:00080000:2.0:1789395249.727878:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789395249.856000:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00000001:00080000:2.0:1789395249.856044:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984129 is committed 00000004:00080000:2.0:1789395249.856051:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00010000:00010000:3.0:1789395249.856089:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.856110:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.856120:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.856127:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395249.856134:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.856144:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.856169:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff89a4f3d38c00) 00010000:00010000:3.0:1789395249.856172:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395249.856177:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.856185:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d8f3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395249.856441:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395249.856467:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239790848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789395249.856568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395249.856647:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239790848 00000100:00100000:1.0:1789395249.856656:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239790848 00000100:00100000:1.0:1789395249.856967:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5347 00000100:00100000:1.0:1789395249.856982:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239790848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789395249.857014:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2560 count 1 00010000:00010000:1.0:1789395249.857041:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.857065:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 5 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.857087:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa00:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1789395249.857092:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789395249.857098:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.857131:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 5 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.857147:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 5 pid: 8426 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395249.857161:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1876316239790976:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395249.857239:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd300 going to sleep for 11 seconds 00000100:00080000:1.0:1789395249.857255:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395249.866010:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1876316239790976:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395249.866110:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395249.869176:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395249.872216:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231883136 00000100:00100000:3.0:1789395249.872237:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231883136 00010000:00010000:3.0:1789395249.872297:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 6 pid: 8426 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395249.872353:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1601 00000100:00100000:3.0:1789395249.872377:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231883136:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395249.875598:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395249.875631:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 6 pid: 8426 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.875656:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 6 pid: 8426 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.875970:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff062f0c/0xff35729af316d6bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106521 expref: 6 pid: 8426 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.875993:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395249.875998:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789395249.876005:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.876015:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395249.877030:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395249.877136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:2397:x1876316231883136:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 4759us (7962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395249.877150:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1601 00010000:00010000:1.0:1789395249.879862:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.879883:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.879895:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.879903:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395249.880945:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395249.881062:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395249.881084:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395249.881095:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:0.0:1789395249.881101:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395249.881111:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395249.881134:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395249.881141:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110ce1c9/0xff35729af316d916 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395249.881162:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395249.881164:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395249.881166:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395249.881717:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1876316239790848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24736us (25145us total) trans 4294969986 rc 0/0 00000100:00100000:1.0:1789395249.881728:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5347 00000004:00080000:1.0:1789395249.881791:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a4fef2bb80/2, rc 0, transno 4294969986 00000100:00100000:1.0:1789395249.881798:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239790848:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789395249.906143:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395250.865710:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239791104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395250.865789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395250.865872:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791104 00000100:00100000:3.0:1789395250.865879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791104 00000100:00100000:3.0:1789395250.865936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604 00000100:00100000:3.0:1789395250.865946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239791104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789395250.865983:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:3.0:1789395250.866032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239791104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395250.866039:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604 00000100:00100000:3.0:1789395250.866436:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239791104:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789395250.929590:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395251.889977:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239791360:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890047:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395251.890106:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239791872:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890128:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395251.890151:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239792384:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395251.890208:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789395251.890214:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239791488:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890425:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395251.890445:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239792000:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890469:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395251.890486:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239792512:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395251.890539:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791360 00000100:00100000:0.0:1789395251.890546:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791360 00000100:00100000:0.0:1789395251.890759:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791872 00000100:00100000:0.0:1789395251.890764:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791872 00000100:00100000:0.0:1789395251.890785:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792384 00000100:00100000:0.0:1789395251.890788:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792384 00000100:00100000:0.0:1789395251.890800:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792000 00000100:00100000:0.0:1789395251.890802:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792000 00000100:00100000:0.0:1789395251.890812:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792512 00000100:00100000:0.0:1789395251.890815:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792512 00000100:00100000:0.0:1789395251.890827:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1789395251.890834:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239791360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890887:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876316239791360:12345-0@lo:400:kworker.0 Request processed in 53us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.890895:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1789395251.890914:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1789395251.890920:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239791872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890945:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876316239791872:12345-0@lo:400:kworker.0 Request processed in 25us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.890954:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1789395251.890964:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1789395251.890969:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239792384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.890992:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876316239792384:12345-0@lo:400:kworker.0 Request processed in 23us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.890997:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1789395251.891008:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1789395251.891013:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239792000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.891037:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239792000:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.891043:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1789395251.891064:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1789395251.891071:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239792512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.891097:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239792512:12345-0@lo:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.891103:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1789395251.891127:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791488 00000100:00100000:0.0:1789395251.891131:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791488 00000100:00100000:1.0:1789395251.891306:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239791616:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891356:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239792128:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891428:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239792640:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891467:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789395251.891473:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239791232:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891523:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239791744:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891745:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239792256:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891789:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239792768:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395251.891837:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792128 00000100:00100000:1.0:1789395251.891841:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792128 00000100:00100000:1.0:1789395251.891868:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792640 00000100:00100000:1.0:1789395251.891871:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792640 00000100:00100000:1.0:1789395251.891884:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792256 00000100:00100000:1.0:1789395251.891886:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792256 00000100:00100000:1.0:1789395251.891902:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792768 00000100:00100000:1.0:1789395251.891905:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792768 00000100:00100000:1.0:1789395251.891921:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1789395251.891928:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239792128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.891964:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239792128:12345-0@lo:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395251.891970:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1789395251.891983:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1789395251.891989:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239792640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.892014:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239792640:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395251.892020:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1789395251.892030:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1789395251.892035:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3638:x1876316239792256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.892067:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3638:x1876316239792256:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395251.892073:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1789395251.892082:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789395251.892087:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239792768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.892107:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239792768:12345-0@lo:400:kworker.0 Request processed in 21us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395251.892112:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789395251.892125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791744 00000100:00100000:1.0:1789395251.892128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791744 00000100:00100000:1.0:1789395251.892147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:1.0:1789395251.892152:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239791488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.892484:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606 00000100:00100000:0.0:1789395251.892493:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239791744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.892531:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239791744:12345-0@lo:400:kworker.0 Request processed in 41us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.892536:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606 00000100:00100000:0.0:1789395251.892555:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791616 00000100:00100000:0.0:1789395251.892559:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791616 00000100:00100000:0.0:1789395251.892840:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1789395251.892847:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239791616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.892879:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876316239791616:12345-0@lo:400:kworker.0 Request processed in 33us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.892885:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1789395251.892967:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3636:x1876316239791488:12345-0@lo:400:kworker.0 Request processed in 814us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395251.892973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:1.0:1789395251.893022:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239791744:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.893036:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239792256:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.893045:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239792768:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.893069:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876316239791616:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.893080:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239792128:0@lo:400:kworker.0 00000100:00100000:1.0:1789395251.893089:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239792640:0@lo:400:kworker.0 00000100:00080000:1.0:1789395251.893582:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395251.893588:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789395251.893590:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789395251.893593:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395251.894048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239791232 00000100:00100000:0.0:1789395251.894064:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239791232 00000100:00100000:0.0:1789395251.894109:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1789395251.894116:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239791232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.894414:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239791232:12345-0@lo:400:kworker.0 Request processed in 297us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395251.894422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1789395251.894490:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239791488:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.894504:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239792000:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.894515:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239792512:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.894527:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876316239791360:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.894536:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1876316239791872:0@lo:400:kworker.0 00000100:00100000:0.0:1789395251.894546:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c98f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1876316239792384:0@lo:400:kworker.0 00000100:00100000:2.0:1789395251.894892:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239791232:0@lo:400:kworker.0 00010000:00010000:2.0:1789395251.954137:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395252.401818:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395252.401841:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395252.401906:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395252.401971:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793280 00000100:00100000:3.0:1789395252.401978:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793280 00000100:00100000:3.0:1789395252.402022:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789395252.402031:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239793280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789395252.402073:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395252.402122:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239793280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395252.402129:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789395252.402174:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395252.411756:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239793152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789395252.411797:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239793024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395252.411830:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395252.411868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395252.411894:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239792896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395252.411913:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793152 00000100:00100000:1.0:1789395252.411922:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793152 00000100:00100000:0.0:1789395252.411934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395252.411965:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793024 00000100:00100000:1.0:1789395252.411969:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793024 00000100:00100000:1.0:1789395252.411987:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789395252.411995:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239793152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789395252.412023:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395252.412073:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239793408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395252.412086:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239793152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395252.412093:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789395252.412108:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395252.412116:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793408 00000100:00100000:1.0:1789395252.412121:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793408 00000100:00100000:1.0:1789395252.412141:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789395252.412148:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239793024:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395252.412156:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789395252.412167:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239793408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395252.412173:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00002000:00000024:3.0:1789395252.412181:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395252.412211:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239793024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395252.412219:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789395252.412230:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239793408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395252.412239:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1789395252.412335:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239793152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395252.412348:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239792896 00000100:00100000:2.0:1789395252.412354:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239792896 00000100:00100000:2.0:1789395252.412416:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1789395252.412424:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239792896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395252.412450:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1789395252.416707:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239793408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395252.416893:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3636:x1876316239792896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4467us (4956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395252.416915:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:1.0:1789395252.419722:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239793024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395252.419758:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239792896:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789395252.977656:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789395253.507007:0:22877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 10:14:12 (1789395252) 00010000:00010000:2.0:1789395254.001776:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395254.433265:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395254.433443:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231883392 00000100:00100000:1.0:1789395254.433454:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231883392 00000100:00080000:3.0:1789395254.433637:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395254.433692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23850 00000100:00100000:1.0:1789395254.433704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:21492:x1876316231883392:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395254.433727:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395254.433731:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789395254.433757:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d90f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065c2 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433776:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395254.433782:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395254.433797:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d91d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065c9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433924:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433941:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433952:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433967:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433975:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.433986:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395254.434342:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa01:0x0], index 1: 0 00010000:00010000:1.0:1789395254.434736:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434748:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434756:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434788:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434795:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434802:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434809:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434815:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395254.434820:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434829:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434842:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395254.434857:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395254.434862:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434869:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d924 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395254.434881:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e732a30 reply state 00000000c0cd3099 transno 4294984130 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434893:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434899:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff89a4e7d26f00) 00010000:00010000:1.0:1789395254.434902:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395254.434904:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395254.434933:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d91d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065c9 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434946:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065c9 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.434954:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff89a4e7d26a00) 00010000:00010000:1.0:1789395254.434957:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395254.434959:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57000, rc 0) 00000100:00100000:1.0:1789395254.435073:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:21492:x1876316231883392:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1371us (1816us total) trans 4294984130 rc 0/0 00000100:00100000:1.0:1789395254.435081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23850 00000100:00100000:3.0:1789395254.443190:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395254.443371:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231883520 00000100:00100000:0.0:1789395254.443415:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231883520 00000100:00100000:0.0:1789395254.443485:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5348 00000100:00100000:0.0:1789395254.443497:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21492:x1876316231883520:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395254.443940:0:14651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395254.443965:0:14651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065d0 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395254.443992:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395254.444016:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1789395254.444021:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395254.444043:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 7 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.444063:0:14651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 7 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.444079:0:14651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56200, rc 0) 00000100:00100000:1.0:1789395254.444141:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:21492:x1876316231883520:12345-192.168.203.54@tcp:101:dd.0 Request processed in 645us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395254.444148:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5348 00000100:00080000:3.0:1789395254.447829:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789395254.462362:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395254.462682:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231883776 00000100:00100000:0.0:1789395254.462695:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231883776 00000100:00100000:0.0:1789395254.462759:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5212 00000100:00100000:0.0:1789395254.462770:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:21492:x1876316231883776:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395254.463378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:21492:x1876316231883776:12345-192.168.203.54@tcp:35:dd.0 Request processed in 607us (1026us total) trans 4294984131 rc 0/0 00000100:00100000:0.0:1789395254.463409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5212 00000100:00100000:3.0:1789395254.491692:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395254.492072:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231883904 00000100:00100000:1.0:1789395254.492083:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231883904 00000100:00100000:1.0:1789395254.492139:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23851 00000100:00100000:1.0:1789395254.492149:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:21493:x1876316231883904:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:1.0:1789395254.492173:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395254.492192:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065d7 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.492262:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d94e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.492281:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.492293:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395254.492337:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:1.0:1789395254.492341:0:21735:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395254.492359:0:21735:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.492381:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56000/0xff35729af316d947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d7 expref: 20 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.492415:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d94e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d7 expref: 19 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.492424:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395254.492428:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395254.492432:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57c00, rc 0) 00000100:00100000:1.0:1789395254.492485:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:21493:x1876316231883904:12345-192.168.203.54@tcp:101:rm.0 Request processed in 337us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395254.492493:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23851 00000100:00100000:3.0:1789395254.517007:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395254.517059:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231884160 00000100:00100000:0.0:1789395254.517072:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231884160 00000100:00100000:0.0:1789395254.517129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23852 00000100:00100000:0.0:1789395254.517138:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:21493:x1876316231884160:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:0.0:1789395254.517195:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395254.517228:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57000/0xff35729af316d932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065c9 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517251:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff89a4e7d26a00) 00010000:00010000:0.0:1789395254.517273:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57c00/0xff35729af316d94e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d7 expref: 18 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517283:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395254.517286:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395254.517309:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517627:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517638:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517648:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517654:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.517660:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518008:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518016:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518023:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789395254.518261:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 64 off11456 00000004:00080000:0.0:1789395254.518272:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705571887112ns, next at 706571884559ns, rc = 0 00010000:00010000:0.0:1789395254.518320:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518329:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518341:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518347:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518353:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518359:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518597:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789395254.518617:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518624:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518630:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518637:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395254.518641:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518649:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518659:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:0.0:1789395254.518661:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789395254.518666:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518672:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d600/0xff35729af316d963 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518686:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518692:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518711:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518717:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518722:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395254.518725:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518731:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518739:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395254.518742:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395254.518745:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518751:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ce00/0xff35729af316d955 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395254.518760:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aeeecef reply state 00000000e2df8695 transno 4294984132 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518772:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395254.518777:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff89a4e7d26f00) 00010000:00010000:0.0:1789395254.518780:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395254.518782:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395254.518944:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:21493:x1876316231884160:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1804us (1947us total) trans 4294984132 rc 0/0 00000100:00100000:0.0:1789395254.518952:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23852 00010000:00010000:1.0:1789395254.520894:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789395254.520909:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.520921:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ca00 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:1.0:1789395254.520926:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.520938:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.520960:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:1.0:1789395254.520963:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789395254.520969:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.520976:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316d96a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.521003:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395254.521005:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789395254.521007:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395254.572494:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395254.572666:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231884288 00000100:00100000:2.0:1789395254.572676:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231884288 00000100:00100000:2.0:1789395254.572743:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23853 00000100:00100000:2.0:1789395254.572752:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:21496:x1876316231884288:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:3.0:1789395254.573792:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395254.573820:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065de expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395254.573892:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395254.573985:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395254.574001:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395254.574059:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395254.574064:0:7813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395254.574087:0:7813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395254.574114:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065de expref: 21 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395254.574133:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065de expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395254.574142:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395254.574145:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395254.574149:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a800, rc 0) 00000100:00100000:3.0:1789395254.574221:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:21496:x1876316231884288:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 1469us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395254.574229:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23853 00000100:00100000:2.0:1789395254.584151:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395254.587836:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231884544 00000100:00100000:3.0:1789395254.587857:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231884544 00000100:00100000:2.0:1789395254.590899:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23854 00000100:00100000:2.0:1789395254.590921:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:21496:x1876316231884544:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:2.0:1789395254.590947:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395254.590951:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789395254.590985:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065de expref: 20 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591016:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395254.591022:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395254.591049:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d97f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065e5 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591202:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591216:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591226:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591238:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591246:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591254:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395254.591736:0:10512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa01:0x0], index 0: 0 00010000:00010000:2.0:1789395254.591908:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591918:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591931:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591975:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591982:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591988:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.591995:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592001:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395254.592006:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592014:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592023:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395254.592026:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395254.592042:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592050:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316d986 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395254.592073:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006373c942 reply state 00000000a839d110 transno 4294984133 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592086:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592092:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff89a4e7d26f00) 00010000:00010000:2.0:1789395254.592094:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395254.592097:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395254.592128:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df200/0xff35729af316d97f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065e5 expref: 22 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592142:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dea00/0xff35729af316d994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065e5 expref: 21 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.592149:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff89a4f3d38400) 00010000:00010000:2.0:1789395254.592151:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395254.592154:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dea00, rc 0) 00000100:00100000:2.0:1789395254.592246:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:21496:x1876316231884544:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 1331us (8109us total) trans 4294984133 rc 0/0 00000100:00100000:2.0:1789395254.592255:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23854 00000100:00100000:0.0:1789395254.597190:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395254.597265:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231884672 00000100:00100000:1.0:1789395254.597279:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231884672 00000100:00100000:1.0:1789395254.597558:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5349 00000100:00100000:1.0:1789395254.597571:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+5:21496:x1876316231884672:12345-192.168.203.54@tcp:101:multiop.0 00010000:00010000:1.0:1789395254.597593:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395254.597629:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008019d03d/0xff35729af316d9a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065ec expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395254.597663:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395254.597688:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1789395254.597694:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395254.597703:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008019d03d/0xff35729af316d9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065ec expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.597740:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008019d03d/0xff35729af316d9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065ec expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.597756:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56000, rc 0) 00000100:00100000:1.0:1789395254.597830:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21496:x1876316231884672:12345-192.168.203.54@tcp:101:multiop.0 Request processed in 263us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395254.597837:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5349 00000100:00080000:3.0:1789395254.597939:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395254.630335:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395254.630521:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231884800 00000100:00100000:1.0:1789395254.630535:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231884800 00000100:00100000:1.0:1789395254.630611:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23855 00000100:00100000:1.0:1789395254.630623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:21496:x1876316231884800:12345-192.168.203.54@tcp:44:multiop.0 00000001:00080000:3.0:1789395254.643174:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984133 is committed 00000004:00080000:3.0:1789395254.643197:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00010000:00010000:1.0:1789395254.643323:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643338:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643347:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643353:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395254.643359:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643377:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643438:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff89a4e7d26f00) 00010000:00010000:1.0:1789395254.643442:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395254.643447:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643454:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56c00/0xff35729af316d92b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643476:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643482:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643489:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643494:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395254.643497:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643503:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643511:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff89a4e7d26f00) 00010000:00010000:1.0:1789395254.643513:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395254.643516:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643522:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10dc00/0xff35729af316d95c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643534:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643541:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643547:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643552:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395254.643555:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643560:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643567:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff89a4e7d26f00) 00010000:00010000:1.0:1789395254.643569:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395254.643571:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.643578:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df000/0xff35729af316d98d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395254.643828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:21496:x1876316231884800:12345-192.168.203.54@tcp:44:multiop.0 Request processed in 13200us (13500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395254.643842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23855 00000100:00100000:0.0:1789395254.644749:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395254.644773:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239793536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789395254.644848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395254.644903:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793536 00000100:00100000:1.0:1789395254.644913:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793536 00000100:00100000:1.0:1789395254.644978:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5350 00000100:00100000:1.0:1789395254.644989:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239793536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789395254.645017:0:14639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2561 count 1 00010000:00010000:1.0:1789395254.645056:0:14639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.645079:0:14639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 6 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.645089:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395254.645093:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789395254.645098:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.645131:0:14639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 6 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.645145:0:14639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 6 pid: 14651 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395254.645156:0:14639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14639:1876316239793664:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395254.645210:0:14639:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3cacaad80 going to sleep for 11 seconds 00000100:00080000:0.0:1789395254.646309:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789395254.661775:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395254.661980:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231884928 00000100:00100000:2.0:1789395254.661995:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231884928 00000100:00100000:2.0:1789395254.662089:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5351 00000100:00100000:2.0:1789395254.662102:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231884928:12345-192.168.203.54@tcp:16:multiop.0 00000100:00100000:2.0:1789395254.662265:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231884928:12345-192.168.203.54@tcp:16:multiop.0 Request processed in 166us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395254.662276:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5351 00000100:00100000:1.0:1789395254.666259:0:14639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14639:1876316239793664:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395254.666308:0:14639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395254.669087:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395254.669589:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885056 00000100:00100000:2.0:1789395254.669601:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885056 00010000:00010000:2.0:1789395254.669790:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 7 pid: 14651 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395254.669845:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1602 00000100:00100000:2.0:1789395254.669857:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231885056:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395254.669874:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395254.669881:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 7 pid: 14651 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.669897:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 7 pid: 14651 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.670357:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316d940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065d0 expref: 7 pid: 14651 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.670380:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395254.670439:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789395254.670447:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.670459:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.670555:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395254.670636:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231885056:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 781us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395254.670655:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1602 00010000:00010000:1.0:1789395254.671459:0:14639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.671476:0:14639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.671490:0:14639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.671499:0:14639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395254.671524:0:14639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789395254.671767:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3637:x1876316239793536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26777us (26915us total) trans 4294969953 rc 0/0 00000100:00100000:1.0:1789395254.671777:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5350 00000004:00080000:0.0:1789395254.671865:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a5009db800/2, rc 0, transno 4294969953 00000100:00100000:0.0:1789395254.671874:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a5009db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239793536:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789395254.672059:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395254.672068:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.672079:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57800 already unused, calling callback (ffffffffc0d64520) 00010000:00010000:2.0:1789395254.672084:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.672096:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.672114:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.672122:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076448314/0xff35729af316d9a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395254.672147:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395254.672149:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395254.672151:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395254.674462:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395254.675137:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885312 00000100:00100000:1.0:1789395254.675151:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885312 00000100:00100000:1.0:1789395254.675230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5213 00000100:00100000:1.0:1789395254.675242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:21496:x1876316231885312:12345-192.168.203.54@tcp:35:multiop.0 00000100:00100000:1.0:1789395254.675665:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:21496:x1876316231885312:12345-192.168.203.54@tcp:35:multiop.0 Request processed in 423us (1215us total) trans 4294984134 rc 0/0 00000100:00100000:1.0:1789395254.675674:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5213 00000100:00100000:0.0:1789395254.835833:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395254.836907:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395254.837674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885440 00000100:00100000:1.0:1789395254.837690:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885440 00000100:00100000:1.0:1789395254.837812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 483 00000100:00100000:1.0:1789395254.837826:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231885440:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395254.837934:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2396:x1876316231885440:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 111us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395254.837943:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 483 00000100:00100000:0.0:1789395254.840237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885568 00000100:00100000:0.0:1789395254.840267:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885568 00000100:00100000:0.0:1789395254.840486:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 775 00000100:00100000:0.0:1789395254.840508:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231885568:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395254.840605:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2395:x1876316231885568:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 108us (3703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395254.840613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 775 00000100:00080000:3.0:1789395254.845948:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789395255.025750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395255.985997:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239793792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789395255.986124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395255.989660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793792 00000100:00100000:0.0:1789395255.989683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793792 00000100:00100000:0.0:1789395255.989880:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1789395255.989892:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239793792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395255.989945:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:0.0:1789395255.990091:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239793792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395255.990099:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:1.0:1789395255.990200:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239793792:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1789395255.990781:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969986 is committed 00010000:00010000:2.0:1789395256.050080:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395257.012596:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239794304:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.012664:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.012723:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239794816:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.012749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.012772:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239795328:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.012792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.012813:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789395257.012818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239794176:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.012843:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.012861:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239794688:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.012881:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.012896:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239795200:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.012915:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.012942:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794816 00000100:00100000:2.0:1789395257.012949:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794816 00000100:00100000:2.0:1789395257.012999:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795328 00000100:00100000:2.0:1789395257.013002:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795328 00000100:00100000:2.0:1789395257.013039:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1789395257.013047:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239794816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013106:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239794816:12345-0@lo:400:kworker.0 Request processed in 60us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.013114:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1789395257.013130:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789395257.013137:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239795328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013167:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239795328:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.013176:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789395257.013197:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794176 00000100:00100000:2.0:1789395257.013201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794176 00000100:00100000:2.0:1789395257.013349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609 00000100:00100000:2.0:1789395257.013356:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239794176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239794176:12345-0@lo:400:kworker.0 Request processed in 67us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.013429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609 00000100:00080000:2.0:1789395257.013455:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395257.013459:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395257.013486:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239794176:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013497:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239794816:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013505:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239795328:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013532:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794304 00000100:00100000:2.0:1789395257.013536:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794304 00000100:00100000:2.0:1789395257.013560:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794688 00000100:00100000:2.0:1789395257.013563:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794688 00000100:00100000:2.0:1789395257.013581:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795200 00000100:00100000:2.0:1789395257.013583:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795200 00000100:00100000:2.0:1789395257.013598:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1789395257.013604:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239794304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013638:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239794304:12345-0@lo:400:kworker.0 Request processed in 34us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.013644:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1789395257.013655:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:2.0:1789395257.013661:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013683:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876316239794688:12345-0@lo:400:kworker.0 Request processed in 23us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.013688:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:2.0:1789395257.013697:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1789395257.013703:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239795200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013723:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876316239795200:12345-0@lo:400:kworker.0 Request processed in 21us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.013728:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00080000:2.0:1789395257.013739:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395257.013756:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1876316239794688:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013764:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3637:1876316239795200:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.013771:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239794304:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.013858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239793920:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.013893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.013926:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239794432:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.013947:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.013966:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239794944:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.013984:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.013998:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239795456:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.014045:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789395257.014060:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239794048:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014082:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.014100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239794560:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014119:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.014135:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239795072:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014153:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395257.014173:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794432 00000100:00100000:3.0:1789395257.014177:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794432 00000100:00100000:3.0:1789395257.014203:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:3.0:1789395257.014210:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239794432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014259:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239794432:12345-0@lo:400:kworker.0 Request processed in 50us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395257.014265:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000100:00100000:3.0:1789395257.014292:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239794432:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014309:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794048 00000100:00100000:3.0:1789395257.014312:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794048 00000100:00100000:3.0:1789395257.014328:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794560 00000100:00100000:3.0:1789395257.014331:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794560 00000100:00100000:3.0:1789395257.014348:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795072 00000100:00100000:3.0:1789395257.014351:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795072 00000100:00100000:3.0:1789395257.014363:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1789395257.014368:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239794048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239794048:12345-0@lo:400:kworker.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395257.014433:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1789395257.014444:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1789395257.014450:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239794560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014477:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239794560:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395257.014482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1789395257.014493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1789395257.014498:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239795072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014522:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239795072:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395257.014528:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1789395257.014552:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239794048:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014561:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239794560:0@lo:400:kworker.0 00000100:00100000:3.0:1789395257.014570:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239795072:0@lo:400:kworker.0 00000100:00080000:3.0:1789395257.014589:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789395257.014838:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239794944 00000100:00100000:1.0:1789395257.014843:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239794944 00000100:00100000:1.0:1789395257.014892:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795456 00000100:00100000:1.0:1789395257.014895:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795456 00000100:00100000:1.0:1789395257.014916:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1789395257.014923:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239794944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395257.014962:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239794944:12345-0@lo:400:kworker.0 Request processed in 39us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395257.014967:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1789395257.014979:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1789395257.014985:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3638:x1876316239795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395257.015010:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3638:x1876316239795456:12345-0@lo:400:kworker.0 Request processed in 25us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395257.015027:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1789395257.015071:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969986 gen 2 00000004:00080000:1.0:1789395257.015077:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a4fef2bb80, transno 4294969986 00000100:00100000:1.0:1789395257.015087:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239794944:0@lo:400:kworker.0 00000100:00100000:1.0:1789395257.015098:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239795456:0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.015407:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239793920 00000100:00100000:2.0:1789395257.015412:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239793920 00000100:00100000:2.0:1789395257.015446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1789395257.015454:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239793920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395257.015538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3638:x1876316239793920:12345-0@lo:400:kworker.0 Request processed in 85us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.015544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00080000:3.0:1789395257.015810:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395257.015814:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395257.018942:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d0428a-b483-45e6-97c2-4fac3e6d8266:3638:1876316239793920:0@lo:400:kworker.0 00010000:00010000:1.0:1789395257.075271:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395257.522717:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395257.522740:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395257.522805:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395257.523557:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395257.523570:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239795840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395257.523718:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795712 00000100:00100000:2.0:1789395257.523726:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795712 00000100:00100000:2.0:1789395257.523775:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789395257.523784:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239795712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395257.523828:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1789395257.523964:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239795584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395257.523996:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395257.524032:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239796096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395257.524064:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395257.524086:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789395257.524092:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395257.524114:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395257.524291:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239795712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 507us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.524299:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789395257.524316:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795584 00000100:00100000:2.0:1789395257.524319:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795584 00000100:00100000:2.0:1789395257.524334:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795968 00000100:00100000:2.0:1789395257.524337:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795968 00000100:00100000:2.0:1789395257.524350:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789395257.524356:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239795584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789395257.524373:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789395257.524636:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395257.524748:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395257.524977:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239795584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 620us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.524984:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789395257.524999:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239795840 00000100:00100000:2.0:1789395257.525003:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239795840 00000100:00100000:2.0:1789395257.525034:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789395257.525040:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239795968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789395257.525052:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395257.525076:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876316239795968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.525082:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789395257.525091:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789395257.525096:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239795840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789395257.525105:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395257.525140:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239795840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.525146:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789395257.525168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796096 00000100:00100000:2.0:1789395257.525172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796096 00000100:00100000:2.0:1789395257.525199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611 00000100:00100000:2.0:1789395257.525205:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239796096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789395257.525229:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1789395257.525258:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239796096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395257.525264:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611 00000100:00100000:1.0:1789395257.526045:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239795840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789395257.526234:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789395257.526252:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fef2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239795584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789395257.526266:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239796096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789395258.097742:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395259.122766:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395259.417170:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395259.417520:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885696 00000100:00100000:2.0:1789395259.417531:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885696 00000100:00100000:2.0:1789395259.417603:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23856 00000100:00100000:2.0:1789395259.417613:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:21737:x1876316231885696:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395259.417640:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395259.417662:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d9b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065f3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395259.417725:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395259.417742:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395259.417754:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395259.417796:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:2.0:1789395259.417800:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395259.417819:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395259.417844:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfe00/0xff35729af316d9b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395259.417861:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395259.417878:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395259.417882:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789395259.417887:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395259.418007:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:21737:x1876316231885696:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 395us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395259.418015:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23856 00000100:00080000:3.0:1789395259.419165:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789395259.424213:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395259.424304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885824 00000100:00100000:2.0:1789395259.424314:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885824 00000100:00100000:2.0:1789395259.424373:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23857 00000100:00100000:2.0:1789395259.424417:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:21737:x1876316231885824:12345-192.168.203.54@tcp:41:lfs.0 00000004:00000024:2.0:1789395259.424458:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:2.0:1789395259.424529:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:21737:x1876316231885824:12345-192.168.203.54@tcp:41:lfs.0 Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395259.424538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23857 00000100:00100000:1.0:1789395259.427977:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395259.428236:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231885952 00000100:00100000:0.0:1789395259.428245:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231885952 00000100:00080000:3.0:1789395259.428299:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395259.428424:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23858 00000100:00100000:0.0:1789395259.428436:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21737:x1876316231885952:12345-192.168.203.54@tcp:41:lfs.0 00000004:00000024:0.0:1789395259.428479:0:7813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1789395259.428558:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21737:x1876316231885952:12345-192.168.203.54@tcp:41:lfs.0 Request processed in 124us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395259.428566:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23858 00000100:00100000:3.0:1789395259.433577:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395259.433959:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886080 00000100:00100000:2.0:1789395259.433969:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886080 00000100:00100000:2.0:1789395259.434214:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 424 00000100:00100000:2.0:1789395259.434227:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21737:x1876316231886080:12345-192.168.203.54@tcp:13:lfs.0 00002000:00000024:2.0:1789395259.434260:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00080000:3.0:1789395259.434360:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789395259.434847:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21737:x1876316231886080:12345-192.168.203.54@tcp:13:lfs.0 Request processed in 335us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395259.434856:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 424 00000100:00100000:3.0:1789395259.449733:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395259.450481:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886208 00000100:00100000:2.0:1789395259.450492:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886208 00000100:00100000:2.0:1789395259.450633:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 425 00000100:00100000:2.0:1789395259.450646:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21737:x1876316231886208:12345-192.168.203.54@tcp:13:lfs.0 00002000:00000024:2.0:1789395259.450680:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789395259.450753:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:21737:x1876316231886208:12345-192.168.203.54@tcp:13:lfs.0 Request processed in 109us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395259.450761:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 425 00000100:00080000:3.0:1789395259.450812:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395259.958523:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395259.958562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395259.958589:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395259.958609:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395259.958630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395259.958657:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886336 00000100:00100000:1.0:1789395259.958667:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886336 00000100:00100000:1.0:1789395259.958710:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 485 00000100:00100000:1.0:1789395259.958719:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231886336:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395259.958785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231886336:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395259.958792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 485 00000100:00100000:1.0:1789395259.958822:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886592 00000100:00100000:1.0:1789395259.958825:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886592 00000100:00100000:1.0:1789395259.958851:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886464 00000100:00100000:1.0:1789395259.958854:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886464 00000100:00100000:1.0:1789395259.958873:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 782 00000100:00100000:1.0:1789395259.958879:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231886592:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395259.958911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231886592:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395259.958917:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 782 00000100:00100000:1.0:1789395259.958929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 783 00000100:00100000:1.0:1789395259.958935:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231886464:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395259.958955:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231886464:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 21us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395259.958962:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 783 00000100:00100000:1.0:1789395259.958978:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886848 00000100:00100000:1.0:1789395259.958982:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886848 00000100:00100000:1.0:1789395259.959016:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886720 00000100:00100000:1.0:1789395259.959019:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886720 00000100:00100000:1.0:1789395259.959037:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 536 00000100:00100000:1.0:1789395259.959043:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231886848:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395259.959068:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231886848:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395259.959074:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 536 00000100:00100000:1.0:1789395259.959085:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 537 00000100:00100000:1.0:1789395259.959091:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231886720:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395259.959134:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231886720:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 43us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395259.959140:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 537 00010000:00010000:2.0:1789395260.145587:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395261.107476:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789395261.107498:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239796224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789395261.107565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395261.108183:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796224 00000100:00100000:3.0:1789395261.108192:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796224 00000100:00100000:3.0:1789395261.108244:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612 00000100:00100000:3.0:1789395261.108253:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239796224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789395261.108289:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443880960 avail 1297641472 00000100:00100000:3.0:1789395261.108355:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239796224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395261.108361:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612 00000100:00100000:1.0:1789395261.108542:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239796224:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1789395261.112772:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969953 is committed 00000001:00080000:3.0:1789395261.113170:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984134 is committed 00010000:00010000:1.0:1789395261.171059:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395262.139561:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239796480:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.139612:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239796352:0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.141616:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239796608:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.146010:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.147329:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239796864:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.147412:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.148106:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239797376:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.148150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.148179:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239797888:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.148202:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.148233:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789395262.148240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239796736:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.148265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.148282:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239797248:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.148301:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.148317:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239797760:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.148336:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.148409:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796352 00000100:00100000:1.0:1789395262.148418:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796352 00000100:00100000:0.0:1789395262.150216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395262.150540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239796992:0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.150589:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789395262.150606:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239796352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.154837:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3637:x1876316239796352:12345-0@lo:400:kworker.0 Request processed in 4223us (8826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395262.154858:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789395262.154945:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796864 00000100:00100000:1.0:1789395262.154956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796864 00000100:00100000:1.0:1789395262.155026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613 00000100:00100000:1.0:1789395262.155101:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239796864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.155170:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239796864:12345-0@lo:400:kworker.0 Request processed in 73us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395262.155177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613 00000100:00100000:1.0:1789395262.155200:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797376 00000100:00100000:1.0:1789395262.155204:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797376 00000100:00100000:1.0:1789395262.155247:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797888 00000100:00100000:1.0:1789395262.155251:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797888 00000100:00100000:1.0:1789395262.155273:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797248 00000100:00100000:1.0:1789395262.155276:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797248 00000100:00100000:1.0:1789395262.155299:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797760 00000100:00100000:1.0:1789395262.155302:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797760 00000100:00100000:1.0:1789395262.155323:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1789395262.155330:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239797376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395262.155368:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239797376:12345-0@lo:400:kworker.0 Request processed in 39us (7217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395262.155374:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1789395262.156466:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395262.156532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239797504:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.156670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395262.156792:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796736 00000100:00100000:0.0:1789395262.156801:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796736 00000100:00100000:0.0:1789395262.156850:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796480 00000100:00100000:0.0:1789395262.156854:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796480 00000100:00100000:0.0:1789395262.156870:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796992 00000100:00100000:0.0:1789395262.156873:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796992 00000100:00100000:0.0:1789395262.156889:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797504 00000100:00100000:0.0:1789395262.156892:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797504 00000100:00100000:0.0:1789395262.156907:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1789395262.156915:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239796736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.156965:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239796736:12345-0@lo:400:kworker.0 Request processed in 51us (8699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.156986:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1789395262.157005:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1789395262.157010:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239796480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.157044:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239796480:12345-0@lo:400:kworker.0 Request processed in 34us (6837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.157051:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1789395262.157062:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1789395262.157068:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.157097:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239796992:12345-0@lo:400:kworker.0 Request processed in 30us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.157103:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1789395262.157112:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1789395262.157118:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239797504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.157141:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239797504:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.157147:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1789395262.157282:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239796480:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.157297:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239796992:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.157307:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239797504:0@lo:400:kworker.0 00000100:00080000:0.0:1789395262.157935:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789395262.157944:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789395262.157948:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395262.158001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239796736:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d0428a-b483-45e6-97c2-4fac3e6d8266:3637:1876316239796352:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158033:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239796864:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239797376:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158092:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1789395262.158106:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239797888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158165:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c98f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239797888:12345-0@lo:400:kworker.0 Request processed in 66us (9962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.158172:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1789395262.158192:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789395262.158199:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239797248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158229:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239797248:12345-0@lo:400:kworker.0 Request processed in 30us (9926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.158235:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789395262.158246:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1789395262.158253:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239797760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.158283:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239797760:12345-0@lo:400:kworker.0 Request processed in 31us (9945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395262.158288:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1789395262.158327:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239797248:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.159434:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239797760:0@lo:400:kworker.0 00000100:00100000:0.0:1789395262.159462:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969953 gen 2 00000004:00080000:0.0:1789395262.159468:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a5009db800, transno 4294969953 00000100:00100000:0.0:1789395262.159484:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239797888:0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.162371:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395262.163553:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239797120:0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.163625:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395262.163660:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239797632:0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.163684:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395262.163759:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239796608 00000100:00100000:3.0:1789395262.163769:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239796608 00000100:00100000:3.0:1789395262.163828:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614 00000100:00100000:3.0:1789395262.163838:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239796608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.163903:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239796608:12345-0@lo:400:kworker.0 Request processed in 66us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395262.163912:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614 00000100:00100000:3.0:1789395262.163940:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797120 00000100:00100000:3.0:1789395262.163943:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797120 00000100:00100000:3.0:1789395262.163994:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239797632 00000100:00100000:3.0:1789395262.163998:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239797632 00000100:00100000:3.0:1789395262.164020:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1789395262.164026:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239797120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.164057:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876316239797120:12345-0@lo:400:kworker.0 Request processed in 32us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395262.164063:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1789395262.164074:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1789395262.164079:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239797632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.164101:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876316239797632:12345-0@lo:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395262.164107:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00080000:3.0:1789395262.164123:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789395262.164159:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239796608:0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.164172:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1876316239797120:0@lo:400:kworker.0 00000100:00100000:3.0:1789395262.164181:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1876316239797632:0@lo:400:kworker.0 00010000:00010000:2.0:1789395262.193738:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395262.641665:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239798016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395262.641761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395262.642083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798016 00000100:00100000:1.0:1789395262.642093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798016 00000100:00100000:1.0:1789395262.642154:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615 00000100:00100000:1.0:1789395262.642166:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239798016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789395262.642216:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1789395262.642270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:3638:x1876316239798016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395262.642277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615 00000100:00100000:1.0:1789395262.642353:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239798016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789395262.642373:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395262.642379:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239798144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395262.642433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395262.643112:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239798272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395262.643151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395262.643183:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395262.643189:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239798400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395262.643220:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395262.643255:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798144 00000100:00100000:3.0:1789395262.643260:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798144 00000100:00100000:3.0:1789395262.643306:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798272 00000100:00100000:3.0:1789395262.643311:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798272 00000100:00100000:3.0:1789395262.643322:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798400 00000100:00100000:3.0:1789395262.643325:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798400 00000100:00100000:3.0:1789395262.643337:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789395262.643344:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239798144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789395262.643369:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395262.643431:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239798144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395262.643438:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789395262.643454:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789395262.643460:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239798272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789395262.643469:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75916992 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789395262.643494:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239798272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395262.643499:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789395262.643510:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789395262.643979:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789395262.643992:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239798528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395262.644027:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395262.644061:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798528 00000100:00100000:2.0:1789395262.644065:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798528 00000100:00100000:2.0:1789395262.644092:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789395262.644099:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239798528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395262.644117:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1789395262.644152:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239798528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395262.644159:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789395262.644203:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239798528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395262.644243:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239798144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789395262.644282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239798272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395262.646049:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239798400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789395262.646085:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 237568 granted 182490816 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395262.646174:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239798400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2658us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395262.646183:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789395262.646427:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239798400:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789395263.234551:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395264.242072:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395265.073701:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395265.073747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395265.073768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231886976 00000100:00100000:2.0:1789395265.073785:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231886976 00000100:00100000:1.0:1789395265.073791:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395265.073854:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395265.073875:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 487 00000100:00100000:2.0:1789395265.073894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231886976:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395265.073895:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231887232 00000100:00100000:1.0:1789395265.073907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231887232 00000100:00100000:1.0:1789395265.073975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231887104 00000100:00100000:1.0:1789395265.073979:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231887104 00000100:00100000:1.0:1789395265.074014:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 790 00000100:00100000:1.0:1789395265.074023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231887232:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395265.074108:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231887232:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395265.074116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 790 00000100:00100000:1.0:1789395265.074134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 791 00000100:00100000:1.0:1789395265.074140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2398:x1876316231887104:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395265.074168:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2398:x1876316231887104:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395265.074353:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 791 00000100:00100000:1.0:1789395265.074380:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231887488 00000100:00100000:1.0:1789395265.074410:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231887488 00000100:00100000:1.0:1789395265.074560:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 542 00000100:00100000:1.0:1789395265.074567:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231887488:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395265.074594:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2398:x1876316231887488:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 28us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395265.074601:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 542 00000100:00080000:1.0:1789395265.074617:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789395265.074621:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789395265.074623:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395265.075715:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231886976:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 1817us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.075731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 487 00000100:00100000:1.0:1789395265.076722:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395265.078965:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231887360 00000100:00100000:2.0:1789395265.078986:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231887360 00000100:00100000:2.0:1789395265.079084:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 543 00000100:00100000:2.0:1789395265.079098:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231887360:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395265.079196:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:2397:x1876316231887360:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 101us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.079205:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 543 00000100:00080000:1.0:1789395265.080506:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789395265.265812:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789395265.617716:0:23219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63c: test sync_on_close=1 ================= 10:14:24 (1789395264) 00000100:00100000:1.0:1789395265.749747:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395265.753957:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231887744 00000100:00100000:2.0:1789395265.753979:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231887744 00000100:00100000:2.0:1789395265.754129:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23859 00000100:00100000:2.0:1789395265.754142:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:22228:x1876316231887744:12345-192.168.203.54@tcp:36:mkdir.0 00000100:00100000:2.0:1789395265.754309:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239798656:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.754414:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.754471:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb48600 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.755078:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798656 00000100:00100000:2.0:1789395265.755084:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798656 00000100:00100000:2.0:1789395265.755129:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:2.0:1789395265.755137:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239798656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.755221:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239798656:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.755230:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:2.0:1789395265.755380:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239798656:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.755465:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239798784:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.755752:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.755780:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb48600 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.755796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798784 00000100:00100000:2.0:1789395265.755801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798784 00000100:00100000:2.0:1789395265.755830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:2.0:1789395265.755837:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239798784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.755944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239798784:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (382us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395265.755963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:2.0:1789395265.755993:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239798784:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789395265.756679:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.756692:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.756705:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395265.756721:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239798912:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1789395265.756751:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.756793:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789395265.756925:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239798912 00000100:00100000:1.0:1789395265.756932:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239798912 00000100:00100000:1.0:1789395265.756985:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:1.0:1789395265.756994:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:6511:x1876316239798912:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1789395265.757015:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395265.757035:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316d9be expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.757064:0:20561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.757075:0:20561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.757102:0:20561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.757115:0:20561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 15 pid: 6511 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395265.757128:0:20561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f650b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20561:1876316239799040:192.168.203.54@tcp:104: 00000100:00100000:1.0:1789395265.757194:0:20561:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca2ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789395265.763494:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395265.763541:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231887872 00000100:00100000:0.0:1789395265.763553:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231887872 00010000:00010000:0.0:1789395265.763607:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 16 pid: 6511 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395265.763658:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1603 00000100:00100000:0.0:1789395265.763673:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231887872:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395265.763693:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395265.763702:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 16 pid: 6511 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.763721:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 16 pid: 6511 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.763750:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395265.763760:0:20671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.763774:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.763798:0:20671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.763846:0:20671:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395265.763865:0:20671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:20671:1876316239799168:0@lo:105: 00000100:00100000:0.0:1789395265.763925:0:20671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395265.763992:0:20671:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4cb1c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789395265.765599:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799168 00000100:00100000:3.0:1789395265.765613:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799168 00000100:00100000:3.0:1789395265.765744:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1789395265.765755:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20671:x1876316239799168:12345-0@lo:105: 00010000:00010000:3.0:1789395265.765771:0:6494:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.765784:0:6494:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.765794:0:6494:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.765804:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.765813:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.765822:0:6494:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.765840:0:6494:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a3ca3de400) 00000100:00100000:3.0:1789395265.765922:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20671:x1876316239799168:12345-0@lo:105: Request processed in 168us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395265.765931:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1789395265.765970:0:20671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:20671:1876316239799168:0@lo:105: 00010000:00010000:0.0:1789395265.765998:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395265.766018:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3df600/0xff35729af316d9b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa44584021065f3 expref: 16 pid: 6511 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395265.766033:0:20561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f650b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20561:1876316239799040:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395265.766055:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231887872:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 2386us (2575us total) trans 0 rc 0/0 00010000:00010000:3.0:1789395265.766057:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 21 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395265.766072:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1603 00010000:00010000:3.0:1789395265.766076:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395265.766081:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395265.766085:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56600, rc 0) 00000100:00100000:3.0:1789395265.766125:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:6511:x1876316239798912:12345-0@lo:101:mdt00_000.0 Request processed in 9133us (9373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395265.766133:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:3.0:1789395265.766176:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239798912:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1789395265.766192:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395265.766214:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1789395265.766544:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.766554:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.766565:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395265.766586:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799296:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1789395265.766627:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395265.766659:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789395265.768616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799296 00000100:00100000:0.0:1789395265.768635:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799296 00000100:00100000:0.0:1789395265.768716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619 00000100:00100000:0.0:1789395265.768729:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6511:x1876316239799296:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1789395265.768750:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395265.768918:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff35729af316d9cc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.768982:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xff35729af316d9cc expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.769001:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316d9cc expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.769010:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff89a4cb041b00) 00010000:00010000:0.0:1789395265.769014:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395265.769018:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d200, rc 0) 00000100:00100000:3.0:1789395265.770163:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799296:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1789395265.770164:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799296:12345-0@lo:101:mdt00_000.0 Request processed in 1429us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395265.770188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619 00010000:00010000:3.0:1789395265.770211:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.770229:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395265.770570:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1789395265.770645:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799424:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395265.770714:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395265.770762:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1789395265.771572:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799424 00000100:00100000:0.0:1789395265.771584:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799424 00000100:00100000:0.0:1789395265.772622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:0.0:1789395265.772646:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789395265.772813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799424:12345-0@lo:1000:mdt00_000.0 Request processed in 176us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395265.772821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:1.0:1789395265.775090:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799424:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395265.775202:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6508a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799552:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789395265.775581:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395265.775627:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca2ffa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789395265.777051:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799552 00000100:00100000:3.0:1789395265.777068:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799552 00000100:00100000:3.0:1789395265.777139:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621 00000100:00100000:3.0:1789395265.777151:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395265.777603:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799552:12345-0@lo:1000:mdt00_000.0 Request processed in 453us (2022us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789395265.777612:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621 00000100:00100000:3.0:1789395265.777674:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6508a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799552:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395265.777810:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799680:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395265.778376:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395265.778423:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395265.778445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799680 00000100:00100000:3.0:1789395265.778450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799680 00000100:00100000:3.0:1789395265.779118:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622 00000100:00100000:3.0:1789395265.779130:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789395265.779253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6511:x1876316239799680:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (879us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789395265.779455:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799680:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.779555:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799808:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.779592:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.779612:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb48000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.779627:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799808 00000100:00100000:2.0:1789395265.779632:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799808 00000100:00100000:2.0:1789395265.779666:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623 00000100:00100000:2.0:1789395265.779673:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6511:x1876316239799808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.779722:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6511:x1876316239799808:12345-0@lo:1000:mdt00_000.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.779730:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623 00000100:00100000:2.0:1789395265.779767:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799808:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.779809:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799936:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.779832:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.779845:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb48000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.779869:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239799936 00000100:00100000:2.0:1789395265.779872:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239799936 00000100:00100000:2.0:1789395265.779889:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:2.0:1789395265.779895:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6511:x1876316239799936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.779968:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6511:x1876316239799936:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.779975:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00000100:00100000:2.0:1789395265.780010:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239799936:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.780049:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239800064:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.780070:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.780084:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb48000 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.780094:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800064 00000100:00100000:2.0:1789395265.780097:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800064 00000100:00100000:2.0:1789395265.780113:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625 00000100:00100000:2.0:1789395265.780118:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6511:x1876316239800064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789395265.780162:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:6511:x1876316239800064:12345-0@lo:1000:mdt00_000.0 Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.780168:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625 00000100:00100000:2.0:1789395265.780190:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6511:1876316239800064:0@lo:1000:mdt00_000.0 00000040:00080000:2.0:1789395265.780801:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].394, 984 off588352 00000040:00080000:2.0:1789395265.780867:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].394, 1136 off642832 00000004:00080000:2.0:1789395265.780874:0:6511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a4fbb48600 with version 753 00000004:00080000:2.0:1789395265.780897:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 753 rpc_version 753 00000020:00100000:2.0:1789395265.780922:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789395265.780931:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9124380 x1876316239800320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789395265.780960:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239800320:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395265.780995:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.781015:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.781029:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800320 00000100:00100000:2.0:1789395265.781035:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800320 00000100:00100000:2.0:1789395265.781061:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626 00000100:00100000:2.0:1789395265.781068:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:7455:x1876316239800320:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395265.781412:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:7455:x1876316239800320:12345-0@lo:1000:osp_up0-1.0 Request processed in 343us (414us total) trans 4294984135 rc 0/0 00000100:00100000:2.0:1789395265.781419:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626 00000100:00100000:2.0:1789395265.781470:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9124380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239800320:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1789395265.783249:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622 00010000:00010000:2.0:1789395265.791448:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791541:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791557:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395265.791607:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001915d849 reply state 00000000515520eb transno 4294968535 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791621:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791630:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:2.0:1789395265.791633:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395265.791638:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789395265.791646:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000004:00080000:2.0:1789395265.791660:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789395265.791677:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791691:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791698:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791865:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789395265.791874:0:6511:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1789395265.791882:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.791891:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395265.792111:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22228:x1876316231887744:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 37964us (42372us total) trans 4294968535 rc 0/0 00000100:00100000:2.0:1789395265.792121:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23859 00010000:00010000:0.0:1789395265.792924:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789395265.792935:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.792944:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:0.0:1789395265.792961:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395265.792971:0:7918:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.793092:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.793100:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789395265.793134:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.793148:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca3de400/0xff35729af316d9be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xff35729af316d9c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.793164:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395265.793166:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789395265.793168:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395265.793243:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239800448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395265.793453:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395265.793575:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800448 00000100:00100000:0.0:1789395265.793585:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800448 00000100:00100000:0.0:1789395265.793644:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1789395265.793654:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3639:x1876316239800448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789395265.793668:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395265.793691:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56600/0xff35729af316d9c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xff35729af316d9be expref: 23 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.793707:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395265.793711:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395265.793749:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3639:x1876316239800448:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395265.793756:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1789395265.793977:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239800448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789395265.806357:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395265.806452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231888000 00000100:00100000:1.0:1789395265.806467:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231888000 00000100:00100000:1.0:1789395265.806548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23860 00000100:00100000:1.0:1789395265.806560:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22229:x1876316231888000:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395265.806585:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395265.806625:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d9e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021065fa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.806718:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d9e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.806735:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.806748:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395265.806806:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:1.0:1789395265.806810:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395265.806837:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.806867:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b57200/0xff35729af316d9e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065fa expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.806890:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065fa expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.806900:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:1.0:1789395265.806903:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789395265.806907:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56800, rc 0) 00000100:00100000:1.0:1789395265.806991:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22229:x1876316231888000:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 432us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395265.807002:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23860 00000100:00100000:3.0:1789395265.823553:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395265.823601:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231888256 00000100:00100000:3.0:1789395265.823614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231888256 00000100:00100000:3.0:1789395265.823680:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23861 00000100:00100000:3.0:1789395265.823693:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22229:x1876316231888256:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395265.823718:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395265.823722:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789395265.823753:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3c9b56800/0xff35729af316d9e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021065fa expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.823776:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395265.823783:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395265.823799:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d9ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106601 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.825428:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.825453:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.825466:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.825926:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.825943:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xff35729af316d9cc expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.825962:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.826403:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xff35729af316d9cc expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395265.826425:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239800576:0@lo:104: 00000100:00100000:3.0:1789395265.826976:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395265.827105:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca6cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789395265.827156:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789395265.827171:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800576 00000100:00100000:3.0:1789395265.827179:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800576 00000100:00100000:3.0:1789395265.827236:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1789395265.827246:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c2a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239800576:12345-0@lo:104: 00010000:00010000:3.0:1789395265.828418:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.828646:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789395265.828657:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c2a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6513:x1876316239800576:12345-0@lo:104: Request processed in 1409us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395265.828667:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1789395265.835957:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c904df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1876316239800576:0@lo:104: 00010000:00010000:3.0:1789395265.835994:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.839135:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789395265.839157:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.839171:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ba00 already unused, calling callback (ffffffffc1969ee0) 00010000:00010000:2.0:1789395265.839181:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395265.839195:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.840366:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.840687:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789395265.840728:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.840739:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a3ca51ba00/0xff35729af316d9cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xff35729af316d9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.840766:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395265.840768:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395265.840770:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395265.840782:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789395265.840809:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239800704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395265.841603:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.841662:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800704 00000100:00100000:2.0:1789395265.841672:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800704 00010000:00010000:2.0:1789395265.841712:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xff35729af316d9cc expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395265.841753:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:2.0:1789395265.841764:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:3637:x1876316239800704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789395265.841783:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1789395265.849630:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984135 is committed 00010000:00010000:3.0:1789395265.849743:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10d200/0xff35729af316d9d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xff35729af316d9cc expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.849764:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff89a4cb041b00) 00010000:00010000:3.0:1789395265.849771:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.849783:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.849792:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.849822:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395265.849982:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.849992:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395265.850208:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239800832:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395265.851178:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3637:x1876316239800704:12345-0@lo:103:ldlm_bl.0 Request processed in 9408us (9569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395265.851194:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:2.0:1789395265.851381:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395265.851430:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4e7eac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789395265.851453:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800832 00000100:00100000:2.0:1789395265.851462:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800832 00000100:00100000:0.0:1789395265.851611:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6586680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239800704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789395265.851740:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627 00000100:00100000:2.0:1789395265.851750:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239800832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395265.851856:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6513:x1876316239800832:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.851864:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627 00000100:00100000:2.0:1789395265.852127:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6587100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1876316239800832:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789395265.854196:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316da04 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854220:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316da04 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854233:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316da04 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854578:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854593:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854601:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854608:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854614:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395265.854620:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854630:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854645:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:2.0:1789395265.854648:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395265.854653:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854661:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b600/0xff35729af316d9f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854676:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854683:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854688:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854693:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395265.854696:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854702:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854709:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff89a4cb041b00) 00010000:00010000:2.0:1789395265.854712:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395265.854714:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854720:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51a800/0xff35729af316d9fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854783:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51aa00/0xff35729af316d9ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106601 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854799:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca3dfc00/0xff35729af316da04 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106601 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.854806:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3900) 00010000:00010000:2.0:1789395265.854809:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395265.854811:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfc00, rc 0) 00000100:00100000:2.0:1789395265.855085:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22229:x1876316231888256:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 31393us (31610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.855095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23861 00000100:00100000:2.0:1789395265.862879:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395265.863074:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231888512 00000100:00100000:0.0:1789395265.863088:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231888512 00000100:00100000:0.0:1789395265.863156:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23862 00000100:00100000:0.0:1789395265.863167:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22229:x1876316231888512:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395265.863193:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395265.863216:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da0b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106608 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395265.863746:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:0.0:1789395265.863779:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da0b lrc: 1/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106608 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.863795:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:0.0:1789395265.863799:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395265.863804:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da0b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106608 expref: 9 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.863819:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:0.0:1789395265.864086:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22229:x1876316231888512:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 920us (1219us total) trans 0 rc 301/301 00000100:00100000:0.0:1789395265.864095:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23862 00000100:00100000:0.0:1789395265.868340:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395265.868794:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231888640 00000100:00100000:3.0:1789395265.868807:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231888640 00000100:00100000:3.0:1789395265.868881:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23863 00000100:00100000:3.0:1789395265.868892:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22229:x1876316231888640:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:3.0:1789395265.868915:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395265.868940:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316da12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210660f expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.869285:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316da19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.869307:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316da19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.869326:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316da19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395265.869651:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 262144 00000004:00200000:3.0:1789395265.869656:0:21735:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789395265.869684:0:21735:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316da19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.869713:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b000/0xff35729af316da12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210660f expref: 18 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.869729:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca51b400/0xff35729af316da19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210660f expref: 17 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395265.869739:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:3.0:1789395265.869742:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789395265.869746:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b400, rc 0) 00000100:00100000:3.0:1789395265.869816:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22229:x1876316231888640:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 925us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395265.869823:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23863 00000100:00100000:3.0:1789395265.872828:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395265.873008:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231888896 00000100:00100000:0.0:1789395265.873021:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231888896 00000100:00100000:0.0:1789395265.873093:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23864 00000100:00100000:0.0:1789395265.873105:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22229:x1876316231888896:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395265.873127:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395265.873154:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316da20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106616 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873239:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873260:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873283:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873299:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873306:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873313:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873447:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316da35 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873457:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316da35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873465:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316da35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873488:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873495:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873502:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873515:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873521:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395265.873526:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873535:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873547:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395265.873550:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395265.873556:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873563:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10c200/0xff35729af316da27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873579:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873586:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873593:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.873598:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10de00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395265.873601:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.875715:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.875738:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff89a4cb041800) 00010000:00010000:0.0:1789395265.875741:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395265.875846:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.875857:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10de00/0xff35729af316da2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.875924:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10cc00/0xff35729af316da20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106616 expref: 19 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.876157:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316da35 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106616 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.876165:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3900) 00010000:00010000:0.0:1789395265.876168:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395265.876170:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:0.0:1789395265.876323:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22229:x1876316231888896:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 3218us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395265.876332:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23864 00000100:00100000:2.0:1789395265.881786:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395265.881906:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231889152 00000100:00100000:0.0:1789395265.881921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231889152 00000100:00100000:0.0:1789395265.882158:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23865 00000100:00100000:0.0:1789395265.882179:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22229:x1876316231889152:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395265.882206:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395265.882229:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da3c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210661d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395265.882332:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:0.0:1789395265.882465:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da3c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210661d expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.882481:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:0.0:1789395265.882484:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395265.882490:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da3c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210661d expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395265.882504:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:0.0:1789395265.882571:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22229:x1876316231889152:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 395us (800us total) trans 4294968536 rc 301/301 00000100:00100000:0.0:1789395265.882578:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23865 00000100:00100000:3.0:1789395265.885942:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395265.886432:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231889280 00000100:00100000:2.0:1789395265.886446:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231889280 00000100:00100000:2.0:1789395265.886526:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1399 00000100:00100000:2.0:1789395265.886536:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231889280:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395265.886552:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395265.886578:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca10ca00/0xff35729af316da35 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106616 expref: 18 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395265.886602:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3900) 00010000:00010000:2.0:1789395265.886608:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395265.887078:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231889280:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 541us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395265.887086:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1399 00000100:00100000:3.0:1789395265.897619:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395265.897795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231889536 00000100:00100000:1.0:1789395265.897820:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231889536 00000100:00100000:1.0:1789395265.897907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23866 00000100:00100000:1.0:1789395265.897919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22229:x1876316231889536:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:1.0:1789395265.898287:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.898306:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.898319:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395265.899162:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c3a8787 reply state 0000000079fb9406 transno 4294968537 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.899180:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395265.899189:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:1.0:1789395265.899191:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1789395265.899195:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789395265.899204:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000100:00100000:1.0:1789395265.899293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22229:x1876316231889536:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 1374us (1689us total) trans 4294968537 rc 0/0 00000100:00100000:1.0:1789395265.899302:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23866 00000100:00100000:3.0:1789395265.907620:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395265.907978:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231889792 00000100:00100000:1.0:1789395265.907998:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231889792 00000100:00100000:1.0:1789395265.908075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5214 00000100:00100000:1.0:1789395265.908086:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22229:x1876316231889792:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:0.0:1789395265.910234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22229:x1876316231889792:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 2136us (2615us total) trans 4294968538 rc 0/0 00000100:00100000:0.0:1789395265.910489:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5214 00000100:00100000:3.0:1789395266.009995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.010128:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231890048 00000100:00100000:2.0:1789395266.010141:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231890048 00000100:00100000:2.0:1789395266.010221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23867 00000100:00100000:2.0:1789395266.010234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231890048:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.010273:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.010298:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316da51 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106624 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.010495:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.010511:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.010531:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.010549:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.010556:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.010563:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395266.010748:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4f6585f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239800960:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789395266.010810:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395266.010874:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4fbb480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395266.011282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239800960 00000100:00100000:3.0:1789395266.011289:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239800960 00000100:00100000:3.0:1789395266.011338:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628 00000100:00100000:3.0:1789395266.011346:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6513:x1876316239800960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789395266.011655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6513:x1876316239800960:12345-0@lo:1000:mdt00_002.0 Request processed in 309us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.011663:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628 00000100:00100000:0.0:1789395266.011751:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294984135 gen 2 00000004:00080000:0.0:1789395266.011758:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294984135 committed transno 4294984135 00000100:00100000:0.0:1789395266.011785:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4f6585f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6513:1876316239800960:0@lo:1000:mdt00_002.0 00000004:00080000:0.0:1789395266.012140:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789395266.012375:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da66 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012638:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da66 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012651:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da66 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012699:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012707:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012713:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012720:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012726:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.012731:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012739:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012753:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:0.0:1789395266.012756:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.012761:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012768:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316da58 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395266.012788:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000410104b5 reply state 0000000078f4da07 transno 4294968539 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012801:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012807:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x69eaf62e (ffff89a4c92e3a00) 00010000:00010000:0.0:1789395266.012810:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395266.012812:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395266.012867:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316da51 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106624 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012882:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da66 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106624 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.012890:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:0.0:1789395266.012892:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395266.012894:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:0.0:1789395266.012983:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231890048:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2752us (3002us total) trans 4294968539 rc 0/0 00000100:00100000:0.0:1789395266.012992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23867 00000100:00100000:3.0:1789395266.028864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.029040:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231890304 00000100:00100000:1.0:1789395266.029054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231890304 00000100:00100000:1.0:1789395266.029123:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5215 00000100:00100000:1.0:1789395266.029136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d8a49850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231890304:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:1.0:1789395266.029596:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d8a49850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231890304:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 462us (756us total) trans 4294968540 rc 0/0 00000100:00100000:1.0:1789395266.029606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5215 00000100:00100000:3.0:1789395266.032822:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.033202:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231890432 00000100:00100000:1.0:1789395266.033216:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231890432 00000100:00100000:1.0:1789395266.033300:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23868 00000100:00100000:1.0:1789395266.033312:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231890432:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:0.0:1789395266.042895:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968540 is committed 00000020:00080000:0.0:1789395266.042922:0:7442:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a4fbb48000 refcount 2 committed 0 result 0 batchid 400 00000020:00080000:0.0:1789395266.042928:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3cac27100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a4fbb48600 00000020:00080000:0.0:1789395266.042932:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].394 00000020:00080000:0.0:1789395266.042935:0:7442:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89a3cac27b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a4efe92400 00000020:00080000:0.0:1789395266.042938:0:7442:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].394 00000020:00080000:2.0:1789395266.043034:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 400 committed batchid 399 00010000:00010000:3.0:1789395266.043109:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043123:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043131:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789395266.043135:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 399 00010000:00010000:3.0:1789395266.043139:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.043148:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043158:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043177:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:3.0:1789395266.043181:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.043186:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043193:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316d9da lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043217:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043224:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043231:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043235:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.043239:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043245:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043251:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3b00) 00010000:00010000:3.0:1789395266.043253:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789395266.043257:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043262:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57600/0xff35729af316da4a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043283:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043289:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043296:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043302:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.043306:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043312:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043320:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x69eaf62e (ffff89a4c92e3a00) 00010000:00010000:3.0:1789395266.043322:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.043325:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.043330:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316da5f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.043541:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:22236:x1876316231890432:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 10222us (10725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.043556:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23868 00000100:00100000:0.0:1789395266.047803:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.048079:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231890688 00000100:00100000:3.0:1789395266.048094:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231890688 00000100:00100000:3.0:1789395266.048169:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23869 00000100:00100000:3.0:1789395266.048180:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:22236:x1876316231890688:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395266.048205:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.048231:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316da74 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210662b expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.048424:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.048441:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.048458:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.051344:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.051369:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.051405:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395266.052208:0:21735:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789395266.052357:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316da89 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052369:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316da89 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052378:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316da89 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052904:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052912:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052919:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052924:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.052930:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052938:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.052960:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c7b89d00) 00010000:00010000:3.0:1789395266.052963:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.052969:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.053033:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316da7b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395266.053048:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f180b780 reply state 0000000028111546 transno 4294968541 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.053060:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.053066:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x112b43cf (ffff89a4c7b89700) 00010000:00010000:3.0:1789395266.053068:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395266.053071:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395266.053111:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316da74 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210662b expref: 10 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.053826:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316da89 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210662b expref: 9 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.053837:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:3.0:1789395266.053840:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.053843:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a600, rc 0) 00000100:00100000:3.0:1789395266.053982:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22236:x1876316231890688:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 5795us (6184us total) trans 4294968541 rc 0/0 00000100:00100000:3.0:1789395266.053991:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23869 00000100:00100000:3.0:1789395266.064069:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.066301:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231890944 00000100:00100000:0.0:1789395266.066317:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231890944 00000100:00100000:0.0:1789395266.066377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5216 00000100:00100000:0.0:1789395266.067481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22236:x1876316231890944:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.067823:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231890944:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 358us (3855us total) trans 4294968542 rc 0/0 00000100:00100000:0.0:1789395266.067832:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5216 00000100:00100000:2.0:1789395266.075030:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.075435:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231891072 00000100:00100000:0.0:1789395266.075446:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231891072 00000100:00100000:0.0:1789395266.075515:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23870 00000100:00100000:0.0:1789395266.075525:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231891072:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:0.0:1789395266.080220:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968542 is committed 00000020:00080000:0.0:1789395266.080244:0:7442:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 400 batchid updated 00000020:00080000:2.0:1789395266.080324:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 400 00000004:00080000:2.0:1789395266.080446:0:7463:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a4fbb483c0 with version 754 00000020:00080000:2.0:1789395266.080464:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 400 cancel update log [0x200000401:0x3:0x0].394: rc = 0 00000020:00080000:2.0:1789395266.080574:0:7463:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 400 cancel update log [0x240000400:0x3:0x0].394: rc = 0 00000100:00100000:3.0:1789395266.080585:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22236:x1876316231891072:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 5051us (5553us total) trans 0 rc 0/0 00000020:00080000:2.0:1789395266.080594:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 400 00000100:00100000:3.0:1789395266.080603:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23870 00000004:00080000:0.0:1789395266.080734:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a4efe2fc00 version 754 rpc_version 754 00000020:00100000:0.0:1789395266.080774:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789395266.080785:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a3c9e18000 x1876316239801216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789395266.080815:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239801216:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1789395266.080882:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395266.080960:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801216 00000100:00100000:0.0:1789395266.080963:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a4cb1c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789395266.080979:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801216 00000100:00100000:2.0:1789395266.081103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629 00000100:00100000:2.0:1789395266.081113:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:7455:x1876316239801216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1789395266.081312:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7455:x1876316239801216:12345-0@lo:1000:osp_up0-1.0 Request processed in 200us (428us total) trans 4294984136 rc 0/0 00000100:00100000:2.0:1789395266.081320:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629 00000100:00100000:3.0:1789395266.081787:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1876316239801216:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1789395266.082497:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.082512:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.082522:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.082528:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51a400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395266.082534:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.082543:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.082563:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x112b43cf (ffff89a4c7b89700) 00010000:00010000:1.0:1789395266.082566:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395266.082571:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.082579:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316da82 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.084910:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.085109:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231891328 00000100:00100000:0.0:1789395266.085122:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231891328 00000100:00100000:0.0:1789395266.085228:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23871 00000100:00100000:0.0:1789395266.085239:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22236:x1876316231891328:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395266.085262:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.085290:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316da97 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106632 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.085471:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.085486:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.085497:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.085510:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.085515:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.085521:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395266.085960:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789395266.086126:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316daac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086136:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316daac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086144:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316daac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086184:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086196:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086202:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086208:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086215:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.086221:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086228:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086241:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cbc0ea00) 00010000:00010000:0.0:1789395266.086244:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.086249:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086255:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316da9e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395266.086271:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a98fa3e reply state 000000005bf76ad4 transno 4294968543 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086284:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086291:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5e132fd4 (ffff89a4cbc0e800) 00010000:00010000:0.0:1789395266.086294:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395266.086296:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395266.086329:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316da97 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106632 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086350:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316daac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106632 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.086358:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395266.086360:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395266.086362:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10dc00, rc 0) 00000100:00100000:0.0:1789395266.086495:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231891328:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1256us (1645us total) trans 4294968543 rc 0/0 00000100:00100000:0.0:1789395266.086506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23871 00000100:00100000:2.0:1789395266.090790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.091144:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231891584 00000100:00100000:3.0:1789395266.091158:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231891584 00000100:00100000:3.0:1789395266.091294:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5217 00000100:00100000:3.0:1789395266.091305:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231891584:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:3.0:1789395266.091639:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231891584:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 335us (858us total) trans 4294968544 rc 0/0 00000100:00100000:3.0:1789395266.091646:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5217 00000100:00100000:0.0:1789395266.094454:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.094913:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231891712 00000100:00100000:1.0:1789395266.094926:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231891712 00000100:00100000:1.0:1789395266.095149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23872 00000100:00100000:1.0:1789395266.095163:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231891712:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:0.0:1789395266.098789:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968544 is committed 00000100:00100000:1.0:1789395266.099074:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22236:x1876316231891712:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 3907us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.099090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23872 00010000:00010000:3.0:1789395266.100507:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.100528:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.100538:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.100545:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.100553:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.100562:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.100583:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5e132fd4 (ffff89a4cbc0e800) 00010000:00010000:3.0:1789395266.100586:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.100591:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.100598:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316daa5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395266.107769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.107971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231891968 00000100:00100000:2.0:1789395266.107985:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231891968 00000100:00100000:2.0:1789395266.108065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23873 00000100:00100000:2.0:1789395266.108077:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22236:x1876316231891968:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.108104:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.108134:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316daba lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106639 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.108280:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.108296:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.108308:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.110792:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.110820:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.110833:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.111982:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789395266.112189:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316dacf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112205:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316dacf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112215:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316dacf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112257:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112265:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112271:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112278:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112285:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.112290:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112299:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112313:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3400) 00010000:00010000:2.0:1789395266.112316:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.112595:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112605:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dac1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.112624:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da7b3673 reply state 00000000370035a4 transno 4294968545 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112637:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112712:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xd873b914 (ffff89a4c92e3600) 00010000:00010000:2.0:1789395266.112714:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.112718:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.112767:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316daba lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106639 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112791:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316dacf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106639 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.112800:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:2.0:1789395266.112802:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.112805:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:2.0:1789395266.113032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231891968:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4956us (5278us total) trans 4294968545 rc 0/0 00000100:00100000:2.0:1789395266.113042:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23873 00000100:00100000:2.0:1789395266.118773:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.119109:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231892224 00000100:00100000:0.0:1789395266.119123:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231892224 00000100:00100000:0.0:1789395266.119197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5218 00000100:00100000:0.0:1789395266.119208:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231892224:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.120088:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22236:x1876316231892224:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 876us (1325us total) trans 4294968546 rc 0/0 00000100:00100000:0.0:1789395266.120100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5218 00000100:00100000:0.0:1789395266.123778:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.124020:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231892352 00000100:00100000:1.0:1789395266.124034:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231892352 00000100:00100000:1.0:1789395266.124110:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23874 00000100:00100000:1.0:1789395266.124121:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22236:x1876316231892352:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:0.0:1789395266.126832:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968546 is committed 00000100:00100000:2.0:1789395266.127099:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231892352:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2971us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395266.127113:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23874 00000100:00100000:3.0:1789395266.131369:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.131628:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231892608 00000100:00100000:0.0:1789395266.131653:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231892608 00000100:00100000:0.0:1789395266.131723:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23875 00000100:00100000:0.0:1789395266.131735:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231892608:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395266.131758:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.131786:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316dadd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106640 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.131928:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.131955:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.131968:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.131984:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.131992:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.131999:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395266.132500:0:21735:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789395266.132672:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316daf2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132682:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316daf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132695:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316daf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132736:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132744:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132752:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132758:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.132763:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132773:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132787:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041c00) 00010000:00010000:0.0:1789395266.132790:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.132795:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132802:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dae4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395266.132818:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf0565de reply state 00000000bdf7f676 transno 4294968547 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132830:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132837:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x233016a9 (ffff89a4cb041d00) 00010000:00010000:0.0:1789395266.132839:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395266.132841:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395266.132876:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316dadd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106640 expref: 14 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132900:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316daf2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106640 expref: 13 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.132908:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:0.0:1789395266.132911:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395266.132913:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c000, rc 0) 00000100:00100000:0.0:1789395266.133008:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231892608:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1275us (1653us total) trans 4294968547 rc 0/0 00000100:00100000:0.0:1789395266.133018:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23875 00010000:00010000:1.0:1789395266.134289:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.134304:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.134317:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.134401:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395266.134407:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.134471:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.134487:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xd873b914 (ffff89a4c92e3600) 00010000:00010000:1.0:1789395266.134489:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395266.134493:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.134499:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dac8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.138867:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.139036:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231892864 00000100:00100000:1.0:1789395266.139051:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231892864 00000100:00100000:1.0:1789395266.139132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5219 00000100:00100000:1.0:1789395266.139144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22236:x1876316231892864:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:1.0:1789395266.139578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231892864:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 435us (737us total) trans 4294968548 rc 0/0 00000100:00100000:1.0:1789395266.139586:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5219 00000100:00100000:3.0:1789395266.143718:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.143916:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231892992 00000100:00100000:0.0:1789395266.143929:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231892992 00000100:00100000:0.0:1789395266.144021:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23876 00000100:00100000:0.0:1789395266.144033:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231892992:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.146176:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968548 is committed 00000100:00100000:0.0:1789395266.146796:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231892992:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2756us (3082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.146812:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23876 00010000:00010000:3.0:1789395266.147532:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.147550:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.147559:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.147566:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.147571:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.147581:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.147599:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x233016a9 (ffff89a4cb041d00) 00010000:00010000:3.0:1789395266.147603:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.147608:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.147614:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316daeb lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.153499:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.153804:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231893248 00000100:00100000:0.0:1789395266.153818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231893248 00000100:00100000:0.0:1789395266.153899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23877 00000100:00100000:0.0:1789395266.153911:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22236:x1876316231893248:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395266.153937:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.153973:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db00 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106647 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.154110:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.154127:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.154140:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.156422:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.156448:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.156462:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395266.156814:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789395266.156976:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316db15 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.156986:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316db15 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.156993:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316db15 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157029:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157036:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157041:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157047:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157052:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.157057:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157064:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157075:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041c00) 00010000:00010000:0.0:1789395266.157078:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.157083:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157089:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db07 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395266.157102:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054e44e5f reply state 00000000b465817d transno 4294968549 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157112:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157119:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa88c5e99 (ffff89a4cb041700) 00010000:00010000:0.0:1789395266.157121:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395266.157124:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395266.157162:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db00 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106647 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157184:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316db15 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106647 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.157192:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:0.0:1789395266.157195:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395266.157197:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d000, rc 0) 00000100:00100000:0.0:1789395266.157270:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231893248:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3360us (3786us total) trans 4294968549 rc 0/0 00000100:00100000:0.0:1789395266.157279:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23877 00000100:00100000:2.0:1789395266.166872:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.167158:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231893504 00000100:00100000:3.0:1789395266.167180:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231893504 00000100:00100000:3.0:1789395266.167250:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5220 00000100:00100000:3.0:1789395266.167261:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231893504:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:2.0:1789395266.168081:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231893504:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 816us (1228us total) trans 4294968550 rc 0/0 00000100:00100000:2.0:1789395266.168094:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5220 00000100:00100000:3.0:1789395266.171602:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.171764:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231893632 00000100:00100000:0.0:1789395266.171780:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231893632 00000100:00100000:0.0:1789395266.171862:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23878 00000100:00100000:0.0:1789395266.171873:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231893632:12345-192.168.203.54@tcp:44:createmany.0 00010000:00010000:2.0:1789395266.174760:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.174783:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.174794:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.174801:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.174807:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.174817:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.174837:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa88c5e99 (ffff89a4cb041700) 00010000:00010000:2.0:1789395266.174841:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.174905:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.174914:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db0e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395266.175004:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968550 is committed 00000100:00100000:0.0:1789395266.176249:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231893632:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 4368us (4649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.176265:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23878 00000100:00100000:0.0:1789395266.184880:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.184983:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231893888 00000100:00100000:2.0:1789395266.184996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231893888 00000100:00100000:2.0:1789395266.185094:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23879 00000100:00100000:2.0:1789395266.185105:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22236:x1876316231893888:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.185131:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.185158:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316db23 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210664e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.185299:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.185316:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.187022:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.190990:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.191018:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.191033:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.192878:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789395266.193093:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316db38 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.193112:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316db38 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.193124:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316db38 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.194928:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.194959:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.194968:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.194976:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.194983:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.194989:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.194997:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.195016:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395266.195020:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.195025:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.195031:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316db2a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.195053:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000469e92cb reply state 000000004406103b transno 4294968551 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.195066:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.195074:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x24f3e3ee (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395266.195076:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.195079:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.195144:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316db23 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210664e expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.195180:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316db38 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210664e expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.195188:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:2.0:1789395266.195191:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.195194:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3de400, rc 0) 00000100:00100000:2.0:1789395266.195303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231893888:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 10198us (10436us total) trans 4294968551 rc 0/0 00000100:00100000:2.0:1789395266.195313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23879 00000100:00100000:2.0:1789395266.199710:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.200975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231894144 00000100:00100000:0.0:1789395266.200993:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231894144 00000100:00100000:0.0:1789395266.201135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5221 00000100:00100000:0.0:1789395266.201147:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231894144:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.201798:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231894144:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 650us (2100us total) trans 4294968552 rc 0/0 00000100:00100000:0.0:1789395266.201808:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5221 00000100:00100000:0.0:1789395266.205835:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.208311:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231894272 00000100:00100000:2.0:1789395266.208474:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231894272 00000100:00100000:2.0:1789395266.208624:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23880 00000100:00100000:2.0:1789395266.208637:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231894272:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.211239:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968552 is committed 00000100:00100000:2.0:1789395266.212913:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231894272:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 4262us (7075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395266.212932:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23880 00010000:00010000:3.0:1789395266.213991:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.214009:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.214017:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.214022:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.214028:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.214037:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.214061:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x24f3e3ee (ffff89a4f3d38f00) 00010000:00010000:3.0:1789395266.214065:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.214071:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.214078:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316db31 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395266.224141:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.224264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231894528 00000100:00100000:1.0:1789395266.224279:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231894528 00000100:00100000:1.0:1789395266.224347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23881 00000100:00100000:1.0:1789395266.224358:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22236:x1876316231894528:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:1.0:1789395266.224419:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395266.224448:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56e00/0xff35729af316db46 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106655 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.224598:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.224615:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.224630:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.224646:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.224652:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.224658:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395266.225285:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00000100:00100000:3.0:1789395266.226973:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789395266.227003:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239801344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395266.227093:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395266.227227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801344 00000100:00100000:0.0:1789395266.227237:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801344 00000100:00100000:0.0:1789395266.227295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630 00000100:00100000:0.0:1789395266.227313:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239801344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395266.227362:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443876864 avail 1297637376 00000100:00100000:0.0:1789395266.227437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239801344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.227444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630 00000100:00100000:3.0:1789395266.227844:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239801344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789395266.231651:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57c00/0xff35729af316db5b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231680:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57c00/0xff35729af316db5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231765:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57c00/0xff35729af316db5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231854:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231862:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231868:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231876:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231883:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395266.231887:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231895:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231909:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:1.0:1789395266.231913:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395266.231918:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.231924:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316db4d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395266.232009:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b37f0be reply state 00000000de5a63d7 transno 4294968553 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.232025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.232032:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x3f283190 (ffff89a3ca5d9000) 00010000:00010000:1.0:1789395266.232034:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395266.232038:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395266.232102:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56e00/0xff35729af316db46 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106655 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.232128:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57c00/0xff35729af316db5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106655 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.232136:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:1.0:1789395266.232138:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395266.232140:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57c00, rc 0) 00000100:00100000:1.0:1789395266.232312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231894528:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 7954us (8185us total) trans 4294968553 rc 0/0 00000100:00100000:1.0:1789395266.232322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23881 00000100:00100000:1.0:1789395266.242704:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.243019:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231894784 00000100:00100000:2.0:1789395266.243032:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231894784 00000100:00100000:2.0:1789395266.243114:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5222 00000100:00100000:2.0:1789395266.243126:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231894784:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:3.0:1789395266.243932:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22236:x1876316231894784:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 801us (1233us total) trans 4294968554 rc 0/0 00000100:00100000:3.0:1789395266.243954:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5222 00000100:00100000:0.0:1789395266.250313:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.250379:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231894912 00000100:00100000:3.0:1789395266.250444:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231894912 00000100:00100000:3.0:1789395266.250518:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23882 00000100:00100000:3.0:1789395266.250529:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22236:x1876316231894912:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.258253:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968554 is committed 00010000:00010000:2.0:1789395266.258381:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.258668:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.258677:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.258684:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b56c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.258690:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.258700:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.258723:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x3f283190 (ffff89a3ca5d9000) 00010000:00010000:2.0:1789395266.258726:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.258732:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.258739:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316db54 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.261875:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231894912:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 11329us (11558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.261895:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23882 00000100:00100000:2.0:1789395266.269063:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.269220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231895168 00000100:00100000:0.0:1789395266.269235:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231895168 00000100:00100000:0.0:1789395266.269314:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23883 00000100:00100000:0.0:1789395266.269326:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22236:x1876316231895168:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395266.269353:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.269419:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316db69 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210665c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.269568:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.269584:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.269602:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.269615:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.269623:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.269629:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789395266.273893:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789395266.278639:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db7e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278664:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db7e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278676:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db7e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278722:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278728:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278735:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278742:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278750:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.278755:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278763:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278775:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041c00) 00010000:00010000:0.0:1789395266.278778:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.278784:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278790:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316db70 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395266.278807:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063b32685 reply state 00000000ba76ff6d transno 4294968555 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278818:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278824:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa000570f (ffff89a4cb041b00) 00010000:00010000:0.0:1789395266.278826:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395266.278829:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395266.278875:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316db69 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210665c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278897:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db7e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210665c expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.278909:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:0.0:1789395266.278911:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395266.278913:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d400, rc 0) 00000100:00100000:0.0:1789395266.279870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22236:x1876316231895168:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 10537us (10824us total) trans 4294968555 rc 0/0 00000100:00100000:0.0:1789395266.279883:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23883 00000100:00100000:1.0:1789395266.284617:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.284727:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231895424 00000100:00100000:0.0:1789395266.284741:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231895424 00000100:00100000:0.0:1789395266.284809:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5223 00000100:00100000:0.0:1789395266.284821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22236:x1876316231895424:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.285308:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22236:x1876316231895424:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 486us (926us total) trans 4294968556 rc 0/0 00000100:00100000:0.0:1789395266.285318:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5223 00000100:00100000:3.0:1789395266.288769:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.288889:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231895552 00000100:00100000:0.0:1789395266.288902:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231895552 00000100:00100000:0.0:1789395266.289380:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23884 00000100:00100000:0.0:1789395266.289450:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22236:x1876316231895552:12345-192.168.203.54@tcp:44:createmany.0 00010000:00010000:2.0:1789395266.290264:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789395266.291529:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968556 is committed 00000100:00100000:0.0:1789395266.291784:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231895552:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2332us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.291797:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23884 00010000:00010000:2.0:1789395266.292607:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.292628:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.292637:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.292645:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10ce00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.292650:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.292659:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.292677:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa000570f (ffff89a4cb041b00) 00010000:00010000:2.0:1789395266.292681:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.292686:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.292692:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316db77 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.295843:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.295969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231895808 00000100:00100000:2.0:1789395266.295982:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231895808 00000100:00100000:3.0:1789395266.296544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23885 00000100:00100000:3.0:1789395266.296558:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22236:x1876316231895808:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395266.296585:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.296611:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316db8c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106663 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.296810:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.296827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.296841:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.296898:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.296907:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.296915:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395266.301730:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789395266.302086:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316dba1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302107:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316dba1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302120:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316dba1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302719:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302730:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302736:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302744:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302750:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.302756:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302766:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302781:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c7b89d00) 00010000:00010000:3.0:1789395266.302784:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.302789:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302796:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316db93 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395266.302815:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078e6e110 reply state 00000000511155e1 transno 4294968557 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.302835:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x9a2cdc4e (ffff89a4c7b89400) 00010000:00010000:3.0:1789395266.302838:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395266.302841:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395266.302890:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316db8c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106663 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.303078:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316dba1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106663 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.303088:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:3.0:1789395266.303090:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.303093:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ae00, rc 0) 00000100:00100000:3.0:1789395266.303371:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22236:x1876316231895808:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 6814us (7539us total) trans 4294968557 rc 0/0 00000100:00100000:3.0:1789395266.303381:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23885 00000100:00100000:1.0:1789395266.308058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.308809:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231896064 00000100:00100000:3.0:1789395266.308825:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231896064 00000100:00100000:3.0:1789395266.308933:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5224 00000100:00100000:3.0:1789395266.308956:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22236:x1876316231896064:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:3.0:1789395266.309352:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:22236:x1876316231896064:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 407us (1308us total) trans 4294968558 rc 0/0 00000100:00100000:3.0:1789395266.309361:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5224 00000100:00100000:1.0:1789395266.314799:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.314966:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231896192 00000100:00100000:2.0:1789395266.314979:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231896192 00000100:00100000:2.0:1789395266.315058:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23886 00000100:00100000:2.0:1789395266.315070:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:22236:x1876316231896192:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:2.0:1789395266.317804:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968558 is committed 00010000:00010000:0.0:1789395266.317960:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.317976:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.317986:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.317993:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.317998:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.318007:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.318029:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x9a2cdc4e (ffff89a4c7b89400) 00010000:00010000:0.0:1789395266.318033:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.318039:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.318045:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316db9a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.318999:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231896192:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 3921us (4203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.319013:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23886 00000100:00100000:1.0:1789395266.322904:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.322995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231896448 00000100:00100000:3.0:1789395266.323010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231896448 00000100:00100000:3.0:1789395266.323084:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23887 00000100:00100000:3.0:1789395266.323096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22236:x1876316231896448:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395266.323121:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.323149:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dbaf lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210666a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323286:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323302:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323314:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323340:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323347:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323354:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395266.323781:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x7:0x0], index 1: 0 00010000:00010000:3.0:1789395266.323939:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316dbc4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323960:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316dbc4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.323969:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316dbc4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324012:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324020:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324027:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324033:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324040:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.324045:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324052:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324065:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c7b89d00) 00010000:00010000:3.0:1789395266.324068:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.324072:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324078:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dbb6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395266.324094:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003593f66d reply state 00000000aa55bcbd transno 4294968559 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324106:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324113:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xb3c1e899 (ffff89a4c7b89200) 00010000:00010000:3.0:1789395266.324115:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395266.324118:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395266.324158:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dbaf lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210666a expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324181:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316dbc4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210666a expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.324189:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:3.0:1789395266.324192:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.324194:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a000, rc 0) 00000100:00100000:3.0:1789395266.324282:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:22236:x1876316231896448:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1188us (1393us total) trans 4294968559 rc 0/0 00000100:00100000:3.0:1789395266.324291:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23887 00000100:00100000:1.0:1789395266.331034:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.331141:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231896704 00000100:00100000:0.0:1789395266.331156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231896704 00000100:00100000:0.0:1789395266.331231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5225 00000100:00100000:0.0:1789395266.331244:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f650b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:22236:x1876316231896704:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:1.0:1789395266.331764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f650b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:22236:x1876316231896704:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 518us (740us total) trans 4294968560 rc 0/0 00000100:00100000:1.0:1789395266.331775:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5225 00000100:00100000:1.0:1789395266.335150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.339282:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231896832 00000100:00100000:0.0:1789395266.339308:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231896832 00000100:00100000:0.0:1789395266.339452:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23888 00000100:00100000:0.0:1789395266.339465:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:22236:x1876316231896832:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.342039:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968560 is committed 00000100:00100000:0.0:1789395266.342595:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22236:x1876316231896832:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 3124us (7461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.342613:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23888 00010000:00010000:2.0:1789395266.344846:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.344869:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.344878:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.344884:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51be00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.344890:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.344899:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.344917:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xb3c1e899 (ffff89a4c7b89200) 00010000:00010000:2.0:1789395266.344921:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.344926:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.344933:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dbbd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.355879:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.355966:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231897088 00000100:00100000:0.0:1789395266.355981:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231897088 00000100:00100000:0.0:1789395266.356055:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23889 00000100:00100000:0.0:1789395266.356067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22236:x1876316231897088:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395266.356094:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.356121:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dbd2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106671 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.356256:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.356272:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.356284:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.358060:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.358087:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.358101:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789395266.358747:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x7:0x0], index 0: 0 00010000:00010000:1.0:1789395266.358972:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316dbe7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.358989:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316dbe7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359000:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316dbe7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359043:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359050:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359057:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359065:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359071:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395266.359076:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359085:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359098:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041c00) 00010000:00010000:1.0:1789395266.359102:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395266.359106:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359113:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dbd9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395266.359131:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053e6f3bc reply state 0000000053c522a2 transno 4294968561 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359141:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359147:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5b3c1a7 (ffff89a4cb041400) 00010000:00010000:1.0:1789395266.359150:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395266.359152:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395266.359195:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dbd2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106671 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359219:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316dbe7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106671 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.359227:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:1.0:1789395266.359229:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395266.359231:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57000, rc 0) 00000100:00100000:1.0:1789395266.359332:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:22236:x1876316231897088:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 3265us (3465us total) trans 4294968561 rc 0/0 00000100:00100000:1.0:1789395266.359342:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23889 00000100:00100000:1.0:1789395266.367929:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.368667:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231897344 00000100:00100000:0.0:1789395266.368680:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231897344 00000100:00100000:0.0:1789395266.368758:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5226 00000100:00100000:0.0:1789395266.368771:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:22236:x1876316231897344:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.369195:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231897344:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 424us (1278us total) trans 4294968562 rc 0/0 00000100:00100000:0.0:1789395266.369204:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5226 00000100:00100000:3.0:1789395266.378457:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.378600:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231897472 00000100:00100000:0.0:1789395266.378614:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231897472 00000100:00100000:0.0:1789395266.378692:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23890 00000100:00100000:0.0:1789395266.378703:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231897472:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.380312:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968562 is committed 00000100:00100000:3.0:1789395266.380566:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:22236:x1876316231897472:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 1859us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.380580:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23890 00010000:00010000:0.0:1789395266.381219:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.381236:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.381246:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.381253:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.381259:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.381269:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.381287:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5b3c1a7 (ffff89a4cb041400) 00010000:00010000:0.0:1789395266.381290:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.381296:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.381309:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c200/0xff35729af316dbe0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.385950:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.386160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231897728 00000100:00100000:0.0:1789395266.386173:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231897728 00000100:00100000:0.0:1789395266.386248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23891 00000100:00100000:0.0:1789395266.386260:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22236:x1876316231897728:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:0.0:1789395266.386284:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.386312:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316dbf5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106678 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.387082:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.387101:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.387114:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.389091:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.389120:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.389133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.389905:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x8:0x0], index 1: 0 00010000:00010000:2.0:1789395266.390103:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dc0a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390116:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dc0a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390125:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dc0a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390167:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390176:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390183:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390191:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390198:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.390204:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390218:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390232:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041e00) 00010000:00010000:2.0:1789395266.390235:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.390240:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390247:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dbfc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.390262:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011eea407 reply state 00000000221f2cd1 transno 4294968563 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390274:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390280:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x72a5df42 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395266.390282:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.390285:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.390663:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316dbf5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106678 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390694:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dc0a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106678 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.390703:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395266.390706:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.390709:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:2.0:1789395266.390861:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231897728:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 4601us (4931us total) trans 4294968563 rc 0/0 00000100:00100000:2.0:1789395266.390871:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23891 00000100:00100000:3.0:1789395266.396520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.396647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231897984 00000100:00100000:2.0:1789395266.396661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231897984 00000100:00100000:2.0:1789395266.396733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5227 00000100:00100000:2.0:1789395266.396745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231897984:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:2.0:1789395266.397117:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:22236:x1876316231897984:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 373us (663us total) trans 4294968564 rc 0/0 00000100:00100000:2.0:1789395266.397125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5227 00000100:00100000:1.0:1789395266.400759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.400864:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231898112 00000100:00100000:2.0:1789395266.400877:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231898112 00000100:00100000:2.0:1789395266.400958:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23892 00000100:00100000:2.0:1789395266.400970:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:22236:x1876316231898112:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.410631:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968564 is committed 00010000:00010000:2.0:1789395266.411010:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.411031:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.411041:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.411050:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3dfe00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.411056:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.411065:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.411088:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x72a5df42 (ffff89a4f3d38800) 00000100:00100000:3.0:1789395266.411094:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:22236:x1876316231898112:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 10111us (10333us total) trans 0 rc 0/0 00010000:00010000:2.0:1789395266.411095:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.411101:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.411116:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23892 00010000:00010000:2.0:1789395266.411131:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc03 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.425468:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.426201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231898368 00000100:00100000:3.0:1789395266.426218:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231898368 00000100:00100000:3.0:1789395266.426348:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23893 00000100:00100000:3.0:1789395266.426360:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:22236:x1876316231898368:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395266.426427:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.426456:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316dc18 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210667f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.426598:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.426614:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.426627:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.433716:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.433742:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.433755:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395266.434362:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x8:0x0], index 0: 0 00010000:00010000:3.0:1789395266.434609:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316dc2d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434621:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316dc2d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434707:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316dc2d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434746:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434754:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434760:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434767:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434773:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395266.434777:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434785:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1dd00) 00010000:00010000:3.0:1789395266.434801:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395266.434805:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434811:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc1f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789395266.434824:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019ba4b68 reply state 0000000085861057 transno 4294968565 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434835:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434840:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa14d934 (ffff89a3c8b1d800) 00010000:00010000:3.0:1789395266.434842:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395266.434845:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789395266.434880:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316dc18 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210667f expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434900:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316dc2d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210667f expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.434907:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:3.0:1789395266.434909:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.434911:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b200, rc 0) 00000100:00100000:3.0:1789395266.435082:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:22236:x1876316231898368:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 8723us (9623us total) trans 4294968565 rc 0/0 00000100:00100000:3.0:1789395266.435861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23893 00000100:00100000:1.0:1789395266.444974:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.445058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231898624 00000100:00100000:2.0:1789395266.445068:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231898624 00000100:00100000:2.0:1789395266.445142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5228 00000100:00100000:2.0:1789395266.445151:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:22236:x1876316231898624:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:2.0:1789395266.445475:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:22236:x1876316231898624:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 324us (509us total) trans 4294968566 rc 0/0 00000100:00100000:2.0:1789395266.445482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5228 00000100:00100000:1.0:1789395266.454138:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.454235:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231898752 00000100:00100000:3.0:1789395266.454245:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231898752 00000100:00100000:3.0:1789395266.454306:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23894 00000100:00100000:3.0:1789395266.454316:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:22236:x1876316231898752:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.456674:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968566 is committed 00000100:00100000:3.0:1789395266.456925:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231898752:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2602us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.456937:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23894 00010000:00010000:0.0:1789395266.457040:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.457055:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.457064:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.457071:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.457077:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.457086:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.457105:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa14d934 (ffff89a3c8b1d800) 00010000:00010000:0.0:1789395266.457108:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.457114:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.457122:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc26 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.475725:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.475849:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231899008 00000100:00100000:2.0:1789395266.475862:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231899008 00000100:00100000:2.0:1789395266.475954:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23895 00000100:00100000:2.0:1789395266.475970:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:22236:x1876316231899008:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.475995:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.476025:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc3b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106686 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.476165:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.476180:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.476193:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.476206:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.476214:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.476221:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.476857:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x9:0x0], index 1: 0 00010000:00010000:2.0:1789395266.478203:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535e00/0xff35729af316dc50 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478223:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535e00/0xff35729af316dc50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478235:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535e00/0xff35729af316dc50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478284:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478292:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478299:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478306:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478313:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.478319:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478326:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478338:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395266.478341:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.478345:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478352:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df600/0xff35729af316dc42 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.478370:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2210af9 reply state 000000007b948d9a transno 4294968567 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478380:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478430:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xc0330bcf (ffff89a4f3d38700) 00010000:00010000:2.0:1789395266.478432:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.478436:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.478477:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3dfe00/0xff35729af316dc3b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106686 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478499:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535e00/0xff35729af316dc50 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106686 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.478514:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:2.0:1789395266.478517:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.478519:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535e00, rc 0) 00000100:00100000:2.0:1789395266.478605:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:22236:x1876316231899008:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2640us (2895us total) trans 4294968567 rc 0/0 00000100:00100000:2.0:1789395266.478615:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23895 00000100:00100000:1.0:1789395266.487837:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.487937:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231899264 00000100:00100000:0.0:1789395266.487959:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231899264 00000100:00100000:0.0:1789395266.488025:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5229 00000100:00100000:0.0:1789395266.488036:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:22236:x1876316231899264:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.488425:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:22236:x1876316231899264:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 390us (600us total) trans 4294968568 rc 0/0 00000100:00100000:0.0:1789395266.488433:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5229 00000100:00100000:1.0:1789395266.498119:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.498232:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231899392 00000100:00100000:0.0:1789395266.498245:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231899392 00000100:00100000:0.0:1789395266.498368:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23896 00000100:00100000:0.0:1789395266.498380:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:22236:x1876316231899392:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:1.0:1789395266.503860:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968568 is committed 00010000:00010000:2.0:1789395266.503976:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.503992:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.504003:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.504011:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3df000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.504017:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.504026:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.504045:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xc0330bcf (ffff89a4f3d38700) 00010000:00010000:2.0:1789395266.504049:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.504055:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.504062:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316dc49 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395266.504924:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231899392:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 6536us (6811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.504939:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23896 00000100:00100000:1.0:1789395266.517796:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.517880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231899648 00000100:00100000:2.0:1789395266.517893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231899648 00000100:00100000:2.0:1789395266.517990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23897 00000100:00100000:2.0:1789395266.518002:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:22236:x1876316231899648:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.518039:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.518069:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dc5e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210668d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.518212:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.518227:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.518238:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.518251:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.518258:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.518265:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.519326:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9:0x0], index 0: 0 00010000:00010000:2.0:1789395266.520127:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534600/0xff35729af316dc73 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520152:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534600/0xff35729af316dc73 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520163:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534600/0xff35729af316dc73 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520208:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520216:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520224:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520231:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520237:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.520242:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520250:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520263:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38700) 00010000:00010000:2.0:1789395266.520266:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.520271:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520278:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dc65 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.520297:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de486f6f reply state 00000000afbbeca3 transno 4294968569 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520309:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520317:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5be36ea4 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395266.520319:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.520322:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.520365:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dc5e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210668d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520601:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534600/0xff35729af316dc73 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210668d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.520611:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:2.0:1789395266.520614:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.520616:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534600, rc 0) 00000100:00100000:2.0:1789395266.520713:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:22236:x1876316231899648:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2712us (2931us total) trans 4294968569 rc 0/0 00000100:00100000:2.0:1789395266.520722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23897 00000100:00100000:1.0:1789395266.532380:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.532696:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231899904 00000100:00100000:0.0:1789395266.532710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231899904 00000100:00100000:0.0:1789395266.532787:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5230 00000100:00100000:0.0:1789395266.532799:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:22236:x1876316231899904:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.533199:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:22236:x1876316231899904:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 401us (833us total) trans 4294968570 rc 0/0 00000100:00100000:0.0:1789395266.533207:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5230 00000100:00100000:1.0:1789395266.537775:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.538012:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231900032 00000100:00100000:3.0:1789395266.538026:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231900032 00000100:00100000:3.0:1789395266.538099:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23898 00000100:00100000:3.0:1789395266.538111:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:22236:x1876316231900032:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:3.0:1789395266.540107:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968570 is committed 00000100:00100000:2.0:1789395266.540426:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:22236:x1876316231900032:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2273us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395266.540440:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23898 00010000:00010000:0.0:1789395266.540617:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.540631:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.540640:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.540648:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.540654:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.540664:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.540681:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5be36ea4 (ffff89a4f3d38800) 00010000:00010000:0.0:1789395266.540685:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.540689:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.540696:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dc6c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.550263:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.550810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231900288 00000100:00100000:3.0:1789395266.550828:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231900288 00000100:00100000:3.0:1789395266.551016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23899 00000100:00100000:3.0:1789395266.551028:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:22236:x1876316231900288:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:3.0:1789395266.551053:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.551080:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316dc81 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106694 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.551219:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.551236:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.551248:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.551262:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.551270:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.551277:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789395266.552592:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa:0x0], index 1: 0 00010000:00010000:3.0:1789395266.552796:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dc96 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.552812:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dc96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.552822:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dc96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553527:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553541:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553548:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553557:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553565:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395266.553570:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553579:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553595:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1dd00) 00010000:00010000:1.0:1789395266.553599:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395266.553604:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553610:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316dc88 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789395266.553631:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000021602ee reply state 00000000eb08b027 transno 4294968571 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553644:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553651:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x13f7213f (ffff89a3c8b1de00) 00010000:00010000:1.0:1789395266.553653:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395266.553656:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789395266.553705:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316dc81 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106694 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553729:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dc96 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106694 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.553743:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395266.553745:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395266.553748:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51be00, rc 0) 00000100:00100000:1.0:1789395266.553920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:22236:x1876316231900288:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2892us (3669us total) trans 4294968571 rc 0/0 00000100:00100000:1.0:1789395266.554100:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23899 00000100:00100000:1.0:1789395266.566256:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.566581:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231900544 00000100:00100000:2.0:1789395266.566595:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231900544 00000100:00100000:2.0:1789395266.566671:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5231 00000100:00100000:2.0:1789395266.566685:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:22236:x1876316231900544:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:2.0:1789395266.567079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:22236:x1876316231900544:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 395us (834us total) trans 4294968572 rc 0/0 00000100:00100000:2.0:1789395266.567087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5231 00000100:00100000:2.0:1789395266.570670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.570768:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231900672 00000100:00100000:3.0:1789395266.570781:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231900672 00000100:00100000:3.0:1789395266.570858:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23900 00000100:00100000:3.0:1789395266.570870:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:22236:x1876316231900672:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:3.0:1789395266.573566:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968572 is committed 00000100:00100000:0.0:1789395266.573840:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:22236:x1876316231900672:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2964us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.573854:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23900 00010000:00010000:2.0:1789395266.574076:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.574090:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.574100:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.574106:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.574112:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.574121:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.574139:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x13f7213f (ffff89a3c8b1de00) 00010000:00010000:2.0:1789395266.574142:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.574147:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.574154:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316dc8f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.578233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.578339:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231900928 00000100:00100000:2.0:1789395266.578354:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231900928 00000100:00100000:2.0:1789395266.578473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23901 00000100:00100000:2.0:1789395266.578485:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:22236:x1876316231900928:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.578511:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.578541:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dca4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210669b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.578681:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.578698:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.578711:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.578724:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.578732:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.578738:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.579774:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa:0x0], index 0: 0 00010000:00010000:2.0:1789395266.580166:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534c00/0xff35729af316dcb9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580181:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534c00/0xff35729af316dcb9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580196:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534c00/0xff35729af316dcb9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580233:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580241:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580247:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580254:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580260:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.580265:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580273:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580286:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38700) 00010000:00010000:2.0:1789395266.580289:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.580294:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580301:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcab lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.580541:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6050ce6 reply state 0000000088debbb8 transno 4294968573 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580558:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580565:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x4a6b5b31 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395266.580568:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.580572:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.580614:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dca4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210669b expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580635:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534c00/0xff35729af316dcb9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210669b expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.580643:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:2.0:1789395266.580646:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.580648:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534c00, rc 0) 00000100:00100000:2.0:1789395266.580783:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:22236:x1876316231900928:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2299us (2565us total) trans 4294968573 rc 0/0 00000100:00100000:2.0:1789395266.580791:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23901 00000100:00100000:1.0:1789395266.585206:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.585293:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231901184 00000100:00100000:3.0:1789395266.585305:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231901184 00000100:00100000:3.0:1789395266.585576:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5232 00000100:00100000:0.0:1789395266.585662:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:22236:x1876316231901184:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.586037:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:22236:x1876316231901184:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 449us (844us total) trans 4294968574 rc 0/0 00000100:00100000:0.0:1789395266.592605:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5232 00000100:00100000:1.0:1789395266.594213:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.594379:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231901312 00000100:00100000:0.0:1789395266.594511:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231901312 00000100:00100000:0.0:1789395266.594618:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23902 00000100:00100000:0.0:1789395266.594629:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:22236:x1876316231901312:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:3.0:1789395266.596292:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968574 is committed 00000100:00100000:2.0:1789395266.596727:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:22236:x1876316231901312:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2092us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395266.596741:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23902 00010000:00010000:0.0:1789395266.597217:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.597231:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.597240:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.597247:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395266.597253:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.597262:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.597281:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x4a6b5b31 (ffff89a4f3d38600) 00010000:00010000:0.0:1789395266.597284:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395266.597289:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.597296:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316dcb2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.605717:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.605813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231901568 00000100:00100000:2.0:1789395266.605826:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231901568 00000100:00100000:2.0:1789395266.605914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23903 00000100:00100000:2.0:1789395266.605927:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:22236:x1876316231901568:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.605960:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.605989:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dcc7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066a2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606129:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606145:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606158:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606173:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606181:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606188:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.606638:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb:0x0], index 1: 0 00010000:00010000:2.0:1789395266.606802:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dcdc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606813:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dcdc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606823:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dcdc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606860:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606873:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606881:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606889:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606895:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.606901:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606909:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606923:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38300) 00010000:00010000:2.0:1789395266.606926:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.606930:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606937:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcce lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.606963:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a6ea278 reply state 0000000082c059f6 transno 4294968575 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606975:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.606981:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa8a8d8e4 (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395266.606984:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.606986:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.607021:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dcc7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066a2 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.607044:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dcdc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066a2 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.607050:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395266.607052:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.607055:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535a00, rc 0) 00000100:00100000:2.0:1789395266.607131:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:22236:x1876316231901568:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 1207us (1429us total) trans 4294968575 rc 0/0 00000100:00100000:2.0:1789395266.607140:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23903 00000100:00100000:3.0:1789395266.616240:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.616788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231901824 00000100:00100000:0.0:1789395266.616802:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231901824 00000100:00100000:0.0:1789395266.616875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5233 00000100:00100000:0.0:1789395266.616888:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:22236:x1876316231901824:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.617504:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22236:x1876316231901824:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 615us (1274us total) trans 4294968576 rc 0/0 00000100:00100000:0.0:1789395266.617516:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5233 00000100:00100000:2.0:1789395266.622955:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.623082:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231901952 00000100:00100000:3.0:1789395266.623095:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231901952 00000100:00100000:3.0:1789395266.623170:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23904 00000100:00100000:3.0:1789395266.623181:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22236:x1876316231901952:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:0.0:1789395266.625192:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968576 is committed 00000100:00100000:3.0:1789395266.625469:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:22236:x1876316231901952:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2282us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.625483:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23904 00010000:00010000:2.0:1789395266.628452:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.628476:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.628487:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.628494:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.628501:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.628510:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.628536:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa8a8d8e4 (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395266.628541:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.628546:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.628553:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316dcd5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395266.629214:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.629294:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231902208 00000100:00100000:2.0:1789395266.629307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231902208 00000100:00100000:2.0:1789395266.629487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23905 00000100:00100000:2.0:1789395266.629500:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+25:22236:x1876316231902208:12345-192.168.203.54@tcp:101:createmany.0 00010000:00010000:2.0:1789395266.629523:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.629545:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dcea lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066a9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.629684:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.629700:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.629712:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631036:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631059:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631070:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395266.631563:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb:0x0], index 0: 0 00010000:00010000:2.0:1789395266.631745:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcff lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631757:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631766:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631808:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631815:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631822:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631828:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631834:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df535200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395266.631839:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631847:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631864:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38300) 00010000:00010000:2.0:1789395266.631867:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395266.631872:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631879:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dcf1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395266.631894:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008973608c reply state 00000000e4a9a86e transno 4294968577 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631906:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631913:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xff13bf8 (ffff89a4f3d38700) 00010000:00010000:2.0:1789395266.631915:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395266.631918:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395266.631975:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dcea lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066a9 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.631997:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066a9 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.632005:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395266.632008:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395266.632010:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534e00, rc 0) 00000100:00100000:2.0:1789395266.632114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22236:x1876316231902208:12345-192.168.203.54@tcp:101:createmany.0 Request processed in 2615us (2906us total) trans 4294968577 rc 0/0 00000100:00100000:2.0:1789395266.632123:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23905 00000100:00100000:1.0:1789395266.636694:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.637029:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231902464 00000100:00100000:0.0:1789395266.637043:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231902464 00000100:00100000:0.0:1789395266.637150:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5234 00000100:00100000:0.0:1789395266.637162:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22236:x1876316231902464:12345-192.168.203.54@tcp:35:createmany.0 00000100:00100000:0.0:1789395266.637664:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:22236:x1876316231902464:12345-192.168.203.54@tcp:35:createmany.0 Request processed in 502us (980us total) trans 4294968578 rc 0/0 00000100:00100000:0.0:1789395266.637673:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5234 00000100:00100000:2.0:1789395266.641011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.641088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231902592 00000100:00100000:3.0:1789395266.641101:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231902592 00000100:00100000:3.0:1789395266.641176:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23906 00000100:00100000:3.0:1789395266.641188:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+29:22236:x1876316231902592:12345-192.168.203.54@tcp:44:createmany.0 00000001:00080000:2.0:1789395266.643285:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968578 is committed 00000100:00100000:3.0:1789395266.643577:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:22236:x1876316231902592:12345-192.168.203.54@tcp:44:createmany.0 Request processed in 2383us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.643591:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23906 00010000:00010000:1.0:1789395266.643750:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.643766:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.643775:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.643782:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4df534a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395266.643788:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.643798:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.643817:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xff13bf8 (ffff89a4f3d38700) 00010000:00010000:1.0:1789395266.643821:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395266.643826:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.643834:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dcf8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395266.715053:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.715193:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231902848 00000100:00100000:2.0:1789395266.715208:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231902848 00000100:00100000:2.0:1789395266.716863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23907 00000100:00100000:2.0:1789395266.716894:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+26:22080:x1876316231902848:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395266.716923:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.716964:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dd0d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066b0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.717122:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dd14 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.717137:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dd14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.717150:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dd14 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395266.717164:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 0 00010000:00010000:3.0:1789395266.721232:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dd0d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066b0 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.722011:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dd14 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066b0 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.722026:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:3.0:1789395266.722030:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.722033:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535200, rc 0) 00000100:00100000:3.0:1789395266.722148:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22080:x1876316231902848:12345-192.168.203.54@tcp:101:bash.0 Request processed in 5269us (7108us total) trans 4294968579 rc 0/0 00000100:00100000:3.0:1789395266.722158:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23907 00000100:00100000:1.0:1789395266.734831:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.735002:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231902976 00000100:00100000:0.0:1789395266.735016:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231902976 00000100:00100000:0.0:1789395266.735096:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5352 00000100:00100000:0.0:1789395266.735109:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:22080:x1876316231902976:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395266.735132:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.735158:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316dd22 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066b7 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395266.735191:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395266.735218:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789395266.735223:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395266.735232:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316dd22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066b7 expref: 7 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.735251:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d161efd/0xff35729af316dd22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066b7 expref: 7 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.735265:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c200, rc 0) 00000100:00100000:0.0:1789395266.735350:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:22080:x1876316231902976:12345-192.168.203.54@tcp:101:bash.0 Request processed in 243us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.735358:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5352 00000100:00100000:2.0:1789395266.741836:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.742038:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231903232 00000100:00100000:0.0:1789395266.742051:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231903232 00000100:00100000:0.0:1789395266.742143:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1400 00000100:00100000:0.0:1789395266.742155:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:2396:x1876316231903232:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395266.742175:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395266.742206:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535200/0xff35729af316dd14 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066b0 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.742229:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:0.0:1789395266.742234:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395266.742316:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:2396:x1876316231903232:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 163us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.742325:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1400 00000100:00100000:1.0:1789395266.748158:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.748237:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231903104 00000100:00100000:0.0:1789395266.748250:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231903104 00000100:00100000:0.0:1789395266.748329:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23908 00000100:00100000:0.0:1789395266.748342:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+27:22080:x1876316231903104:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395266.748377:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.748449:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316dd29 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066be expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.748493:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316dd30 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.748507:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316dd30 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.748520:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316dd30 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.748668:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316dd29 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066be expref: 29 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.748689:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ca00/0xff35729af316dd30 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066be expref: 28 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.748699:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:0.0:1789395266.748702:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395266.748706:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ca00, rc 0) 00000100:00100000:0.0:1789395266.748782:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22080:x1876316231903104:12345-192.168.203.54@tcp:101:bash.0 Request processed in 442us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.748790:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23908 00000100:00100000:1.0:1789395266.764857:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.764979:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231903360 00000100:00100000:2.0:1789395266.764992:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231903360 00002000:00100000:2.0:1789395266.765062:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x2:0x0] (0->5) req@ffff89a4fedf7800 x1876316231903360/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/0 e 0 to 0 dl 1789395277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395266.765075:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7800 with x1876316231903360 ext(0->5) 00002000:00010000:2.0:1789395266.765082:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7800 00000100:00100000:2.0:1789395266.765126:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 53 00000100:00100000:2.0:1789395266.765139:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231903360:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395266.766898:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231903360:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1747us (2040us total) trans 4294969954 rc 0/0 00000100:00100000:2.0:1789395266.766913:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 53 00002000:00100000:2.0:1789395266.766928:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x2:0x0] (0->5) req@ffff89a4fedf7800 x1876316231903360/t4294969954(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/448 e 0 to 0 dl 1789395277 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395266.766955:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7800 with x1876316231903360 ext(0->5) 00002000:00010000:2.0:1789395266.766964:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7800 00000100:00100000:3.0:1789395266.770365:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.770461:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231903488 00000100:00100000:1.0:1789395266.770475:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231903488 00000100:00100000:1.0:1789395266.770552:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5353 00000100:00100000:1.0:1789395266.770565:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231903488:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395266.775224:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969954 is committed 00000100:00100000:1.0:1789395266.775812:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2397:x1876316231903488:12345-192.168.203.54@tcp:16:bash.0 Request processed in 5240us (5452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.775827:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5353 00000100:00100000:1.0:1789395266.778516:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.778623:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231903744 00000100:00100000:2.0:1789395266.778635:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231903744 00000100:00100000:2.0:1789395266.778699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5235 00000100:00100000:2.0:1789395266.778711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+28:22080:x1876316231903744:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395266.778980:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968580 00000100:00100000:2.0:1789395266.779124:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:22080:x1876316231903744:12345-192.168.203.54@tcp:35:bash.0 Request processed in 414us (623us total) trans 4294968581 rc 0/0 00000100:00100000:2.0:1789395266.779134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5235 00000020:00080000:2.0:1789395266.779140:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395266.785105:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.785356:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904000 00000100:00100000:3.0:1789395266.785587:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904000 00000100:00100000:3.0:1789395266.785703:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23909 00000100:00100000:3.0:1789395266.785716:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+30:22080:x1876316231904000:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395266.785758:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.785785:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd37 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066c5 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.785928:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dd3e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.785955:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dd3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.785970:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dd3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395266.785982:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19b:0x0]: returning size 0 00010000:00010000:3.0:1789395266.786115:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd37 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066c5 expref: 33 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.786144:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dd3e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066c5 expref: 32 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.786155:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:3.0:1789395266.786159:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.786163:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a400, rc 0) 00000100:00100000:3.0:1789395266.786250:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:22080:x1876316231904000:12345-192.168.203.54@tcp:101:bash.0 Request processed in 536us (1159us total) trans 4294968582 rc 0/0 00000100:00100000:3.0:1789395266.786267:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23909 00000100:00100000:2.0:1789395266.794491:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.794706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.794792:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904128 00000100:00100000:0.0:1789395266.794805:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904128 00000100:00100000:0.0:1789395266.794887:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1401 00000100:00100000:0.0:1789395266.794899:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:2395:x1876316231904128:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395266.794918:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395266.794957:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dd3e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066c5 expref: 32 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.794981:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:0.0:1789395266.794986:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395266.795053:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:2395:x1876316231904128:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.795061:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1401 00000100:00100000:3.0:1789395266.798927:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904256 00000100:00100000:3.0:1789395266.798960:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904256 00000100:00100000:0.0:1789395266.799961:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5354 00000100:00100000:0.0:1789395266.799976:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+6:22080:x1876316231904256:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395266.800010:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.800038:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316dd4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066cc expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395266.800072:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395266.800100:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789395266.800106:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395266.800115:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316dd4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066cc expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.800134:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051311d1e/0xff35729af316dd4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066cc expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.800153:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d200, rc 0) 00000100:00100000:0.0:1789395266.800255:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:22080:x1876316231904256:12345-192.168.203.54@tcp:101:bash.0 Request processed in 283us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.800264:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5354 00000100:00100000:2.0:1789395266.816748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.820804:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904384 00000100:00100000:3.0:1789395266.820826:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904384 00000100:00100000:0.0:1789395266.821712:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23910 00000100:00100000:0.0:1789395266.821728:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+31:22080:x1876316231904384:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395266.821759:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.821960:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316dd53 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066d3 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.822192:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316dd5a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.822271:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316dd5a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.822286:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316dd5a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.822922:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316dd53 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066d3 expref: 33 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.822961:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10de00/0xff35729af316dd5a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066d3 expref: 32 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.822973:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:0.0:1789395266.822977:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395266.823255:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10de00, rc 0) 00000100:00100000:0.0:1789395266.823490:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:22080:x1876316231904384:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1757us (6747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.823500:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23910 00000100:00100000:3.0:1789395266.831168:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.832034:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904512 00000100:00100000:0.0:1789395266.832049:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904512 00002000:00100000:0.0:1789395266.832118:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->5) req@ffff89a4ffb6c000 x1876316231904512/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/0 e 0 to 0 dl 1789395277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395266.832129:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb6c000 with x1876316231904512 ext(0->5) 00002000:00010000:0.0:1789395266.832136:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ffb6c000 00000100:00100000:0.0:1789395266.832224:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 54 00000100:00100000:0.0:1789395266.832237:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2398:x1876316231904512:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395266.833756:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231904512:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1510us (2592us total) trans 4294969987 rc 0/0 00000100:00100000:0.0:1789395266.833769:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 54 00002000:00100000:0.0:1789395266.833783:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->5) req@ffff89a4ffb6c000 x1876316231904512/t4294969987(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/448 e 0 to 0 dl 1789395277 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395266.833793:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb6c000 with x1876316231904512 ext(0->5) 00002000:00010000:0.0:1789395266.833799:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ffb6c000 00000100:00100000:0.0:1789395266.837932:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.838028:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904640 00000100:00100000:1.0:1789395266.838040:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904640 00000100:00100000:1.0:1789395266.838117:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5355 00000100:00100000:1.0:1789395266.838130:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2397:x1876316231904640:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395266.840227:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969987 is committed 00000100:00100000:1.0:1789395266.841158:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:2397:x1876316231904640:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3019us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.841172:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5355 00000100:00100000:0.0:1789395266.850770:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.853756:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231904896 00000100:00100000:2.0:1789395266.853777:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231904896 00000100:00100000:2.0:1789395266.853933:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5236 00000100:00100000:2.0:1789395266.853955:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+32:22080:x1876316231904896:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395266.854234:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968583 00000100:00100000:2.0:1789395266.854382:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:22080:x1876316231904896:12345-192.168.203.54@tcp:35:bash.0 Request processed in 429us (3627us total) trans 4294968584 rc 0/0 00000100:00100000:2.0:1789395266.854423:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5236 00000020:00080000:2.0:1789395266.854428:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395266.869815:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.872602:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231905152 00000100:00100000:0.0:1789395266.872625:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231905152 00000100:00100000:0.0:1789395266.872722:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23911 00000100:00100000:0.0:1789395266.872734:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+34:22080:x1876316231905152:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395266.872767:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.872796:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dd61 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066da expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.872957:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dd68 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.872974:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dd68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.872987:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dd68 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395266.873001:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19c:0x0]: returning size 0 00010000:00010000:0.0:1789395266.873141:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c600/0xff35729af316dd61 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066da expref: 37 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.873171:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dd68 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066da expref: 36 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.873182:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395266.873185:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395266.873189:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c400, rc 0) 00000100:00100000:0.0:1789395266.873277:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:22080:x1876316231905152:12345-192.168.203.54@tcp:101:bash.0 Request processed in 545us (3475us total) trans 4294968585 rc 0/0 00000100:00100000:0.0:1789395266.873286:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23911 00000100:00100000:0.0:1789395266.879490:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.879540:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395266.879647:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231905280 00000100:00100000:1.0:1789395266.879660:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231905280 00000100:00100000:1.0:1789395266.879735:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5356 00000100:00100000:1.0:1789395266.879748:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:22080:x1876316231905280:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395266.879771:0:14639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395266.879795:0:14639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316dd76 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066e1 expref: -99 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395266.879828:0:14639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395266.879868:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1789395266.879874:0:14639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395266.879883:0:14639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316dd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066e1 expref: 8 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.879901:0:14639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004365ad9b/0xff35729af316dd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066e1 expref: 8 pid: 14639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395266.879916:0:14639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56200, rc 0) 00000100:00100000:1.0:1789395266.880004:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22080:x1876316231905280:12345-192.168.203.54@tcp:101:bash.0 Request processed in 259us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.880011:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5356 00000100:00100000:3.0:1789395266.880318:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231905408 00000100:00100000:3.0:1789395266.880324:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231905408 00000100:00100000:3.0:1789395266.880370:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1402 00000100:00100000:3.0:1789395266.880378:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:2396:x1876316231905408:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395266.880414:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395266.880438:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316dd68 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066da expref: 36 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.880458:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:3.0:1789395266.880463:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395266.880503:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+35:2396:x1876316231905408:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 126us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.880510:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1402 00000100:00100000:0.0:1789395266.884878:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.884982:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231905536 00000100:00100000:2.0:1789395266.884995:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231905536 00000100:00100000:2.0:1789395266.885067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23912 00000100:00100000:2.0:1789395266.885080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+35:22080:x1876316231905536:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395266.885107:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.885131:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dd7d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066e8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.885172:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dd84 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.885187:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dd84 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.885199:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dd84 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.885360:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dd7d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066e8 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.885731:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534a00/0xff35729af316dd84 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066e8 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.885748:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:2.0:1789395266.885751:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395266.885755:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df534a00, rc 0) 00000100:00100000:2.0:1789395266.885873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:22080:x1876316231905536:12345-192.168.203.54@tcp:101:bash.0 Request processed in 795us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395266.885881:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23912 00000100:00100000:1.0:1789395266.898533:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.898789:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231905664 00000100:00100000:2.0:1789395266.898801:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231905664 00002000:00100000:2.0:1789395266.898862:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x3:0x0] (0->5) req@ffff89a4fedf7480 x1876316231905664/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/0 e 0 to 0 dl 1789395277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395266.898874:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7480 with x1876316231905664 ext(0->5) 00002000:00010000:2.0:1789395266.898881:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7480 00000100:00100000:2.0:1789395266.898909:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 55 00000100:00100000:2.0:1789395266.898920:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2395:x1876316231905664:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395266.900312:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231905664:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1384us (1782us total) trans 4294969955 rc 0/0 00000100:00100000:2.0:1789395266.900878:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 55 00002000:00100000:2.0:1789395266.900894:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x3:0x0] (0->5) req@ffff89a4fedf7480 x1876316231905664/t4294969955(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/448 e 0 to 0 dl 1789395277 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395266.900905:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7480 with x1876316231905664 ext(0->5) 00002000:00010000:2.0:1789395266.900912:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7480 00000100:00100000:0.0:1789395266.907934:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.908041:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231905792 00000100:00100000:2.0:1789395266.908054:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231905792 00000100:00100000:2.0:1789395266.908128:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5357 00000100:00100000:2.0:1789395266.908141:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231905792:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395266.910624:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969955 is committed 00000100:00100000:1.0:1789395266.917776:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2396:x1876316231905792:12345-192.168.203.54@tcp:16:bash.0 Request processed in 9620us (9839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395266.917793:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5357 00000100:00100000:0.0:1789395266.923217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.923331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906048 00000100:00100000:2.0:1789395266.923345:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906048 00000100:00100000:2.0:1789395266.923452:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5237 00000100:00100000:2.0:1789395266.923465:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+36:22080:x1876316231906048:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395266.923735:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968586 00000100:00100000:2.0:1789395266.923868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:22080:x1876316231906048:12345-192.168.203.54@tcp:35:bash.0 Request processed in 403us (664us total) trans 4294968587 rc 0/0 00000100:00100000:2.0:1789395266.923877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5237 00000020:00080000:2.0:1789395266.923882:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395266.927831:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.928023:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906304 00000100:00100000:3.0:1789395266.928037:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906304 00000100:00100000:3.0:1789395266.928111:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23913 00000100:00100000:3.0:1789395266.928123:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+38:22080:x1876316231906304:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395266.928151:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395266.928178:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dd8b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066ef expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.928335:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd92 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.928351:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.928364:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395266.928378:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19d:0x0]: returning size 0 00010000:00010000:3.0:1789395266.928565:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dd8b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066ef expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.928596:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066ef expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.928605:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:3.0:1789395266.928608:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395266.928612:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51bc00, rc 0) 00000100:00100000:3.0:1789395266.928681:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:22080:x1876316231906304:12345-192.168.203.54@tcp:101:bash.0 Request processed in 559us (865us total) trans 4294968588 rc 0/0 00000100:00100000:3.0:1789395266.928689:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23913 00000100:00100000:0.0:1789395266.932989:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395266.934019:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906432 00000100:00100000:3.0:1789395266.934036:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906432 00000100:00100000:3.0:1789395266.934127:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1403 00000100:00100000:3.0:1789395266.934140:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:2395:x1876316231906432:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395266.934157:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395266.934186:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dd92 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066ef expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395266.934208:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:3.0:1789395266.934213:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395266.934284:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:2395:x1876316231906432:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 146us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.934292:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1403 00000100:00100000:1.0:1789395266.942264:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395266.942426:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906560 00000100:00100000:0.0:1789395266.942440:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906560 00000100:00100000:0.0:1789395266.942513:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5358 00000100:00100000:0.0:1789395266.942524:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+7:22080:x1876316231906560:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395266.942547:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395266.942572:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316dda0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066f6 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395266.942607:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395266.942633:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1789395266.942638:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395266.942647:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316dda0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066f6 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.942664:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d367d9a/0xff35729af316dda0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066f6 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395266.942678:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c600, rc 0) 00000100:00100000:0.0:1789395266.942751:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22080:x1876316231906560:12345-192.168.203.54@tcp:101:bash.0 Request processed in 229us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395266.942760:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5358 00000100:00100000:0.0:1789395266.946439:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.946574:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906688 00000100:00100000:2.0:1789395266.946588:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906688 00000100:00100000:2.0:1789395266.946744:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23914 00000100:00100000:2.0:1789395266.946757:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+39:22080:x1876316231906688:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395266.946786:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395266.946812:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dda7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021066fd expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.946853:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316ddae lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.946868:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316ddae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.946880:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316ddae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.947042:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dda7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066fd expref: 41 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.947063:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535400/0xff35729af316ddae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066fd expref: 40 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395266.947072:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:2.0:1789395266.947076:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395266.947079:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535400, rc 0) 00000100:00100000:2.0:1789395266.947156:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:22080:x1876316231906688:12345-192.168.203.54@tcp:101:bash.0 Request processed in 402us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395266.947164:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23914 00000100:00100000:3.0:1789395266.962115:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.962368:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906816 00000100:00100000:2.0:1789395266.962382:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906816 00002000:00100000:2.0:1789395266.962487:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->5) req@ffff89a4ffb6f800 x1876316231906816/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/0 e 0 to 0 dl 1789395277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395266.962500:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb6f800 with x1876316231906816 ext(0->5) 00002000:00010000:2.0:1789395266.962507:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ffb6f800 00000100:00100000:2.0:1789395266.962543:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 56 00000100:00100000:2.0:1789395266.962554:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2397:x1876316231906816:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395266.967096:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2397:x1876316231906816:12345-192.168.203.54@tcp:4:bash.0 Request processed in 4526us (4979us total) trans 4294969988 rc 0/0 00000100:00100000:2.0:1789395266.967115:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 56 00002000:00100000:2.0:1789395266.967133:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->5) req@ffff89a4ffb6f800 x1876316231906816/t4294969988(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:732/0 lens 496/448 e 0 to 0 dl 1789395277 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395266.967152:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb6f800 with x1876316231906816 ext(0->5) 00002000:00010000:2.0:1789395266.967160:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ffb6f800 00000100:00100000:1.0:1789395266.979675:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.980168:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231906944 00000100:00100000:2.0:1789395266.980182:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231906944 00000100:00100000:2.0:1789395266.980309:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5359 00000100:00100000:2.0:1789395266.980322:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2398:x1876316231906944:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395266.982129:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969988 is committed 00000100:00100000:3.0:1789395266.983283:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:2398:x1876316231906944:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2951us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395266.983297:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5359 00000100:00100000:0.0:1789395266.998895:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395266.999298:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231907200 00000100:00100000:2.0:1789395266.999314:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231907200 00000100:00100000:2.0:1789395266.999885:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5238 00000100:00100000:2.0:1789395266.999900:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+40:22080:x1876316231907200:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.000207:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968589 00000100:00100000:2.0:1789395267.000358:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:22080:x1876316231907200:12345-192.168.203.54@tcp:35:bash.0 Request processed in 461us (1475us total) trans 4294968590 rc 0/0 00000100:00100000:2.0:1789395267.000367:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5238 00000020:00080000:2.0:1789395267.001488:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395267.006293:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.006668:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231907456 00000100:00100000:2.0:1789395267.006682:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231907456 00000100:00100000:2.0:1789395267.006772:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23915 00000100:00100000:2.0:1789395267.006784:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+42:22080:x1876316231907456:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.006814:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.006841:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316ddb5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106704 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.007005:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316ddbc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.007022:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316ddbc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.007037:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316ddbc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395267.007052:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19e:0x0]: returning size 0 00010000:00010000:2.0:1789395267.007182:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316ddb5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106704 expref: 45 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789395267.007189:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789395267.007213:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316ddbc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106704 expref: 44 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.007223:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:2.0:1789395267.007227:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395267.007231:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535600, rc 0) 00000100:00100000:2.0:1789395267.010915:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:22080:x1876316231907456:12345-192.168.203.54@tcp:101:bash.0 Request processed in 4114us (4617us total) trans 4294968591 rc 0/0 00000100:00100000:2.0:1789395267.010932:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23915 00000100:00100000:1.0:1789395267.022846:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.023005:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231907712 00000100:00100000:0.0:1789395267.023018:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231907712 00000100:00100000:0.0:1789395267.023099:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1404 00000100:00100000:0.0:1789395267.023111:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d023c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:2396:x1876316231907712:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395267.023131:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395267.023162:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535600/0xff35729af316ddbc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106704 expref: 44 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.023185:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:0.0:1789395267.023190:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395267.023312:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d023c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:2396:x1876316231907712:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 203us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.023322:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1404 00000100:00100000:0.0:1789395267.025250:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.029816:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231907584 00000100:00100000:1.0:1789395267.029839:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231907584 00000100:00100000:1.0:1789395267.030010:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5360 00000100:00100000:1.0:1789395267.030025:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22080:x1876316231907584:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.030049:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.030079:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb42ec1/0xff35729af316ddca lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210670b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395267.030115:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395267.030143:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789395267.030149:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395267.030159:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb42ec1/0xff35729af316ddca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210670b expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.030178:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bb42ec1/0xff35729af316ddca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210670b expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.030195:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57600, rc 0) 00000100:00100000:1.0:1789395267.030279:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22080:x1876316231907584:12345-192.168.203.54@tcp:101:bash.0 Request processed in 256us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.030287:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5360 00000100:00080000:3.0:1789395267.030729:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789395267.036660:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.036804:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231907840 00000100:00100000:1.0:1789395267.036818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231907840 00000100:00100000:1.0:1789395267.036935:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23916 00000100:00100000:1.0:1789395267.036960:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+43:22080:x1876316231907840:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.036989:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.037013:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57200/0xff35729af316ddd1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106712 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.037054:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56800/0xff35729af316ddd8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.037069:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56800/0xff35729af316ddd8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.037082:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56800/0xff35729af316ddd8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.037237:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57200/0xff35729af316ddd1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106712 expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.037263:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56800/0xff35729af316ddd8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106712 expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.037273:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:1.0:1789395267.037277:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395267.037281:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56800, rc 0) 00000100:00100000:1.0:1789395267.037364:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:22080:x1876316231907840:12345-192.168.203.54@tcp:101:bash.0 Request processed in 407us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.037372:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23916 00000100:00100000:0.0:1789395267.047805:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.048054:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231907968 00000100:00100000:3.0:1789395267.048067:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231907968 00002000:00100000:3.0:1789395267.048135:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (0->5) req@ffff89a3cadb7800 x1876316231907968/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.048148:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadb7800 with x1876316231907968 ext(0->5) 00002000:00010000:3.0:1789395267.048155:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadb7800 00000100:00100000:3.0:1789395267.048194:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 57 00000100:00100000:3.0:1789395267.048205:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2396:x1876316231907968:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395267.049756:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231907968:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1541us (1957us total) trans 4294969956 rc 0/0 00000100:00100000:3.0:1789395267.049771:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 57 00002000:00100000:3.0:1789395267.049785:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (0->5) req@ffff89a3cadb7800 x1876316231907968/t4294969956(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.049795:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadb7800 with x1876316231907968 ext(0->5) 00002000:00010000:3.0:1789395267.049802:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadb7800 00000100:00100000:2.0:1789395267.055552:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.055664:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231908096 00000100:00100000:1.0:1789395267.055676:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231908096 00000100:00100000:1.0:1789395267.055751:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5361 00000100:00100000:1.0:1789395267.055764:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231908096:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.058166:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969956 is committed 00000100:00100000:2.0:1789395267.058803:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231908096:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3032us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.058816:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5361 00000100:00100000:0.0:1789395267.061614:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.061705:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231908352 00000100:00100000:1.0:1789395267.061717:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231908352 00000100:00100000:1.0:1789395267.061819:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5239 00000100:00100000:1.0:1789395267.061830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+44:22080:x1876316231908352:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:1.0:1789395267.062105:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968592 00000100:00100000:1.0:1789395267.062242:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:22080:x1876316231908352:12345-192.168.203.54@tcp:35:bash.0 Request processed in 412us (638us total) trans 4294968593 rc 0/0 00000100:00100000:1.0:1789395267.062251:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5239 00000020:00080000:1.0:1789395267.062257:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395267.066232:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.066342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231908608 00000100:00100000:3.0:1789395267.066355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231908608 00000100:00100000:3.0:1789395267.066470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23917 00000100:00100000:3.0:1789395267.066482:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+46:22080:x1876316231908608:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.066510:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.066537:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dddf lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106719 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.066681:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dde6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.066697:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dde6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.066709:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dde6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395267.066723:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19f:0x0]: returning size 0 00010000:00010000:3.0:1789395267.066860:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316dddf lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106719 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.066890:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dde6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106719 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.066901:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:3.0:1789395267.066904:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395267.066908:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51aa00, rc 0) 00000100:00100000:3.0:1789395267.066992:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:22080:x1876316231908608:12345-192.168.203.54@tcp:101:bash.0 Request processed in 511us (775us total) trans 4294968594 rc 0/0 00000100:00100000:3.0:1789395267.066999:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23917 00000100:00100000:0.0:1789395267.073457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.073511:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.073629:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231908864 00000100:00100000:3.0:1789395267.073642:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231908864 00000100:00100000:3.0:1789395267.073730:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1405 00000100:00100000:3.0:1789395267.073743:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:2395:x1876316231908864:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395267.073763:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395267.073790:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316dde6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106719 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.073813:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:3.0:1789395267.073818:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395267.073880:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fef29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:2395:x1876316231908864:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.073888:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1405 00000100:00100000:2.0:1789395267.073979:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231908736 00000100:00100000:2.0:1789395267.073984:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231908736 00000100:00100000:2.0:1789395267.074039:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5362 00000100:00100000:2.0:1789395267.074046:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f6586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+8:22080:x1876316231908736:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.074063:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.074084:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004724f4de/0xff35729af316ddf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106720 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.074114:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.074134:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.074139:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.074148:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004724f4de/0xff35729af316ddf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106720 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.074164:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004724f4de/0xff35729af316ddf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106720 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.074176:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535200, rc 0) 00000100:00100000:2.0:1789395267.074199:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f6586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22080:x1876316231908736:12345-192.168.203.54@tcp:101:bash.0 Request processed in 154us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.074206:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5362 00000100:00080000:3.0:1789395267.074304:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395267.078210:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.078306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231908992 00000100:00100000:3.0:1789395267.078329:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231908992 00000100:00100000:3.0:1789395267.078446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23918 00000100:00100000:3.0:1789395267.078459:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:22080:x1876316231908992:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.078487:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.078513:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316ddfb lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106727 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.078555:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a800/0xff35729af316de02 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.078571:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a800/0xff35729af316de02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.078584:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a800/0xff35729af316de02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.078740:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316ddfb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106727 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.078763:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a800/0xff35729af316de02 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106727 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.078773:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:3.0:1789395267.078777:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789395267.078780:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a800, rc 0) 00000100:00100000:3.0:1789395267.078863:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:22080:x1876316231908992:12345-192.168.203.54@tcp:101:bash.0 Request processed in 406us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.078870:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23918 00000100:00100000:1.0:1789395267.086373:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.086519:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231909120 00000100:00100000:2.0:1789395267.086533:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231909120 00002000:00100000:2.0:1789395267.086596:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->5) req@ffff89a501db2a00 x1876316231909120/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.086609:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2a00 with x1876316231909120 ext(0->5) 00002000:00010000:2.0:1789395267.086615:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db2a00 00000100:00100000:2.0:1789395267.086650:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 58 00000100:00100000:2.0:1789395267.086662:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2398:x1876316231909120:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395267.088275:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2398:x1876316231909120:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1603us (1905us total) trans 4294969989 rc 0/0 00000100:00100000:2.0:1789395267.088292:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 58 00002000:00100000:2.0:1789395267.088306:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->5) req@ffff89a501db2a00 x1876316231909120/t4294969989(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.088327:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2a00 with x1876316231909120 ext(0->5) 00002000:00010000:2.0:1789395267.088334:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db2a00 00000100:00100000:1.0:1789395267.092687:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.092876:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231909248 00000100:00100000:2.0:1789395267.092889:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231909248 00000100:00100000:2.0:1789395267.092963:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5363 00000100:00100000:2.0:1789395267.092974:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231909248:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.094518:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969989 is committed 00000100:00100000:2.0:1789395267.094728:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:2395:x1876316231909248:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1748us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.094741:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5363 00000100:00100000:0.0:1789395267.098579:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.098715:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231909504 00000100:00100000:2.0:1789395267.098728:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231909504 00000100:00100000:2.0:1789395267.098826:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5240 00000100:00100000:2.0:1789395267.098837:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a5009db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:22080:x1876316231909504:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.099107:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968595 00000100:00100000:2.0:1789395267.099244:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a5009db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+50:22080:x1876316231909504:12345-192.168.203.54@tcp:35:bash.0 Request processed in 407us (678us total) trans 4294968596 rc 0/0 00000100:00100000:2.0:1789395267.099253:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5240 00000020:00080000:2.0:1789395267.099259:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.103141:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.103456:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231909760 00000100:00100000:0.0:1789395267.103469:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231909760 00000100:00100000:0.0:1789395267.103539:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23919 00000100:00100000:0.0:1789395267.103550:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+50:22080:x1876316231909760:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.103578:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.103604:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316de09 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210672e expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.103750:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316de10 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.103767:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316de10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.103781:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316de10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.103794:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a0:0x0]: returning size 0 00010000:00010000:0.0:1789395267.103930:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316de09 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210672e expref: 53 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.103974:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316de10 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210672e expref: 52 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.103985:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:0.0:1789395267.103988:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.103992:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:0.0:1789395267.104192:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+52:22080:x1876316231909760:12345-192.168.203.54@tcp:101:bash.0 Request processed in 643us (1063us total) trans 4294968597 rc 0/0 00000100:00100000:0.0:1789395267.104201:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23919 00000100:00100000:0.0:1789395267.110968:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.111130:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.111209:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231910016 00000100:00100000:1.0:1789395267.111222:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231910016 00000100:00100000:1.0:1789395267.111297:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5364 00000100:00100000:1.0:1789395267.111310:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22080:x1876316231910016:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.111343:0:14650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.111371:0:14650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d12238b/0xff35729af316de1e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106735 expref: -99 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395267.111434:0:14650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395267.111461:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789395267.111467:0:14650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395267.111476:0:14650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d12238b/0xff35729af316de1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106735 expref: 10 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.111500:0:14650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d12238b/0xff35729af316de1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106735 expref: 10 pid: 14650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.111515:0:14650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57e00, rc 0) 00000100:00100000:1.0:1789395267.111594:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22080:x1876316231910016:12345-192.168.203.54@tcp:101:bash.0 Request processed in 285us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.111602:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5364 00000100:00100000:3.0:1789395267.115097:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231909888 00000100:00100000:3.0:1789395267.115121:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231909888 00000100:00100000:2.0:1789395267.115351:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.115466:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1406 00000100:00100000:3.0:1789395267.115479:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+52:2396:x1876316231909888:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395267.115498:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395267.115528:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316de10 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210672e expref: 52 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.115552:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:3.0:1789395267.115558:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395267.115634:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+51:2396:x1876316231909888:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 158us (4681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.115642:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1406 00000100:00100000:1.0:1789395267.115710:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231910144 00000100:00100000:1.0:1789395267.115715:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231910144 00000100:00100000:1.0:1789395267.115755:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23920 00000100:00100000:1.0:1789395267.115763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+51:22080:x1876316231910144:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.115786:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.115805:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56600/0xff35729af316de25 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210673c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.115841:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57200/0xff35729af316de2c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.115871:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57200/0xff35729af316de2c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.115883:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57200/0xff35729af316de2c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.116030:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56600/0xff35729af316de25 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210673c expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.116052:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57200/0xff35729af316de2c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210673c expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.116060:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:1.0:1789395267.116063:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395267.116066:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57200, rc 0) 00000100:00100000:1.0:1789395267.116100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+52:22080:x1876316231910144:12345-192.168.203.54@tcp:101:bash.0 Request processed in 338us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.116106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23920 00000100:00100000:2.0:1789395267.122483:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.122688:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231910272 00000100:00100000:0.0:1789395267.122703:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231910272 00002000:00100000:0.0:1789395267.122768:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x5:0x0] (0->5) req@ffff89a4cbfe4e00 x1876316231910272/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.122787:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe4e00 with x1876316231910272 ext(0->5) 00002000:00010000:0.0:1789395267.122793:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4cbfe4e00 00000100:00100000:0.0:1789395267.122833:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 59 00000100:00100000:0.0:1789395267.122844:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2395:x1876316231910272:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395267.126713:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231910272:12345-192.168.203.54@tcp:4:bash.0 Request processed in 3860us (4235us total) trans 4294969957 rc 0/0 00000100:00100000:0.0:1789395267.126727:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 59 00002000:00100000:0.0:1789395267.126740:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x5:0x0] (0->5) req@ffff89a4cbfe4e00 x1876316231910272/t4294969957(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.126750:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe4e00 with x1876316231910272 ext(0->5) 00002000:00010000:0.0:1789395267.126757:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4cbfe4e00 00000100:00100000:2.0:1789395267.132841:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.132952:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231910400 00000100:00100000:3.0:1789395267.132966:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231910400 00000100:00100000:3.0:1789395267.133028:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5365 00000100:00100000:3.0:1789395267.133039:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231910400:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395267.135572:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969957 is committed 00000100:00100000:3.0:1789395267.136238:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231910400:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3191us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.136253:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5365 00000100:00100000:2.0:1789395267.139636:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.139788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231910656 00000100:00100000:1.0:1789395267.139802:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231910656 00000100:00100000:1.0:1789395267.139877:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5241 00000100:00100000:1.0:1789395267.139890:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+52:22080:x1876316231910656:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:1.0:1789395267.140173:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968598 00000100:00100000:1.0:1789395267.140311:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22080:x1876316231910656:12345-192.168.203.54@tcp:35:bash.0 Request processed in 423us (689us total) trans 4294968599 rc 0/0 00000100:00100000:1.0:1789395267.140321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5241 00000020:00080000:1.0:1789395267.140339:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395267.146635:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.146702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231910912 00000100:00100000:3.0:1789395267.146716:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231910912 00000100:00100000:3.0:1789395267.146832:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23921 00000100:00100000:3.0:1789395267.146858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22080:x1876316231910912:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.146892:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.146922:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de33 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106743 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.147116:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316de3a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.147132:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316de3a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.147145:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316de3a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395267.147157:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 0 00010000:00010000:3.0:1789395267.147290:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de33 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106743 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.147332:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316de3a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106743 expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.147343:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:3.0:1789395267.147347:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395267.147351:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51aa00, rc 0) 00000100:00100000:3.0:1789395267.147494:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22080:x1876316231910912:12345-192.168.203.54@tcp:101:bash.0 Request processed in 651us (872us total) trans 4294968600 rc 0/0 00000100:00100000:3.0:1789395267.147502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23921 00000100:00100000:0.0:1789395267.154730:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.154874:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.155011:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231911168 00000100:00100000:2.0:1789395267.155024:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231911168 00000100:00100000:2.0:1789395267.155104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1407 00000100:00100000:2.0:1789395267.155115:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:2396:x1876316231911168:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395267.155134:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395267.155162:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316de3a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106743 expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.155187:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:2.0:1789395267.155193:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395267.155271:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+55:2396:x1876316231911168:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 157us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.155279:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1407 00000100:00100000:1.0:1789395267.156147:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231911040 00000100:00100000:1.0:1789395267.156158:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231911040 00000100:00100000:1.0:1789395267.156208:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5366 00000100:00100000:1.0:1789395267.156216:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+9:22080:x1876316231911040:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.156232:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.156255:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2dea6eb/0xff35729af316de48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210674a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395267.156291:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395267.156312:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789395267.156317:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395267.156326:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2dea6eb/0xff35729af316de48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210674a expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.156344:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2dea6eb/0xff35729af316de48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210674a expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.156357:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56e00, rc 0) 00000100:00100000:1.0:1789395267.156631:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22080:x1876316231911040:12345-192.168.203.54@tcp:101:bash.0 Request processed in 415us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.156640:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5366 00000100:00100000:0.0:1789395267.165823:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.165919:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231911296 00000100:00100000:1.0:1789395267.165932:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231911296 00000100:00100000:1.0:1789395267.166009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23922 00000100:00100000:1.0:1789395267.166020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+55:22080:x1876316231911296:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.166049:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.166075:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316de4f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106751 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.166119:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57800/0xff35729af316de56 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.166135:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57800/0xff35729af316de56 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.166149:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57800/0xff35729af316de56 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.166299:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56400/0xff35729af316de4f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106751 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.166323:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57800/0xff35729af316de56 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106751 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.166332:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:1.0:1789395267.166336:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395267.166339:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b57800, rc 0) 00000100:00100000:1.0:1789395267.167121:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22080:x1876316231911296:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1096us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.167131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23922 00000100:00100000:2.0:1789395267.173874:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.174161:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231911424 00000100:00100000:3.0:1789395267.174174:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231911424 00002000:00100000:3.0:1789395267.174242:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->5) req@ffff89a4cbfe5880 x1876316231911424/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.174254:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe5880 with x1876316231911424 ext(0->5) 00002000:00010000:3.0:1789395267.174262:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4cbfe5880 00000100:00100000:3.0:1789395267.174345:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 60 00000100:00100000:3.0:1789395267.174356:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2396:x1876316231911424:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395267.175540:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231911424:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1175us (1673us total) trans 4294969990 rc 0/0 00000100:00100000:3.0:1789395267.175553:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 60 00002000:00100000:3.0:1789395267.175565:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->5) req@ffff89a4cbfe5880 x1876316231911424/t4294969990(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.175576:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe5880 with x1876316231911424 ext(0->5) 00002000:00010000:3.0:1789395267.175582:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4cbfe5880 00000100:00100000:0.0:1789395267.178590:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.179015:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231911552 00000100:00100000:2.0:1789395267.179028:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231911552 00000100:00100000:2.0:1789395267.179105:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5367 00000100:00100000:2.0:1789395267.179117:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2397:x1876316231911552:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.180756:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969990 is committed 00000100:00100000:2.0:1789395267.180961:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:2397:x1876316231911552:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1838us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.180974:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5367 00000100:00100000:0.0:1789395267.184078:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.184183:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231911808 00000100:00100000:2.0:1789395267.184197:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231911808 00000100:00100000:2.0:1789395267.184282:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5242 00000100:00100000:2.0:1789395267.184293:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22080:x1876316231911808:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.184692:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968601 00000100:00100000:2.0:1789395267.184819:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22080:x1876316231911808:12345-192.168.203.54@tcp:35:bash.0 Request processed in 527us (756us total) trans 4294968602 rc 0/0 00000100:00100000:2.0:1789395267.184829:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5242 00000020:00080000:2.0:1789395267.184836:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.189437:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.189574:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912064 00000100:00100000:3.0:1789395267.189587:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912064 00000100:00100000:3.0:1789395267.189658:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23923 00000100:00100000:3.0:1789395267.189669:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22080:x1876316231912064:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.189698:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.189727:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b600/0xff35729af316de5d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106758 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.189879:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de64 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.189896:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.189910:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395267.189923:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a2:0x0]: returning size 0 00010000:00010000:3.0:1789395267.190069:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b600/0xff35729af316de5d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106758 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.190099:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de64 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106758 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.190109:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:3.0:1789395267.190112:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395267.190117:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51bc00, rc 0) 00000100:00100000:3.0:1789395267.190293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:22080:x1876316231912064:12345-192.168.203.54@tcp:101:bash.0 Request processed in 624us (921us total) trans 4294968603 rc 0/0 00000100:00100000:3.0:1789395267.190301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23923 00000100:00100000:0.0:1789395267.196815:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.197583:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.197748:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912320 00000100:00100000:3.0:1789395267.197761:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912320 00000100:00100000:3.0:1789395267.197843:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1408 00000100:00100000:3.0:1789395267.197869:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:2397:x1876316231912320:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395267.197888:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395267.197917:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316de64 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106758 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.197950:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:3.0:1789395267.197955:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395267.198024:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:2397:x1876316231912320:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 157us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.198032:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1408 00000100:00100000:2.0:1789395267.199789:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912192 00000100:00100000:2.0:1789395267.199808:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912192 00000100:00100000:2.0:1789395267.200057:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5368 00000100:00100000:2.0:1789395267.200071:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22080:x1876316231912192:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.200092:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.200116:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316de72 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210675f expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.200148:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.200183:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.200189:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.200198:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316de72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210675f expref: 11 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.200216:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d79f9274/0xff35729af316de72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210675f expref: 11 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.200232:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4df535600, rc 0) 00000100:00100000:2.0:1789395267.200309:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22080:x1876316231912192:12345-192.168.203.54@tcp:101:bash.0 Request processed in 241us (3509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.200325:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5368 00000100:00100000:3.0:1789395267.204053:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.204135:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912448 00000100:00100000:1.0:1789395267.204148:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912448 00000100:00100000:1.0:1789395267.204220:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23924 00000100:00100000:1.0:1789395267.204233:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:22080:x1876316231912448:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.204258:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.204282:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56a00/0xff35729af316de79 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106766 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.204332:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316de80 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.204352:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316de80 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.204365:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316de80 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.204538:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56a00/0xff35729af316de79 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106766 expref: 61 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.204560:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b56c00/0xff35729af316de80 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106766 expref: 60 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.204569:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:1.0:1789395267.204572:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395267.204575:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56c00, rc 0) 00000100:00100000:1.0:1789395267.204638:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:22080:x1876316231912448:12345-192.168.203.54@tcp:101:bash.0 Request processed in 408us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.204646:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23924 00000100:00100000:1.0:1789395267.210643:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.210832:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912576 00000100:00100000:2.0:1789395267.210844:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912576 00002000:00100000:2.0:1789395267.210910:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x6:0x0] (0->5) req@ffff89a501db2300 x1876316231912576/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.210923:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2300 with x1876316231912576 ext(0->5) 00002000:00010000:2.0:1789395267.210931:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db2300 00000100:00100000:2.0:1789395267.210980:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 61 00000100:00100000:2.0:1789395267.210992:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231912576:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395267.212872:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231912576:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1870us (2231us total) trans 4294969958 rc 0/0 00000100:00100000:2.0:1789395267.212887:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 61 00002000:00100000:2.0:1789395267.212901:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x6:0x0] (0->5) req@ffff89a501db2300 x1876316231912576/t4294969958(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.212912:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2300 with x1876316231912576 ext(0->5) 00002000:00010000:2.0:1789395267.212918:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db2300 00000100:00100000:1.0:1789395267.216745:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.216848:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912704 00000100:00100000:2.0:1789395267.216862:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912704 00000100:00100000:2.0:1789395267.216930:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5369 00000100:00100000:2.0:1789395267.216959:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231912704:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.218751:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969958 is committed 00000100:00100000:2.0:1789395267.218965:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231912704:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2007us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.218979:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5369 00000100:00100000:3.0:1789395267.222213:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.222342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231912960 00000100:00100000:2.0:1789395267.222355:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231912960 00000100:00100000:2.0:1789395267.222606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5243 00000100:00100000:2.0:1789395267.222618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:22080:x1876316231912960:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.222884:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968604 00000100:00100000:2.0:1789395267.223031:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+62:22080:x1876316231912960:12345-192.168.203.54@tcp:35:bash.0 Request processed in 414us (830us total) trans 4294968605 rc 0/0 00000100:00100000:2.0:1789395267.223039:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5243 00000020:00080000:2.0:1789395267.223045:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.227320:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.227422:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231913216 00000100:00100000:0.0:1789395267.227437:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231913216 00000100:00100000:0.0:1789395267.227508:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23925 00000100:00100000:0.0:1789395267.227521:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+62:22080:x1876316231913216:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.227553:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.227579:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316de87 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210676d expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.227725:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316de8e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.227742:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316de8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.227755:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316de8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.227769:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a3:0x0]: returning size 0 00010000:00010000:0.0:1789395267.227902:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c400/0xff35729af316de87 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210676d expref: 65 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.227933:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316de8e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210676d expref: 64 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.227955:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:0.0:1789395267.227958:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.227963:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ce00, rc 0) 00000100:00100000:0.0:1789395267.228045:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:22080:x1876316231913216:12345-192.168.203.54@tcp:101:bash.0 Request processed in 527us (750us total) trans 4294968606 rc 0/0 00000100:00100000:0.0:1789395267.228053:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23925 00000100:00100000:1.0:1789395267.233443:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.233506:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.233624:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231913344 00000100:00100000:0.0:1789395267.233636:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231913344 00000100:00100000:0.0:1789395267.233700:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5370 00000100:00100000:0.0:1789395267.233711:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+10:22080:x1876316231913344:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.233732:0:14652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.233757:0:14652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316de9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106774 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395267.233791:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395267.233819:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789395267.233824:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395267.233833:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316de9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106774 expref: 11 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.233869:0:14652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c33d8887/0xff35729af316de9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106774 expref: 11 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.233884:0:14652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c400, rc 0) 00000100:00100000:0.0:1789395267.233974:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22080:x1876316231913344:12345-192.168.203.54@tcp:101:bash.0 Request processed in 263us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.233981:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5370 00000100:00100000:2.0:1789395267.234291:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231913472 00000100:00100000:2.0:1789395267.234298:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231913472 00000100:00100000:2.0:1789395267.234346:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1409 00000100:00100000:2.0:1789395267.234354:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:2396:x1876316231913472:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395267.234366:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395267.234424:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316de8e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210676d expref: 64 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.234444:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:2.0:1789395267.234449:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395267.234478:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:2396:x1876316231913472:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 125us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.234486:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1409 00000100:00100000:1.0:1789395267.242822:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.243050:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231913600 00000100:00100000:2.0:1789395267.243065:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231913600 00000100:00100000:2.0:1789395267.243140:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23926 00000100:00100000:2.0:1789395267.243152:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:22080:x1876316231913600:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.243180:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.243206:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dea3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210677b expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.243250:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316deaa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.243265:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316deaa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.243279:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316deaa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.243686:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534400/0xff35729af316dea3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210677b expref: 65 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.243708:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df000/0xff35729af316deaa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210677b expref: 64 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.243718:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:2.0:1789395267.243722:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395267.243726:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df000, rc 0) 00000100:00100000:2.0:1789395267.243810:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:22080:x1876316231913600:12345-192.168.203.54@tcp:101:bash.0 Request processed in 661us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.243819:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23926 00000100:00100000:1.0:1789395267.250811:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239801856:0@lo:400:kworker.0 00000100:00100000:1.0:1789395267.250910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395267.250996:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239802368:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251247:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876316239801600:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251282:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251305:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239802112:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251364:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239802624:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251424:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251458:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789395267.251465:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239801472:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251502:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251521:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239801984:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251564:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239802496:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251606:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239803008:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.251662:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802496 00000100:00100000:3.0:1789395267.251670:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802496 00000100:00100000:3.0:1789395267.251729:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239803008 00000100:00100000:3.0:1789395267.251733:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239803008 00000100:00100000:3.0:1789395267.251757:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789395267.251766:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239802496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251823:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239802496:12345-0@lo:400:kworker.0 Request processed in 58us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.251832:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789395267.251851:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1789395267.251858:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239803008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.251886:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239803008:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.251892:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00080000:3.0:1789395267.251908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395267.251913:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789395267.251923:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801856 00000100:00100000:3.0:1789395267.251927:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801856 00000100:00100000:3.0:1789395267.251965:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801600 00000100:00100000:3.0:1789395267.251968:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801600 00000100:00100000:3.0:1789395267.251990:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802112 00000100:00100000:3.0:1789395267.251993:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802112 00000100:00100000:3.0:1789395267.252011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802624 00000100:00100000:3.0:1789395267.252014:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802624 00000100:00100000:3.0:1789395267.252029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1789395267.252040:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239801856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876316239801856:12345-0@lo:400:kworker.0 Request processed in 38us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.252079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1789395267.252090:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1789395267.252096:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876316239801600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252123:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876316239801600:12345-0@lo:400:kworker.0 Request processed in 27us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.252129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1789395267.252140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1789395267.252145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239802112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252171:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876316239802112:12345-0@lo:400:kworker.0 Request processed in 26us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.252177:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1789395267.252187:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1789395267.252193:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239802624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252217:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876316239802624:12345-0@lo:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.252223:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00080000:3.0:1789395267.252237:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789395267.252270:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239802496:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252282:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239803008:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252291:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876316239801600:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252300:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1876316239802112:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.252310:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1876316239802624:0@lo:400:kworker.0 00000100:00100000:1.0:1789395267.252702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395267.252786:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239801728:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.252828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395267.252861:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a501db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239802240:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.252883:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395267.252896:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4fedf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239802752:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.252915:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395267.252964:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801472 00000100:00100000:0.0:1789395267.252970:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801472 00000100:00100000:0.0:1789395267.253010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1789395267.253017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239801472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253061:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3639:x1876316239801472:12345-0@lo:400:kworker.0 Request processed in 44us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.253067:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1789395267.253101:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801984 00000100:00100000:0.0:1789395267.253105:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801984 00000100:00100000:0.0:1789395267.253129:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239801728 00000100:00100000:0.0:1789395267.253132:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239801728 00000100:00100000:0.0:1789395267.253151:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631 00000100:00100000:0.0:1789395267.253158:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239801984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253192:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239801984:12345-0@lo:400:kworker.0 Request processed in 34us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.253199:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631 00000100:00100000:0.0:1789395267.253211:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3632 00000100:00100000:0.0:1789395267.253216:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239801728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253247:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:3636:x1876316239801728:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.253253:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3632 00000100:00100000:0.0:1789395267.253296:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239801728:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253331:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d0428a-b483-45e6-97c2-4fac3e6d8266:3639:1876316239801472:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253343:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239801984:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253367:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802240 00000100:00100000:0.0:1789395267.253371:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802240 00000100:00100000:1.0:1789395267.253530:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239802880:0@lo:400:kworker.0 00000100:00100000:1.0:1789395267.253561:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395267.253620:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802752 00000100:00100000:3.0:1789395267.253624:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802752 00000100:00100000:3.0:1789395267.253658:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1789395267.253665:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239802752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.253705:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876316239802752:12345-0@lo:400:kworker.0 Request processed in 41us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.253710:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1789395267.253845:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1789395267.253852:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239802240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253885:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876316239802240:12345-0@lo:400:kworker.0 Request processed in 33us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.253892:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00080000:0.0:1789395267.253908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789395267.253931:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1876316239802240:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.253955:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1876316239802752:0@lo:400:kworker.0 00000100:00100000:3.0:1789395267.255199:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.255793:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a501db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876316239801856:0@lo:400:kworker.0 00000100:00100000:2.0:1789395267.255875:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802368 00000100:00100000:2.0:1789395267.255884:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802368 00000100:00100000:2.0:1789395267.255960:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239802880 00000100:00100000:2.0:1789395267.255964:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239802880 00000100:00100000:2.0:1789395267.255992:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789395267.256001:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239802368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395267.256072:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239802368:12345-0@lo:400:kworker.0 Request processed in 73us (3371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.256080:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789395267.256098:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1789395267.256104:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239802880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395267.256131:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3637:x1876316239802880:12345-0@lo:400:kworker.0 Request processed in 28us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.256137:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00080000:2.0:1789395267.256154:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789395267.256158:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395267.256247:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231913728 00000100:00100000:0.0:1789395267.256252:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231913728 00002000:00100000:0.0:1789395267.256290:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->5) req@ffff89a3c9a4bb80 x1876316231913728/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.256302:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a4bb80 with x1876316231913728 ext(0->5) 00002000:00010000:0.0:1789395267.256309:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9a4bb80 00000100:00100000:0.0:1789395267.256342:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 62 00000100:00100000:0.0:1789395267.256350:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2396:x1876316231913728:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395267.257049:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4fedf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239802368:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.257066:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239802880:0@lo:400:kworker.0 00000100:00100000:0.0:1789395267.257783:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231913728:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1429us (2586us total) trans 4294969991 rc 0/0 00000100:00100000:0.0:1789395267.257795:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 62 00002000:00100000:0.0:1789395267.257808:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->5) req@ffff89a3c9a4bb80 x1876316231913728/t4294969991(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.257819:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a4bb80 with x1876316231913728 ext(0->5) 00002000:00010000:0.0:1789395267.257825:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9a4bb80 00000100:00100000:3.0:1789395267.261496:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.261641:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231913856 00000100:00100000:2.0:1789395267.261654:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231913856 00000100:00100000:2.0:1789395267.261708:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5371 00000100:00100000:2.0:1789395267.261717:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231913856:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.263152:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969991 is committed 00000100:00100000:2.0:1789395267.263348:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:2395:x1876316231913856:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1625us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.263360:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5371 00000100:00100000:2.0:1789395267.266907:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.267033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231914112 00000100:00100000:1.0:1789395267.267047:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231914112 00000100:00100000:1.0:1789395267.267166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5244 00000100:00100000:1.0:1789395267.267178:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:22080:x1876316231914112:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:1.0:1789395267.267511:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968607 00000100:00100000:1.0:1789395267.267641:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+66:22080:x1876316231914112:12345-192.168.203.54@tcp:35:bash.0 Request processed in 463us (746us total) trans 4294968608 rc 0/0 00000100:00100000:1.0:1789395267.267649:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5244 00000020:00080000:1.0:1789395267.267655:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395267.272056:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.272172:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231914368 00000100:00100000:0.0:1789395267.272186:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231914368 00000100:00100000:0.0:1789395267.272264:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23927 00000100:00100000:0.0:1789395267.272276:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+66:22080:x1876316231914368:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.272308:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.272345:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316deb1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106782 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.272583:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316deb8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.272598:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316deb8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.272611:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316deb8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.272623:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a4:0x0]: returning size 0 00010000:00010000:0.0:1789395267.272750:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316deb1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106782 expref: 69 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.272779:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316deb8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106782 expref: 68 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.272789:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:0.0:1789395267.272792:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.272796:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10da00, rc 0) 00000100:00100000:0.0:1789395267.273093:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:22080:x1876316231914368:12345-192.168.203.54@tcp:101:bash.0 Request processed in 818us (1051us total) trans 4294968609 rc 0/0 00000100:00100000:0.0:1789395267.273102:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23927 00000100:00100000:3.0:1789395267.279669:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.279718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.279821:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231914496 00000100:00100000:1.0:1789395267.279834:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231914496 00000100:00100000:1.0:1789395267.279921:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5372 00000100:00100000:1.0:1789395267.279933:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22080:x1876316231914496:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.279964:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.279991:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc54c2aa/0xff35729af316dec6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106789 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395267.280025:0:14478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395267.280054:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789395267.280059:0:14478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395267.280068:0:14478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc54c2aa/0xff35729af316dec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106789 expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.280091:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc54c2aa/0xff35729af316dec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106789 expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.280104:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56400, rc 0) 00000100:00100000:1.0:1789395267.280187:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22080:x1876316231914496:12345-192.168.203.54@tcp:101:bash.0 Request processed in 256us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.280195:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5372 00000100:00100000:2.0:1789395267.280790:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231914624 00000100:00100000:2.0:1789395267.280798:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231914624 00000100:00100000:2.0:1789395267.280863:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1410 00000100:00100000:2.0:1789395267.280873:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:2395:x1876316231914624:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395267.280886:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395267.280911:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316deb8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106782 expref: 68 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.280948:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:2.0:1789395267.280954:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395267.280991:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+67:2395:x1876316231914624:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 121us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.280999:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1410 00000100:00100000:3.0:1789395267.285895:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.286138:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231914752 00000100:00100000:0.0:1789395267.286152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231914752 00000100:00100000:0.0:1789395267.286228:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23928 00000100:00100000:0.0:1789395267.286239:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+67:22080:x1876316231914752:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.286271:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.286298:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316decd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106790 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.286351:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316ded4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.286366:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316ded4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.286378:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316ded4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.286562:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316decd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106790 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.286584:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10ce00/0xff35729af316ded4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106790 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.286594:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:0.0:1789395267.286597:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395267.286601:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10ce00, rc 0) 00000100:00100000:0.0:1789395267.286672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:22080:x1876316231914752:12345-192.168.203.54@tcp:101:bash.0 Request processed in 435us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.286680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23928 00000100:00100000:1.0:1789395267.302381:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.303030:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231914880 00000100:00100000:3.0:1789395267.303045:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231914880 00002000:00100000:3.0:1789395267.303110:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7:0x0] (0->6) req@ffff89a3c904d180 x1876316231914880/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.303123:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c904d180 with x1876316231914880 ext(0->6) 00002000:00010000:3.0:1789395267.303130:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c904d180 00000100:00100000:3.0:1789395267.303174:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 63 00000100:00100000:3.0:1789395267.303185:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231914880:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395267.306540:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231914880:12345-192.168.203.54@tcp:4:bash.0 Request processed in 3339us (4158us total) trans 4294969959 rc 0/0 00000100:00100000:3.0:1789395267.306562:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 63 00002000:00100000:3.0:1789395267.306579:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7:0x0] (0->6) req@ffff89a3c904d180 x1876316231914880/t4294969959(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.306590:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c904d180 with x1876316231914880 ext(0->6) 00002000:00010000:3.0:1789395267.306597:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c904d180 00010000:00010000:3.0:1789395267.316948:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789395267.317435:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.317575:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231915008 00000100:00100000:2.0:1789395267.317588:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231915008 00000100:00100000:2.0:1789395267.317656:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5373 00000100:00100000:2.0:1789395267.317667:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231915008:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.322008:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969959 is committed 00000100:00100000:2.0:1789395267.322609:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231915008:12345-192.168.203.54@tcp:16:bash.0 Request processed in 4934us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.322623:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5373 00000100:00100000:1.0:1789395267.326611:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.326721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231915264 00000100:00100000:2.0:1789395267.326734:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231915264 00000100:00100000:2.0:1789395267.326808:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5245 00000100:00100000:2.0:1789395267.326820:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:22080:x1876316231915264:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.327111:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968610 00000100:00100000:2.0:1789395267.327261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+70:22080:x1876316231915264:12345-192.168.203.54@tcp:35:bash.0 Request processed in 443us (664us total) trans 4294968611 rc 0/0 00000100:00100000:2.0:1789395267.327269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5245 00000020:00080000:2.0:1789395267.327276:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.334125:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.334302:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231915520 00000100:00100000:0.0:1789395267.334315:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231915520 00000100:00100000:0.0:1789395267.334445:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23929 00000100:00100000:0.0:1789395267.334458:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+70:22080:x1876316231915520:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.334486:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.334514:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316dedb lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106797 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.334656:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316dee2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.334672:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316dee2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.334683:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316dee2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.334696:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a5:0x0]: returning size 0 00010000:00010000:0.0:1789395267.334822:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316dedb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106797 expref: 73 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.334852:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316dee2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106797 expref: 72 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.334862:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:0.0:1789395267.334865:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.334869:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:0.0:1789395267.334956:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:22080:x1876316231915520:12345-192.168.203.54@tcp:101:bash.0 Request processed in 500us (846us total) trans 4294968612 rc 0/0 00000100:00100000:0.0:1789395267.334968:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23929 00000100:00100000:3.0:1789395267.342651:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.342708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.342819:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231915648 00000100:00100000:2.0:1789395267.342832:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231915648 00000100:00100000:2.0:1789395267.342980:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5374 00000100:00100000:2.0:1789395267.342993:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+11:22080:x1876316231915648:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.343019:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.343045:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f370e991/0xff35729af316def0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210679e expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.343077:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.343104:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.343110:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.343119:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f370e991/0xff35729af316def0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210679e expref: 12 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.343137:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f370e991/0xff35729af316def0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210679e expref: 12 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.343152:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df600, rc 0) 00000100:00100000:2.0:1789395267.343225:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22080:x1876316231915648:12345-192.168.203.54@tcp:101:bash.0 Request processed in 235us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.343233:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5374 00000100:00100000:3.0:1789395267.347144:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.347200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231915904 00000100:00100000:3.0:1789395267.347210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231915904 00000100:00100000:3.0:1789395267.347271:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23930 00000100:00100000:3.0:1789395267.347281:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:22080:x1876316231915904:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.347307:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.347342:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316def7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.347379:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b600/0xff35729af316defe lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.347433:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b600/0xff35729af316defe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.347446:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b600/0xff35729af316defe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395267.347464:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231915776 00000100:00100000:0.0:1789395267.347472:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231915776 00000100:00100000:0.0:1789395267.347519:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1411 00000100:00100000:0.0:1789395267.347528:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4df88a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:2397:x1876316231915776:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395267.347541:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395267.347561:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316dee2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106797 expref: 74 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.347582:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:0.0:1789395267.347588:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395267.347602:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316def7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067a5 expref: 74 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.347619:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b600/0xff35729af316defe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067a5 expref: 73 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.347627:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:3.0:1789395267.347631:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789395267.347634:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b600, rc 0) 00000100:00100000:0.0:1789395267.347656:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4df88a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+73:2397:x1876316231915776:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 127us (4946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.347664:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1411 00000100:00100000:3.0:1789395267.347671:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+73:22080:x1876316231915904:12345-192.168.203.54@tcp:101:bash.0 Request processed in 389us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.347678:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23930 00000100:00100000:3.0:1789395267.356247:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.356782:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231916032 00000100:00100000:2.0:1789395267.356802:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231916032 00002000:00100000:2.0:1789395267.356859:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (0->6) req@ffff89a3c9a48a80 x1876316231916032/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.356869:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a48a80 with x1876316231916032 ext(0->6) 00002000:00010000:2.0:1789395267.356875:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9a48a80 00000100:00100000:2.0:1789395267.356910:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 64 00000100:00100000:2.0:1789395267.356921:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2395:x1876316231916032:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395267.358355:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231916032:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1423us (2113us total) trans 4294969992 rc 0/0 00000100:00100000:2.0:1789395267.358371:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 64 00002000:00100000:2.0:1789395267.358569:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7:0x0] (0->6) req@ffff89a3c9a48a80 x1876316231916032/t4294969992(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.358582:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a48a80 with x1876316231916032 ext(0->6) 00002000:00010000:2.0:1789395267.358590:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c9a48a80 00000100:00100000:0.0:1789395267.363146:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.363320:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231916160 00000100:00100000:1.0:1789395267.363336:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231916160 00000100:00100000:1.0:1789395267.363453:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5375 00000100:00100000:1.0:1789395267.363466:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231916160:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.365900:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969992 is committed 00000100:00100000:1.0:1789395267.366259:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:2396:x1876316231916160:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2787us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.366275:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5375 00000100:00100000:2.0:1789395267.370045:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.370140:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231916416 00000100:00100000:1.0:1789395267.370155:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231916416 00000100:00100000:1.0:1789395267.370235:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5246 00000100:00100000:1.0:1789395267.370247:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:22080:x1876316231916416:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:1.0:1789395267.370562:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968613 00000100:00100000:1.0:1789395267.371019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:22080:x1876316231916416:12345-192.168.203.54@tcp:35:bash.0 Request processed in 770us (987us total) trans 4294968614 rc 0/0 00000100:00100000:1.0:1789395267.371033:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5246 00000020:00080000:1.0:1789395267.371040:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395267.375544:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.375689:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231916672 00000100:00100000:0.0:1789395267.375702:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231916672 00000100:00100000:0.0:1789395267.375766:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23931 00000100:00100000:0.0:1789395267.375778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:22080:x1876316231916672:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.375805:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.375832:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316df05 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067ac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.375989:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df0c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.376010:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.376022:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.376034:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a6:0x0]: returning size 0 00010000:00010000:0.0:1789395267.376169:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316df05 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067ac expref: 77 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.376198:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df0c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067ac expref: 76 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.376208:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:0.0:1789395267.376211:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.376215:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:0.0:1789395267.376562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:22080:x1876316231916672:12345-192.168.203.54@tcp:101:bash.0 Request processed in 783us (1031us total) trans 4294968615 rc 0/0 00000100:00100000:0.0:1789395267.376570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23931 00000100:00100000:0.0:1789395267.382786:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.382839:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.382967:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231916800 00000100:00100000:2.0:1789395267.382980:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231916800 00000100:00100000:2.0:1789395267.383053:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5376 00000100:00100000:2.0:1789395267.383065:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22080:x1876316231916800:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.383088:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.383116:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083756f94/0xff35729af316df1a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067b3 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.383154:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.383193:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.383199:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.383207:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083756f94/0xff35729af316df1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067b3 expref: 13 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.383225:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083756f94/0xff35729af316df1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067b3 expref: 13 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.383245:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3dfe00, rc 0) 00000100:00100000:2.0:1789395267.383329:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22080:x1876316231916800:12345-192.168.203.54@tcp:101:bash.0 Request processed in 266us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.383337:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5376 00000100:00100000:3.0:1789395267.384459:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231916928 00000100:00100000:3.0:1789395267.384477:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231916928 00000100:00100000:3.0:1789395267.384558:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1412 00000100:00100000:3.0:1789395267.384567:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:2396:x1876316231916928:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395267.384581:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395267.384607:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df0c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067ac expref: 76 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.384629:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:3.0:1789395267.384635:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395267.384686:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:2396:x1876316231916928:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 120us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.384697:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1412 00000100:00100000:0.0:1789395267.389656:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.389823:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231917056 00000100:00100000:2.0:1789395267.389837:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231917056 00000100:00100000:2.0:1789395267.389915:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23932 00000100:00100000:2.0:1789395267.389927:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:22080:x1876316231917056:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.389966:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.389992:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316df21 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067ba expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.390033:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316df28 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.390050:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316df28 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.390063:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316df28 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.390627:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316df21 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067ba expref: 77 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.390650:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1a00/0xff35729af316df28 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067ba expref: 76 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.390664:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:2.0:1789395267.390667:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395267.390671:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1a00, rc 0) 00000100:00100000:2.0:1789395267.390743:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:22080:x1876316231917056:12345-192.168.203.54@tcp:101:bash.0 Request processed in 818us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.390751:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23932 00000100:00100000:2.0:1789395267.398426:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.398822:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231917184 00000100:00100000:0.0:1789395267.398835:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231917184 00002000:00100000:0.0:1789395267.398903:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x8:0x0] (0->6) req@ffff89a4cbfe6a00 x1876316231917184/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.398916:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe6a00 with x1876316231917184 ext(0->6) 00002000:00010000:0.0:1789395267.398924:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4cbfe6a00 00000100:00100000:0.0:1789395267.398978:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 65 00000100:00100000:0.0:1789395267.398990:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2396:x1876316231917184:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395267.400829:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231917184:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1828us (2435us total) trans 4294969960 rc 0/0 00000100:00100000:0.0:1789395267.400844:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 65 00002000:00100000:0.0:1789395267.400860:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x8:0x0] (0->6) req@ffff89a4cbfe6a00 x1876316231917184/t4294969960(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.400872:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe6a00 with x1876316231917184 ext(0->6) 00002000:00010000:0.0:1789395267.400880:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4cbfe6a00 00000100:00100000:3.0:1789395267.404993:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.405276:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231917312 00000100:00100000:2.0:1789395267.405290:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231917312 00000100:00100000:2.0:1789395267.405377:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5377 00000100:00100000:2.0:1789395267.405588:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231917312:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.407610:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969960 is committed 00000100:00100000:2.0:1789395267.408025:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2395:x1876316231917312:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2629us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.408039:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5377 00000100:00100000:3.0:1789395267.418867:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.419059:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231917568 00000100:00100000:0.0:1789395267.419073:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231917568 00000100:00100000:0.0:1789395267.419263:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5247 00000100:00100000:0.0:1789395267.419277:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:22080:x1876316231917568:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:0.0:1789395267.419643:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968616 00000100:00100000:0.0:1789395267.420250:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+78:22080:x1876316231917568:12345-192.168.203.54@tcp:35:bash.0 Request processed in 971us (1392us total) trans 4294968617 rc 0/0 00000100:00100000:0.0:1789395267.425906:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5247 00000020:00080000:0.0:1789395267.425923:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.426653:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.426771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231917824 00000100:00100000:3.0:1789395267.426783:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231917824 00000100:00100000:3.0:1789395267.426895:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23933 00000100:00100000:3.0:1789395267.426907:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+78:22080:x1876316231917824:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.426944:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.426973:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316df2f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.427136:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df36 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.427152:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df36 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.429693:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df36 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395267.429728:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a7:0x0]: returning size 0 00010000:00010000:2.0:1789395267.430436:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316df2f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067c1 expref: 81 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.430477:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df36 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067c1 expref: 80 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.430488:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:2.0:1789395267.430492:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395267.430497:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ba00, rc 0) 00000100:00100000:2.0:1789395267.430602:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:22080:x1876316231917824:12345-192.168.203.54@tcp:101:bash.0 Request processed in 3695us (3950us total) trans 4294968618 rc 0/0 00000100:00100000:2.0:1789395267.430617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23933 00000100:00100000:3.0:1789395267.435123:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.435303:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231917952 00000100:00100000:1.0:1789395267.435323:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231917952 00000100:00100000:1.0:1789395267.435434:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5378 00000100:00100000:1.0:1789395267.435446:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+12:22080:x1876316231917952:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395267.435468:0:10007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395267.435495:0:10007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316df44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067c8 expref: -99 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395267.435528:0:10007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395267.435554:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1789395267.435560:0:10007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395267.435568:0:10007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316df44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067c8 expref: 13 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.435586:0:10007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3976c16/0xff35729af316df44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067c8 expref: 13 pid: 10007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.435600:0:10007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9b56a00, rc 0) 00000100:00100000:1.0:1789395267.435669:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22080:x1876316231917952:12345-192.168.203.54@tcp:101:bash.0 Request processed in 225us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.435677:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5378 00000100:00100000:0.0:1789395267.442921:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.444018:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231918080 00000100:00100000:3.0:1789395267.444035:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231918080 00000100:00100000:3.0:1789395267.444126:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1413 00000100:00100000:3.0:1789395267.444137:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:2395:x1876316231918080:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395267.444156:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395267.444191:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df36 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067c1 expref: 80 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.444212:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:3.0:1789395267.444217:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395267.444316:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+79:2395:x1876316231918080:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 173us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.444325:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1413 00000100:00100000:1.0:1789395267.453081:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.453268:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231918208 00000100:00100000:0.0:1789395267.453282:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231918208 00000100:00100000:0.0:1789395267.453349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23934 00000100:00100000:0.0:1789395267.453361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+79:22080:x1876316231918208:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.453405:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.453431:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316df4b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067cf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.453480:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316df52 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.453499:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316df52 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.453511:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316df52 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.453677:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10da00/0xff35729af316df4b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067cf expref: 81 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.453701:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c800/0xff35729af316df52 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067cf expref: 80 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.453710:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395267.453713:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395267.453717:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10c800, rc 0) 00000100:00100000:0.0:1789395267.453800:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:22080:x1876316231918208:12345-192.168.203.54@tcp:101:bash.0 Request processed in 442us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.453808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23934 00000100:00100000:1.0:1789395267.463020:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.463888:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231918336 00000100:00100000:3.0:1789395267.463905:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231918336 00002000:00100000:3.0:1789395267.463982:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->6) req@ffff89a3cac40a80 x1876316231918336/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.463995:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac40a80 with x1876316231918336 ext(0->6) 00002000:00010000:3.0:1789395267.464002:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cac40a80 00000100:00100000:3.0:1789395267.464107:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 66 00000100:00100000:3.0:1789395267.464120:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2398:x1876316231918336:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395267.466225:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2398:x1876316231918336:12345-192.168.203.54@tcp:4:bash.0 Request processed in 2092us (3204us total) trans 4294969993 rc 0/0 00000100:00100000:3.0:1789395267.466242:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 66 00002000:00100000:3.0:1789395267.466260:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->6) req@ffff89a3cac40a80 x1876316231918336/t4294969993(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.466284:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac40a80 with x1876316231918336 ext(0->6) 00002000:00010000:3.0:1789395267.466292:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cac40a80 00000100:00100000:0.0:1789395267.477637:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.477909:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231918464 00000100:00100000:2.0:1789395267.477922:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231918464 00000100:00100000:2.0:1789395267.478012:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5379 00000100:00100000:2.0:1789395267.478024:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2397:x1876316231918464:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395267.482211:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969993 is committed 00000100:00100000:0.0:1789395267.484897:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:2397:x1876316231918464:12345-192.168.203.54@tcp:16:bash.0 Request processed in 6859us (7258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.484914:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5379 00000100:00100000:1.0:1789395267.490635:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.490749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231918720 00000100:00100000:0.0:1789395267.490765:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231918720 00000100:00100000:0.0:1789395267.490847:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5248 00000100:00100000:0.0:1789395267.490859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:22080:x1876316231918720:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:1.0:1789395267.503782:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968619 00000100:00100000:1.0:1789395267.504056:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+82:22080:x1876316231918720:12345-192.168.203.54@tcp:35:bash.0 Request processed in 13192us (13430us total) trans 4294968620 rc 0/0 00000100:00100000:1.0:1789395267.504070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5248 00000020:00080000:1.0:1789395267.504077:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.510107:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.510355:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231918976 00000100:00100000:3.0:1789395267.510371:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231918976 00000100:00100000:3.0:1789395267.510615:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23935 00000100:00100000:3.0:1789395267.510629:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+82:22080:x1876316231918976:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.510660:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.510687:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316df59 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067d6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.510832:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df60 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.510863:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.510877:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395267.510889:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a8:0x0]: returning size 0 00010000:00010000:3.0:1789395267.511038:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316df59 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067d6 expref: 85 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.511068:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df60 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067d6 expref: 84 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.511078:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:3.0:1789395267.511081:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395267.511085:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ba00, rc 0) 00000100:00100000:3.0:1789395267.511165:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:22080:x1876316231918976:12345-192.168.203.54@tcp:101:bash.0 Request processed in 538us (1071us total) trans 4294968621 rc 0/0 00000100:00100000:3.0:1789395267.511173:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23935 00000100:00100000:3.0:1789395267.520204:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.520421:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231919232 00000100:00100000:0.0:1789395267.520435:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231919232 00000100:00100000:0.0:1789395267.520516:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5380 00000100:00100000:0.0:1789395267.520529:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22080:x1876316231919232:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.520552:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.520578:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316df6e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067dd expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395267.520613:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395267.520640:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789395267.520645:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395267.520654:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316df6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067dd expref: 14 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.520673:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009376d580/0xff35729af316df6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067dd expref: 14 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.520686:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10da00, rc 0) 00000100:00100000:0.0:1789395267.520761:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22080:x1876316231919232:12345-192.168.203.54@tcp:101:bash.0 Request processed in 234us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.520768:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5380 00000100:00100000:3.0:1789395267.521488:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.522259:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231919104 00000100:00100000:0.0:1789395267.522524:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231919104 00000100:00100000:0.0:1789395267.522608:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1414 00000100:00100000:0.0:1789395267.522618:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:2398:x1876316231919104:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395267.522634:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395267.522662:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316df60 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067d6 expref: 84 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.522685:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:0.0:1789395267.522691:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395267.522759:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+83:2398:x1876316231919104:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 142us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.522766:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1414 00000100:00100000:1.0:1789395267.525961:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.527944:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231919360 00000100:00100000:0.0:1789395267.527967:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231919360 00000100:00100000:0.0:1789395267.528043:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23936 00000100:00100000:0.0:1789395267.528054:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+83:22080:x1876316231919360:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.528084:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.528108:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df75 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067e4 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.528150:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377200/0xff35729af316df7c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.528173:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377200/0xff35729af316df7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.528185:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377200/0xff35729af316df7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.528358:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316df75 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067e4 expref: 85 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.528379:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377200/0xff35729af316df7c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067e4 expref: 84 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.528426:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:0.0:1789395267.528429:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395267.528433:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377200, rc 0) 00000100:00100000:0.0:1789395267.528523:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:22080:x1876316231919360:12345-192.168.203.54@tcp:101:bash.0 Request processed in 470us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.528530:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23936 00000100:00100000:1.0:1789395267.541587:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.541700:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231919488 00000100:00100000:2.0:1789395267.541714:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231919488 00002000:00100000:2.0:1789395267.541778:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x9:0x0] (0->6) req@ffff89a3cac43480 x1876316231919488/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.541791:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac43480 with x1876316231919488 ext(0->6) 00002000:00010000:2.0:1789395267.541799:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cac43480 00000100:00100000:2.0:1789395267.541848:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 67 00000100:00100000:2.0:1789395267.541858:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231919488:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395267.544660:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231919488:12345-192.168.203.54@tcp:4:bash.0 Request processed in 2787us (3074us total) trans 4294969961 rc 0/0 00000100:00100000:2.0:1789395267.544679:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 67 00002000:00100000:2.0:1789395267.544693:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x9:0x0] (0->6) req@ffff89a3cac43480 x1876316231919488/t4294969961(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.544704:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac43480 with x1876316231919488 ext(0->6) 00002000:00010000:2.0:1789395267.544712:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cac43480 00000100:00100000:2.0:1789395267.569821:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.570522:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231919616 00000100:00100000:1.0:1789395267.570538:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231919616 00000100:00100000:1.0:1789395267.570621:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5381 00000100:00100000:1.0:1789395267.570634:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231919616:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395267.577573:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969961 is committed 00000100:00100000:2.0:1789395267.585001:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2395:x1876316231919616:12345-192.168.203.54@tcp:16:bash.0 Request processed in 14352us (15176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.585020:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5381 00000100:00100000:1.0:1789395267.588320:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.588879:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231919872 00000100:00100000:0.0:1789395267.588892:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231919872 00000100:00100000:0.0:1789395267.588974:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5249 00000100:00100000:0.0:1789395267.588985:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:22080:x1876316231919872:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:0.0:1789395267.589270:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968622 00000100:00100000:0.0:1789395267.589561:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+86:22080:x1876316231919872:12345-192.168.203.54@tcp:35:bash.0 Request processed in 576us (1255us total) trans 4294968623 rc 0/0 00000100:00100000:0.0:1789395267.589570:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5249 00000020:00080000:0.0:1789395267.589576:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.594944:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.595045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231920128 00000100:00100000:0.0:1789395267.595059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231920128 00000100:00100000:0.0:1789395267.595138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23937 00000100:00100000:0.0:1789395267.595151:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+86:22080:x1876316231920128:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.595184:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.595214:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316df83 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067eb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.595379:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316df8a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.595541:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316df8a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.595556:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316df8a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.595568:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a9:0x0]: returning size 0 00010000:00010000:0.0:1789395267.595691:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316df83 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067eb expref: 89 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.595718:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316df8a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067eb expref: 88 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.595728:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:0.0:1789395267.595731:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.595735:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376c00, rc 0) 00000100:00100000:0.0:1789395267.595820:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:22080:x1876316231920128:12345-192.168.203.54@tcp:101:bash.0 Request processed in 672us (900us total) trans 4294968624 rc 0/0 00000100:00100000:0.0:1789395267.595827:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23937 00000100:00100000:1.0:1789395267.600776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.600883:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231920256 00000100:00100000:2.0:1789395267.600896:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231920256 00000100:00100000:2.0:1789395267.600982:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5382 00000100:00100000:2.0:1789395267.600994:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+13:22080:x1876316231920256:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.601017:0:14652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.601043:0:14652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316df98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067f2 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.601077:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.601107:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.601113:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.601122:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316df98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067f2 expref: 14 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.601139:0:14652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066e09617/0xff35729af316df98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067f2 expref: 14 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.601153:0:14652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0600, rc 0) 00000100:00100000:2.0:1789395267.601311:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22080:x1876316231920256:12345-192.168.203.54@tcp:101:bash.0 Request processed in 319us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.601320:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5382 00000100:00100000:1.0:1789395267.603099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.603296:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231920384 00000100:00100000:2.0:1789395267.603313:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231920384 00000100:00100000:2.0:1789395267.603414:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1415 00000100:00100000:2.0:1789395267.603425:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:2396:x1876316231920384:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395267.603444:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395267.603472:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316df8a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067eb expref: 88 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.603498:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:2.0:1789395267.603504:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395267.603561:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+87:2396:x1876316231920384:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 136us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.603569:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1415 00000100:00100000:2.0:1789395267.607840:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.607913:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231920512 00000100:00100000:3.0:1789395267.607926:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231920512 00000100:00100000:3.0:1789395267.608013:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23938 00000100:00100000:3.0:1789395267.608026:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+87:22080:x1876316231920512:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395267.608054:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.608081:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316df9f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021067f9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.608125:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dfa6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.608139:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dfa6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.608151:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dfa6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.608325:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316df9f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067f9 expref: 89 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.608349:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a400/0xff35729af316dfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021067f9 expref: 88 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.608359:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:3.0:1789395267.608362:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789395267.608366:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a400, rc 0) 00000100:00100000:3.0:1789395267.610762:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:22080:x1876316231920512:12345-192.168.203.54@tcp:101:bash.0 Request processed in 2720us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.610778:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23938 00000100:00100000:1.0:1789395267.616784:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.617062:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231920640 00000100:00100000:0.0:1789395267.617075:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231920640 00002000:00100000:0.0:1789395267.617142:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x9:0x0] (0->6) req@ffff89a3cac42680 x1876316231920640/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.617156:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac42680 with x1876316231920640 ext(0->6) 00002000:00010000:0.0:1789395267.617163:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cac42680 00000100:00100000:0.0:1789395267.617203:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 68 00000100:00100000:0.0:1789395267.617218:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2396:x1876316231920640:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395267.618179:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231920640:12345-192.168.203.54@tcp:4:bash.0 Request processed in 959us (1402us total) trans 4294969994 rc 0/0 00000100:00100000:0.0:1789395267.618191:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 68 00002000:00100000:0.0:1789395267.618203:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x9:0x0] (0->6) req@ffff89a3cac42680 x1876316231920640/t4294969994(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.618213:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac42680 with x1876316231920640 ext(0->6) 00002000:00010000:0.0:1789395267.618218:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cac42680 00000100:00100000:0.0:1789395267.622214:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.622606:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231920768 00000100:00100000:2.0:1789395267.622620:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231920768 00000100:00100000:2.0:1789395267.622696:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5383 00000100:00100000:2.0:1789395267.622708:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231920768:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.624041:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969994 is committed 00000100:00100000:2.0:1789395267.624440:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:2397:x1876316231920768:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1679us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.624454:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5383 00000100:00100000:2.0:1789395267.627536:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.627773:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921024 00000100:00100000:1.0:1789395267.627786:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921024 00000100:00100000:1.0:1789395267.627857:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5250 00000100:00100000:1.0:1789395267.627869:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:22080:x1876316231921024:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:1.0:1789395267.628178:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968625 00000100:00100000:1.0:1789395267.628355:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+90:22080:x1876316231921024:12345-192.168.203.54@tcp:35:bash.0 Request processed in 487us (830us total) trans 4294968626 rc 0/0 00000100:00100000:1.0:1789395267.628364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5250 00000020:00080000:1.0:1789395267.628370:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.642237:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.642353:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921280 00000100:00100000:0.0:1789395267.642367:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921280 00000100:00100000:0.0:1789395267.642488:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23939 00000100:00100000:0.0:1789395267.642499:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+90:22080:x1876316231921280:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.642525:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.642551:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316dfad lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106800 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.642687:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316dfb4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.642702:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316dfb4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.642718:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316dfb4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395267.642730:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1aa:0x0]: returning size 0 00010000:00010000:0.0:1789395267.642851:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316dfad lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106800 expref: 93 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.642878:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316dfb4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106800 expref: 92 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.642889:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395267.642892:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395267.642896:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376800, rc 0) 00000100:00100000:0.0:1789395267.643295:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:22080:x1876316231921280:12345-192.168.203.54@tcp:101:bash.0 Request processed in 796us (1072us total) trans 4294968627 rc 0/0 00000100:00100000:0.0:1789395267.643305:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23939 00000100:00100000:2.0:1789395267.650103:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.650566:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921408 00000100:00100000:3.0:1789395267.650581:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921408 00000100:00100000:1.0:1789395267.650590:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.650664:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921536 00000100:00100000:2.0:1789395267.650669:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921536 00000100:00100000:3.0:1789395267.650671:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1416 00000100:00100000:3.0:1789395267.650683:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:2395:x1876316231921408:12345-192.168.203.54@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789395267.650701:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5384 00010000:00010000:3.0:1789395267.650706:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789395267.650707:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22080:x1876316231921536:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.650723:0:14638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395267.650735:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316dfb4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106800 expref: 92 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.650746:0:14638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316dfc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106807 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.650758:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:3.0:1789395267.650763:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1789395267.650782:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.650801:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.650805:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.650814:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316dfc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106807 expref: 15 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395267.650827:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+91:2395:x1876316231921408:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 147us (740us total) trans 0 rc 0/0 00010000:00010000:2.0:1789395267.650830:0:14638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c6eb6fc/0xff35729af316dfc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106807 expref: 15 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395267.650836:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1416 00010000:00010000:2.0:1789395267.650842:0:14638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0c00, rc 0) 00000100:00100000:2.0:1789395267.650863:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22080:x1876316231921536:12345-192.168.203.54@tcp:101:bash.0 Request processed in 156us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.650869:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5384 00000100:00100000:2.0:1789395267.656175:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.656243:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921664 00000100:00100000:0.0:1789395267.656257:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921664 00000100:00100000:0.0:1789395267.656352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23940 00000100:00100000:0.0:1789395267.656364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+91:22080:x1876316231921664:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.656422:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.656448:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316dfc9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210680e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.656493:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377400/0xff35729af316dfd0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.656514:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377400/0xff35729af316dfd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.656527:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377400/0xff35729af316dfd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.656671:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316dfc9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210680e expref: 93 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.656692:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377400/0xff35729af316dfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210680e expref: 92 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.656701:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395267.656705:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395267.656708:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377400, rc 0) 00000100:00100000:0.0:1789395267.656786:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:22080:x1876316231921664:12345-192.168.203.54@tcp:101:bash.0 Request processed in 424us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.656795:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23940 00000100:00100000:3.0:1789395267.667377:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.667727:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921792 00000100:00100000:0.0:1789395267.667742:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921792 00002000:00100000:0.0:1789395267.667804:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa:0x0] (0->6) req@ffff89a501db0700 x1876316231921792/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.667817:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0700 with x1876316231921792 ext(0->6) 00002000:00010000:0.0:1789395267.667823:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db0700 00000100:00100000:0.0:1789395267.667877:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 69 00000100:00100000:0.0:1789395267.667889:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231921792:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395267.669210:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231921792:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1312us (1837us total) trans 4294969962 rc 0/0 00000100:00100000:3.0:1789395267.669224:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 69 00002000:00100000:3.0:1789395267.669235:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa:0x0] (0->6) req@ffff89a501db0700 x1876316231921792/t4294969962(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.669245:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0700 with x1876316231921792 ext(0->6) 00002000:00010000:3.0:1789395267.669251:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db0700 00000100:00100000:1.0:1789395267.673118:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.673224:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231921920 00000100:00100000:0.0:1789395267.673237:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231921920 00000100:00100000:0.0:1789395267.673436:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5385 00000100:00100000:0.0:1789395267.673448:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231921920:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.674847:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969962 is committed 00000100:00100000:0.0:1789395267.675071:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231921920:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1619us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.675083:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5385 00000100:00100000:2.0:1789395267.678248:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.678604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231922176 00000100:00100000:3.0:1789395267.678617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231922176 00000100:00100000:3.0:1789395267.678690:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5251 00000100:00100000:3.0:1789395267.678702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:22080:x1876316231922176:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:3.0:1789395267.678993:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968628 00000100:00100000:3.0:1789395267.679134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+94:22080:x1876316231922176:12345-192.168.203.54@tcp:35:bash.0 Request processed in 434us (900us total) trans 4294968629 rc 0/0 00000100:00100000:3.0:1789395267.679144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5251 00000020:00080000:3.0:1789395267.679150:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395267.682788:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.682901:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231922432 00000100:00100000:2.0:1789395267.682912:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231922432 00000100:00100000:2.0:1789395267.682993:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23941 00000100:00100000:2.0:1789395267.683005:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+94:22080:x1876316231922432:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.683030:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.683057:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316dfd7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106815 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.683231:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316dfde lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.683251:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316dfde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.683263:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316dfde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395267.683277:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ab:0x0]: returning size 0 00010000:00010000:2.0:1789395267.683479:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316dfd7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106815 expref: 97 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.683510:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316dfde lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106815 expref: 96 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.683520:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:2.0:1789395267.683523:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395267.683526:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:2.0:1789395267.683598:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22080:x1876316231922432:12345-192.168.203.54@tcp:101:bash.0 Request processed in 595us (823us total) trans 4294968630 rc 0/0 00000100:00100000:2.0:1789395267.683606:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23941 00000100:00100000:3.0:1789395267.692005:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.692113:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231922560 00000100:00100000:0.0:1789395267.692125:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231922560 00000100:00100000:0.0:1789395267.692195:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5386 00000100:00100000:0.0:1789395267.692207:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+14:22080:x1876316231922560:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.692229:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.692254:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b439907c/0xff35729af316dfec lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210681c expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395267.692285:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395267.692323:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789395267.692329:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395267.692338:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b439907c/0xff35729af316dfec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210681c expref: 15 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.692356:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b439907c/0xff35729af316dfec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210681c expref: 15 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.692370:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376200, rc 0) 00000100:00100000:0.0:1789395267.692480:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22080:x1876316231922560:12345-192.168.203.54@tcp:101:bash.0 Request processed in 274us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.692488:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5386 00000100:00100000:1.0:1789395267.696970:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.697011:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.697115:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231922688 00000100:00100000:0.0:1789395267.697126:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231922688 00000100:00100000:0.0:1789395267.697197:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1417 00000100:00100000:0.0:1789395267.697207:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:2396:x1876316231922688:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395267.697225:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395267.697254:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316dfde lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106815 expref: 96 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.697276:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:0.0:1789395267.697282:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395267.697348:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+95:2396:x1876316231922688:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 142us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.697356:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1417 00000100:00100000:2.0:1789395267.698000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231922816 00000100:00100000:2.0:1789395267.698007:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231922816 00000100:00100000:2.0:1789395267.698052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23942 00000100:00100000:2.0:1789395267.698059:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+95:22080:x1876316231922816:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.698081:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.698099:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316dff3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106823 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.698139:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316dffa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.698153:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316dffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.698164:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316dffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.698293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316dff3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106823 expref: 97 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.698310:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1c00/0xff35729af316dffa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106823 expref: 96 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.698318:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:2.0:1789395267.698321:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395267.698324:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1c00, rc 0) 00000100:00100000:2.0:1789395267.698371:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22080:x1876316231922816:12345-192.168.203.54@tcp:101:bash.0 Request processed in 312us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.698377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23942 00000100:00100000:1.0:1789395267.705489:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.705673:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231922944 00000100:00100000:2.0:1789395267.705686:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231922944 00002000:00100000:2.0:1789395267.705751:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (0->6) req@ffff89a3cac40380 x1876316231922944/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.705764:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac40380 with x1876316231922944 ext(0->6) 00002000:00010000:2.0:1789395267.705771:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cac40380 00000100:00100000:2.0:1789395267.705810:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 70 00000100:00100000:2.0:1789395267.705822:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2395:x1876316231922944:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:2.0:1789395267.707451:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231922944:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1618us (1963us total) trans 4294969995 rc 0/0 00000100:00100000:2.0:1789395267.707465:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 70 00002000:00100000:2.0:1789395267.707479:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (0->6) req@ffff89a3cac40380 x1876316231922944/t4294969995(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.707489:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cac40380 with x1876316231922944 ext(0->6) 00002000:00010000:2.0:1789395267.707496:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cac40380 00000100:00100000:3.0:1789395267.711212:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.711696:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231923072 00000100:00100000:2.0:1789395267.711711:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231923072 00000100:00100000:2.0:1789395267.711790:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5387 00000100:00100000:2.0:1789395267.711802:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231923072:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395267.714922:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969995 is committed 00000100:00100000:0.0:1789395267.715247:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:2396:x1876316231923072:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3439us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.715261:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5387 00000100:00100000:1.0:1789395267.718583:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.718714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231923328 00000100:00100000:2.0:1789395267.718726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231923328 00000100:00100000:2.0:1789395267.718841:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5252 00000100:00100000:2.0:1789395267.718853:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22080:x1876316231923328:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.719143:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968631 00000100:00100000:2.0:1789395267.719327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+98:22080:x1876316231923328:12345-192.168.203.54@tcp:35:bash.0 Request processed in 475us (757us total) trans 4294968632 rc 0/0 00000100:00100000:2.0:1789395267.719336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5252 00000020:00080000:2.0:1789395267.719341:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.725335:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.725555:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231923584 00000100:00100000:2.0:1789395267.725569:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231923584 00000100:00100000:2.0:1789395267.725648:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23943 00000100:00100000:2.0:1789395267.725660:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+98:22080:x1876316231923584:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.725689:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.725716:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e001 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210682a expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.725872:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e008 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.725889:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e008 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.725901:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e008 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395267.725914:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ac:0x0]: returning size 0 00010000:00010000:2.0:1789395267.726052:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e001 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210682a expref: 101 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.726079:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e008 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210682a expref: 100 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.726088:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395267.726091:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395267.726095:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0400, rc 0) 00000100:00100000:2.0:1789395267.726225:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cac42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:22080:x1876316231923584:12345-192.168.203.54@tcp:101:bash.0 Request processed in 566us (904us total) trans 4294968633 rc 0/0 00000100:00100000:2.0:1789395267.726232:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23943 00000100:00100000:0.0:1789395267.732943:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.733773:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.734105:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231923840 00000100:00100000:0.0:1789395267.734118:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231923840 00000100:00100000:0.0:1789395267.734189:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5388 00000100:00100000:0.0:1789395267.734202:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22080:x1876316231923840:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395267.734223:0:14652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395267.734250:0:14652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000589332de/0xff35729af316e016 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106831 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395267.734285:0:14652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395267.734322:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1789395267.734328:0:14652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395267.734337:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000589332de/0xff35729af316e016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106831 expref: 16 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.734354:0:14652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000589332de/0xff35729af316e016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106831 expref: 16 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.734368:0:14652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376e00, rc 0) 00000100:00100000:0.0:1789395267.734473:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22080:x1876316231923840:12345-192.168.203.54@tcp:101:bash.0 Request processed in 274us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.734481:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5388 00000100:00100000:2.0:1789395267.735983:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231923712 00000100:00100000:2.0:1789395267.736000:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231923712 00000100:00100000:2.0:1789395267.736065:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1418 00000100:00100000:2.0:1789395267.736074:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4df88b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:2396:x1876316231923712:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395267.736090:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395267.736116:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e008 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210682a expref: 100 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.736138:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395267.736143:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395267.736206:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4df88b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+99:2396:x1876316231923712:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 133us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.736213:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1418 00000100:00100000:1.0:1789395267.740441:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.740640:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231923968 00000100:00100000:2.0:1789395267.740653:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231923968 00000100:00100000:2.0:1789395267.740727:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23944 00000100:00100000:2.0:1789395267.740740:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+99:22080:x1876316231923968:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.740769:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.740794:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e01d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106838 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.740836:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316e024 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.740863:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316e024 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.740876:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316e024 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.741041:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e01d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106838 expref: 101 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.741063:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1e00/0xff35729af316e024 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106838 expref: 100 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.741072:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395267.741075:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395267.741079:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1e00, rc 0) 00000100:00100000:2.0:1789395267.741155:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:22080:x1876316231923968:12345-192.168.203.54@tcp:101:bash.0 Request processed in 418us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.741162:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23944 00000100:00100000:3.0:1789395267.746141:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.746725:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231924096 00000100:00100000:1.0:1789395267.746740:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231924096 00002000:00100000:1.0:1789395267.746806:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (0->6) req@ffff89a501db2d80 x1876316231924096/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395267.746819:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2d80 with x1876316231924096 ext(0->6) 00002000:00010000:1.0:1789395267.746826:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db2d80 00000100:00100000:1.0:1789395267.746869:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 71 00000100:00100000:1.0:1789395267.746879:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231924096:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:0.0:1789395267.749848:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231924096:12345-192.168.203.54@tcp:4:bash.0 Request processed in 2956us (3707us total) trans 4294969963 rc 0/0 00000100:00100000:0.0:1789395267.749864:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 71 00002000:00100000:0.0:1789395267.749879:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (0->6) req@ffff89a501db2d80 x1876316231924096/t4294969963(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.749891:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2d80 with x1876316231924096 ext(0->6) 00002000:00010000:0.0:1789395267.749897:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db2d80 00000100:00100000:1.0:1789395267.753847:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.753955:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231924224 00000100:00100000:2.0:1789395267.753968:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231924224 00000100:00100000:2.0:1789395267.754075:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5389 00000100:00100000:2.0:1789395267.754088:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231924224:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:0.0:1789395267.755373:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969963 is committed 00000100:00100000:2.0:1789395267.755713:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231924224:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1622us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.755724:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5389 00000100:00100000:1.0:1789395267.758724:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.758830:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231924480 00000100:00100000:2.0:1789395267.758844:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231924480 00000100:00100000:2.0:1789395267.758915:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5253 00000100:00100000:2.0:1789395267.758927:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:22080:x1876316231924480:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.759214:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968634 00000100:00100000:2.0:1789395267.759349:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+102:22080:x1876316231924480:12345-192.168.203.54@tcp:35:bash.0 Request processed in 422us (638us total) trans 4294968635 rc 0/0 00000100:00100000:2.0:1789395267.759359:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5253 00000020:00080000:2.0:1789395267.759365:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395267.761799:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239803136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789395267.761898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395267.762090:0:11908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239803136 00000100:00100000:0.0:1789395267.762102:0:11908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239803136 00000100:00100000:0.0:1789395267.762172:0:11908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633 00000100:00100000:0.0:1789395267.762183:0:11908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239803136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789395267.762225:0:11908:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1298812928 00000100:00100000:0.0:1789395267.762285:0:11908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239803136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.762292:0:11908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633 00000100:00100000:3.0:1789395267.762538:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239803136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789395267.762789:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c93e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239803264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789395267.762829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395267.762871:0:22469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239803264 00000100:00100000:2.0:1789395267.762875:0:22469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239803264 00000100:00100000:2.0:1789395267.762908:0:22469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789395267.762914:0:22469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239803264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789395267.762929:0:22469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 257775296 pending 0 free 3923488768 avail 3691708416 00000100:00100000:2.0:1789395267.762975:0:22469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239803264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.762982:0:22469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789395267.763017:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c93e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239803264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395267.763095:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395267.763103:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239803392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789395267.763132:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395267.763160:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239803392 00000100:00100000:1.0:1789395267.763163:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239803392 00000100:00100000:1.0:1789395267.763192:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789395267.763198:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239803392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789395267.763210:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 159979200 pending 0 free 3923525632 avail 3691716608 00000100:00100000:1.0:1789395267.763241:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239803392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.763247:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789395267.763277:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239803392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395267.763369:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395267.763377:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c9a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239803520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789395267.763432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395267.763687:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789395267.763696:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3ca141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239803648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395267.763725:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395267.763795:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239803520 00000100:00100000:0.0:1789395267.763799:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239803520 00000100:00100000:0.0:1789395267.763832:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239803648 00000100:00100000:0.0:1789395267.763834:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239803648 00000100:00100000:0.0:1789395267.763849:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789395267.763856:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239803520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789395267.763867:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 257775296 pending 0 free 3923488768 avail 3691708416 00000100:00100000:0.0:1789395267.763897:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876316239803520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.763904:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789395267.763918:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789395267.763923:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239803648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789395267.763945:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 159979200 pending 0 free 3923525632 avail 3691716608 00000100:00100000:0.0:1789395267.763970:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876316239803648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.763976:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789395267.764046:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3ca141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1876316239803648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789395267.765470:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c9a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239803520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789395267.766210:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.766302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231924736 00000100:00100000:3.0:1789395267.766323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231924736 00000100:00100000:3.0:1789395267.766515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23945 00000100:00100000:2.0:1789395267.766695:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+102:22080:x1876316231924736:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.766720:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.766750:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e02b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210683f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.766896:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e032 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.766912:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e032 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.766926:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e032 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395267.766951:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ad:0x0]: returning size 0 00010000:00010000:2.0:1789395267.767081:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e02b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210683f expref: 105 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.767109:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e032 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210683f expref: 104 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.767118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395267.767122:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395267.767125:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0200, rc 0) 00000100:00100000:2.0:1789395267.767238:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c93e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22080:x1876316231924736:12345-192.168.203.54@tcp:101:bash.0 Request processed in 713us (1032us total) trans 4294968636 rc 0/0 00000100:00100000:2.0:1789395267.767246:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23945 00000100:00100000:1.0:1789395267.772995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.773139:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.773801:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231924864 00000100:00100000:2.0:1789395267.773815:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231924864 00000100:00100000:2.0:1789395267.774025:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5390 00000100:00100000:2.0:1789395267.774038:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+15:22080:x1876316231924864:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.774061:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.774091:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316e040 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106846 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.774123:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.774150:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.774155:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.774165:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316e040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106846 expref: 16 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.774187:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fac5ee4f/0xff35729af316e040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106846 expref: 16 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.774202:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0e00, rc 0) 00000100:00100000:2.0:1789395267.774280:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22080:x1876316231924864:12345-192.168.203.54@tcp:101:bash.0 Request processed in 245us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.774288:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5390 00000100:00100000:3.0:1789395267.774709:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231924992 00000100:00100000:3.0:1789395267.774717:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231924992 00000100:00100000:3.0:1789395267.774774:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1419 00000100:00100000:3.0:1789395267.774782:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:2395:x1876316231924992:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395267.774794:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395267.774817:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e032 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210683f expref: 104 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395267.774841:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:3.0:1789395267.774856:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395267.774890:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+103:2395:x1876316231924992:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 110us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.774897:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1419 00000100:00100000:1.0:1789395267.779520:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.779674:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231925120 00000100:00100000:2.0:1789395267.779687:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231925120 00000100:00100000:2.0:1789395267.779746:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23946 00000100:00100000:2.0:1789395267.779756:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+103:22080:x1876316231925120:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395267.779782:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.779805:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e047 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210684d expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.779845:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e04e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.779860:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e04e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.779871:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e04e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.780021:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e047 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210684d expref: 105 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.780042:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0000/0xff35729af316e04e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210684d expref: 104 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.780051:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395267.780055:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395267.780058:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0000, rc 0) 00000100:00100000:2.0:1789395267.780135:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22080:x1876316231925120:12345-192.168.203.54@tcp:101:bash.0 Request processed in 380us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.780142:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23946 00000100:00100000:0.0:1789395267.786114:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.786210:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231925248 00000100:00100000:3.0:1789395267.786222:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231925248 00002000:00100000:3.0:1789395267.786283:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->6) req@ffff89a3ca140a80 x1876316231925248/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.786294:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca140a80 with x1876316231925248 ext(0->6) 00002000:00010000:3.0:1789395267.786301:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca140a80 00000100:00100000:3.0:1789395267.786344:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 72 00000100:00100000:3.0:1789395267.786354:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231925248:12345-192.168.203.54@tcp:4:bash.0 00000100:00100000:3.0:1789395267.788033:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231925248:12345-192.168.203.54@tcp:4:bash.0 Request processed in 1667us (1919us total) trans 4294969996 rc 0/0 00000100:00100000:3.0:1789395267.788048:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 72 00002000:00100000:3.0:1789395267.788061:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->6) req@ffff89a3ca140a80 x1876316231925248/t4294969996(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 496/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395267.788071:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca140a80 with x1876316231925248 ext(0->6) 00002000:00010000:3.0:1789395267.788076:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3ca140a80 00000100:00100000:1.0:1789395267.791663:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.791776:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231925376 00000100:00100000:0.0:1789395267.791789:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231925376 00000100:00100000:0.0:1789395267.791865:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5391 00000100:00100000:0.0:1789395267.791877:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231925376:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395267.793603:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969996 is committed 00000100:00100000:0.0:1789395267.793820:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231925376:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1939us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.793834:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5391 00000100:00100000:1.0:1789395267.797156:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.797272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231925632 00000100:00100000:2.0:1789395267.797285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231925632 00000100:00100000:2.0:1789395267.797367:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5254 00000100:00100000:2.0:1789395267.797378:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22080:x1876316231925632:12345-192.168.203.54@tcp:35:bash.0 00000001:00080000:2.0:1789395267.797697:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968637 00000100:00100000:2.0:1789395267.797822:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+106:22080:x1876316231925632:12345-192.168.203.54@tcp:35:bash.0 Request processed in 445us (680us total) trans 4294968638 rc 0/0 00000100:00100000:2.0:1789395267.797831:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5254 00000020:00080000:2.0:1789395267.797836:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395267.878280:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.878454:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231925888 00000100:00100000:2.0:1789395267.878467:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231925888 00000100:00100000:2.0:1789395267.878544:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23947 00000100:00100000:2.0:1789395267.878556:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+106:22250:x1876316231925888:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395267.878585:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.878614:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e055 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106854 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.878761:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.878777:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.878789:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.878854:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.878863:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.878869:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789395267.879321:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc:0x0], index 1: 0 00010000:00010000:2.0:1789395267.879563:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879573:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879581:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879620:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879638:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879645:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879652:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879658:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395267.879663:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879671:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879684:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3ca366300) 00010000:00010000:2.0:1789395267.879687:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395267.879692:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879699:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e05c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789395267.879714:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095d00834 reply state 000000004fbf4a6e transno 4294968639 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879725:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879731:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3ca366900) 00010000:00010000:2.0:1789395267.879734:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395267.879736:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789395267.879772:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0400/0xff35729af316e055 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 109 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879791:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 108 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.879799:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395267.879801:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395267.879804:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1400, rc 0) 00000100:00100000:2.0:1789395267.879891:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+109:22250:x1876316231925888:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1336us (1626us total) trans 4294968639 rc 0/0 00000100:00100000:2.0:1789395267.879901:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23947 00000100:00100000:1.0:1789395267.890768:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.891231:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231926016 00000100:00100000:2.0:1789395267.891245:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231926016 00000100:00100000:2.0:1789395267.891491:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5392 00000100:00100000:2.0:1789395267.891504:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22250:x1876316231926016:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395267.891528:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.891556:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316e078 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210685b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789395267.891585:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789395267.891611:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1789395267.891617:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789395267.891627:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316e078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210685b expref: 17 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.891650:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3adb4b5/0xff35729af316e078 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210685b expref: 17 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.891664:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0400, rc 0) 00000100:00100000:2.0:1789395267.891733:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22250:x1876316231926016:12345-192.168.203.54@tcp:101:dd.0 Request processed in 232us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.891740:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5392 00000100:00100000:1.0:1789395267.898209:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.898451:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231926144 00000100:00100000:2.0:1789395267.898465:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231926144 00002000:00100000:2.0:1789395267.898528:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c9a6f480 x1876316231926144/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 8680/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.898539:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6f480 with x1876316231926144 ext(0->8191) 00002000:00010000:2.0:1789395267.898546:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6f480 00000100:00100000:2.0:1789395267.898588:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 73 00000100:00100000:2.0:1789395267.898599:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231926144:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395267.900741:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231926144:12345-192.168.203.54@tcp:4:dd.0 Request processed in 2132us (2535us total) trans 4294969964 rc 0/0 00000100:00100000:2.0:1789395267.900757:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 73 00002000:00100000:2.0:1789395267.900770:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c9a6f480 x1876316231926144/t4294969964(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 8680/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395267.900782:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6f480 with x1876316231926144 ext(0->8191) 00002000:00010000:2.0:1789395267.900788:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6f480 00000100:00100000:0.0:1789395267.904751:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.904841:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231926272 00000100:00100000:1.0:1789395267.904854:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231926272 00000100:00100000:1.0:1789395267.904996:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23948 00000100:00100000:1.0:1789395267.905008:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+109:22250:x1876316231926272:12345-192.168.203.54@tcp:44:dd.0 00000001:00080000:0.0:1789395267.907170:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968639 is committed 00010000:00010000:1.0:1789395267.907488:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.907503:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.907516:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.907522:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395267.907528:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.907536:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.907554:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3ca366900) 00010000:00010000:1.0:1789395267.907557:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395267.907562:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395267.907569:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e063 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395267.907841:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:22250:x1876316231926272:12345-192.168.203.54@tcp:44:dd.0 Request processed in 2826us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395267.907859:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23948 00000100:00100000:1.0:1789395267.911832:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.911916:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231926400 00000100:00100000:0.0:1789395267.911928:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231926400 00000100:00100000:0.0:1789395267.912191:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5393 00000100:00100000:0.0:1789395267.912205:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231926400:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395267.914034:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969964 is committed 00000100:00100000:0.0:1789395267.914303:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231926400:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2094us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.914325:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5393 00000100:00100000:3.0:1789395267.917735:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.918122:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231926656 00000100:00100000:2.0:1789395267.918136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231926656 00000100:00100000:2.0:1789395267.918208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5255 00000100:00100000:2.0:1789395267.918220:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+47:22250:x1876316231926656:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395267.918772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:22250:x1876316231926656:12345-192.168.203.54@tcp:35:dd.0 Request processed in 552us (1049us total) trans 4294968640 rc 0/0 00000100:00100000:2.0:1789395267.918781:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5255 00000100:00100000:1.0:1789395267.931574:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.931702:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231926912 00000100:00100000:2.0:1789395267.931715:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231926912 00000100:00100000:2.0:1789395267.931829:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23949 00000100:00100000:2.0:1789395267.931841:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+48:22251:x1876316231926912:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395267.931879:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.931906:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e07f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106862 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.932064:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.932080:0:21735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 49 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.932091:0:21735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.932135:0:21735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 49 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.932150:0:21735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 49 pid: 7813 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395267.932331:0:21735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21735:1876316239803776:192.168.203.54@tcp:104: 00000100:00100000:2.0:1789395267.932593:0:21735:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3ca3563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395267.936783:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.936874:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231927040 00000100:00100000:0.0:1789395267.936886:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231927040 00010000:00010000:0.0:1789395267.936947:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 50 pid: 7813 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395267.936997:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1605 00000100:00100000:0.0:1789395267.937008:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+50:2396:x1876316231927040:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395267.937027:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395267.937034:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 50 pid: 7813 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.937049:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 50 pid: 7813 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.937077:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395267.937083:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.937093:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.937102:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395267.937124:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395267.937603:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+50:2396:x1876316231927040:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 595us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395267.937614:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1605 00010000:00010000:2.0:1789395267.937774:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e06a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106854 expref: 49 pid: 7813 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395267.937796:0:21735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21735:1876316239803776:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395267.937825:0:21735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.937834:0:21735:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.937840:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395267.937908:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395267.938150:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e07f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 50 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.938636:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 49 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.938646:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395267.938650:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789395267.938653:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:2.0:1789395267.938718:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+49:22251:x1876316231926912:12345-192.168.203.54@tcp:101:dd.0 Request processed in 6878us (7157us total) trans 4294968641 rc 0/0 00000100:00100000:2.0:1789395267.938728:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23949 00000100:00100000:0.0:1789395267.943353:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.945715:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231927168 00000100:00100000:2.0:1789395267.945877:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231927168 00000100:00100000:2.0:1789395267.946080:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23950 00000100:00100000:2.0:1789395267.946096:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+49:22251:x1876316231927168:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395267.946127:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.946153:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316e094 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106869 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.946226:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316e094 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106869 expref: 50 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.946243:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1200/0xff35729af316e094 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106869 expref: 50 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.946265:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395267.946268:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789395267.946272:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1200, rc 0) 00000100:00100000:2.0:1789395267.946498:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+50:22251:x1876316231927168:12345-192.168.203.54@tcp:101:dd.0 Request processed in 405us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.946507:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23950 00000100:00100000:1.0:1789395267.953086:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395267.953768:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231927296 00000100:00100000:2.0:1789395267.953783:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231927296 00000100:00100000:2.0:1789395267.953914:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23951 00000100:00100000:2.0:1789395267.953926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+50:22251:x1876316231927296:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395267.953959:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.953985:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e09b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106870 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.954026:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e0a2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.954041:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.954058:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.954202:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e09b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106870 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.954222:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1400/0xff35729af316e0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106870 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.954231:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395267.954234:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789395267.954237:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1400, rc 0) 00000100:00100000:2.0:1789395267.954321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+51:22251:x1876316231927296:12345-192.168.203.54@tcp:101:dd.0 Request processed in 397us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395267.954328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23951 00000100:00100000:1.0:1789395267.962279:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395267.962586:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231927424 00000100:00100000:0.0:1789395267.962599:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231927424 00002000:00100000:0.0:1789395267.962667:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15dc00 x1876316231927424/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 8680/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.962680:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15dc00 with x1876316231927424 ext(0->8191) 00002000:00010000:0.0:1789395267.962687:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15dc00 00000100:00100000:0.0:1789395267.962757:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 74 00000100:00100000:0.0:1789395267.962768:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231927424:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395267.963674:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231927424:12345-192.168.203.54@tcp:4:dd.0 Request processed in 903us (1406us total) trans 4294969965 rc 0/0 00000100:00100000:0.0:1789395267.963684:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 74 00002000:00100000:0.0:1789395267.963694:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15dc00 x1876316231927424/t4294969965(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 8680/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395267.963703:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15dc00 with x1876316231927424 ext(0->8191) 00002000:00010000:0.0:1789395267.963707:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15dc00 00000100:00100000:0.0:1789395267.968065:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.968143:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231927552 00000100:00100000:1.0:1789395267.968157:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231927552 00000100:00100000:1.0:1789395267.968260:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5394 00000100:00100000:1.0:1789395267.968272:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231927552:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395267.969601:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969965 is committed 00000100:00100000:1.0:1789395267.969815:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231927552:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1540us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395267.969828:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5394 00000100:00100000:1.0:1789395267.982797:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395267.984474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231927808 00000100:00100000:3.0:1789395267.984493:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231927808 00000100:00100000:2.0:1789395267.984714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23952 00000100:00100000:2.0:1789395267.984726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+51:22252:x1876316231927808:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395267.984749:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395267.984776:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e0a9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106877 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.984945:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.984961:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.984972:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.984988:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.984995:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985001:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985069:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e0be lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985079:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e0be lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985087:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e0be lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395267.985099:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395267.985194:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985217:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985224:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985230:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985237:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395267.985243:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985251:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985265:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3ca366000) 00010000:00010000:2.0:1789395267.985268:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395267.985273:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985280:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e0b0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985297:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985304:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985319:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985325:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395267.985328:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985334:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985340:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3ca366900) 00010000:00010000:2.0:1789395267.985342:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395267.985345:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985351:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e0b7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985457:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e0a9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106877 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985475:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0200/0xff35729af316e0be lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106877 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395267.985483:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395267.985486:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395267.985488:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0200, rc 0) 00000100:00100000:2.0:1789395267.985568:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+53:22252:x1876316231927808:12345-192.168.203.54@tcp:101:dd.0 Request processed in 843us (2783us total) trans 4294968642 rc 0/0 00000100:00100000:2.0:1789395267.985575:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23952 00000100:00100000:3.0:1789395267.989555:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395267.989659:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231928064 00000100:00100000:1.0:1789395267.989672:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231928064 00000100:00100000:1.0:1789395267.989743:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5256 00000100:00100000:1.0:1789395267.989754:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+53:22252:x1876316231928064:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395267.990085:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22252:x1876316231928064:12345-192.168.203.54@tcp:35:dd.0 Request processed in 331us (543us total) trans 4294968643 rc 0/0 00000100:00100000:1.0:1789395267.990093:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5256 00000100:00100000:3.0:1789395267.999761:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.000003:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231928192 00000100:00100000:0.0:1789395268.000016:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231928192 00002000:00100000:0.0:1789395268.000085:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a4fedf7b80 x1876316231928192/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 8680/0 e 0 to 0 dl 1789395278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.000097:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7b80 with x1876316231928192 ext(0->8191) 00002000:00010000:0.0:1789395268.000105:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7b80 00000100:00100000:0.0:1789395268.000342:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 75 00000100:00100000:0.0:1789395268.000355:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231928192:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395268.001987:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231928192:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1624us (2229us total) trans 4294969966 rc 0/0 00000100:00100000:0.0:1789395268.002002:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 75 00002000:00100000:0.0:1789395268.002017:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a4fedf7b80 x1876316231928192/t4294969966(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:733/0 lens 8680/448 e 0 to 0 dl 1789395278 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.002027:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7b80 with x1876316231928192 ext(0->8191) 00002000:00010000:0.0:1789395268.002033:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7b80 00000100:00100000:1.0:1789395268.006248:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.006541:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231928320 00000100:00100000:2.0:1789395268.006554:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231928320 00000100:00100000:2.0:1789395268.006623:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5395 00000100:00100000:2.0:1789395268.006635:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231928320:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395268.008228:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969966 is committed 00000100:00100000:2.0:1789395268.008647:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231928320:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2007us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.008661:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5395 00000100:00100000:3.0:1789395268.022564:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.022695:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231928576 00000100:00100000:1.0:1789395268.022709:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231928576 00000100:00100000:1.0:1789395268.022791:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23953 00000100:00100000:1.0:1789395268.022803:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22253:x1876316231928576:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395268.022834:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395268.022876:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e0cc lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210687e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023046:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023062:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023076:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023096:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023104:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023112:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023181:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e0e1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023192:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023200:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395268.023211:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1789395268.023304:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023312:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023319:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023326:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023332:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395268.023339:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023347:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023360:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3ca5d9500) 00010000:00010000:1.0:1789395268.023363:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395268.023368:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023375:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e0d3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023450:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023458:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023464:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023470:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395268.023473:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023480:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023488:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3ca5d9200) 00010000:00010000:1.0:1789395268.023491:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395268.023495:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023501:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e0da lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023553:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e0cc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210687e expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023571:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210687e expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.023580:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395268.023583:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395268.023586:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215a00, rc 0) 00000100:00100000:1.0:1789395268.023674:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22253:x1876316231928576:12345-192.168.203.54@tcp:101:dd.0 Request processed in 873us (1124us total) trans 4294968644 rc 0/0 00000100:00100000:1.0:1789395268.023683:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23953 00000100:00100000:3.0:1789395268.028440:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.028558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231928832 00000100:00100000:2.0:1789395268.028571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231928832 00000100:00100000:2.0:1789395268.028638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5257 00000100:00100000:2.0:1789395268.028650:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22253:x1876316231928832:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395268.028944:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+57:22253:x1876316231928832:12345-192.168.203.54@tcp:35:dd.0 Request processed in 296us (570us total) trans 4294968645 rc 0/0 00000100:00100000:2.0:1789395268.028953:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5257 00000100:00100000:3.0:1789395268.035143:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.035319:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231928960 00000100:00100000:1.0:1789395268.035332:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231928960 00002000:00100000:1.0:1789395268.035422:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a4fedf7100 x1876316231928960/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.035434:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7100 with x1876316231928960 ext(0->8191) 00002000:00010000:1.0:1789395268.035441:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7100 00000100:00100000:1.0:1789395268.035471:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 76 00000100:00100000:1.0:1789395268.035480:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231928960:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395268.036873:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.037146:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231928960:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1664us (2013us total) trans 4294969967 rc 0/0 00000100:00100000:1.0:1789395268.037163:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 76 00002000:00100000:1.0:1789395268.037176:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a4fedf7100 x1876316231928960/t4294969967(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.037187:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7100 with x1876316231928960 ext(0->8191) 00002000:00010000:1.0:1789395268.037193:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7100 00000100:00100000:2.0:1789395268.037272:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231929088 00000100:00100000:2.0:1789395268.037281:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231929088 00000100:00100000:2.0:1789395268.037338:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1420 00000100:00100000:2.0:1789395268.037346:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+57:2396:x1876316231929088:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.037360:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.037420:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e0e1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210687e expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.037443:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.037448:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.037467:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:2396:x1876316231929088:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 123us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.037475:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1420 00000100:00100000:3.0:1789395268.046784:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.047202:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231929216 00000100:00100000:2.0:1789395268.047216:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231929216 00000100:00100000:2.0:1789395268.047350:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5396 00000100:00100000:2.0:1789395268.047363:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231929216:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395268.048898:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969967 is committed 00000100:00100000:2.0:1789395268.049109:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231929216:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1742us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.049121:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5396 00000100:00100000:3.0:1789395268.061611:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.061758:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231929472 00000100:00100000:0.0:1789395268.061770:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231929472 00000100:00100000:0.0:1789395268.061835:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23954 00000100:00100000:0.0:1789395268.061858:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22254:x1876316231929472:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395268.061891:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395268.061919:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e0ef lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106885 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062069:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062085:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062097:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062111:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062118:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062126:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062200:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e104 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062210:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e104 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062218:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e104 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395268.062230:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1789395268.062324:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062333:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062339:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062347:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062353:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.062358:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062366:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062378:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041000) 00010000:00010000:0.0:1789395268.062382:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.062552:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062561:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e0f6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062578:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062584:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062594:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062600:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.062603:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062609:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062618:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4cb041200) 00010000:00010000:0.0:1789395268.062620:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.062624:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062630:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e0fd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062689:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e0ef lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106885 expref: 59 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062709:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e104 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106885 expref: 58 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.062717:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.062719:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395268.062722:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377c00, rc 0) 00000100:00100000:0.0:1789395268.062809:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22254:x1876316231929472:12345-192.168.203.54@tcp:101:dd.0 Request processed in 964us (1212us total) trans 4294968646 rc 0/0 00000100:00100000:0.0:1789395268.062821:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23954 00000100:00100000:3.0:1789395268.068088:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.068193:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231929728 00000100:00100000:1.0:1789395268.068206:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231929728 00000100:00100000:1.0:1789395268.068277:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5258 00000100:00100000:1.0:1789395268.068289:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22254:x1876316231929728:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395268.068624:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:22254:x1876316231929728:12345-192.168.203.54@tcp:35:dd.0 Request processed in 335us (549us total) trans 4294968647 rc 0/0 00000100:00100000:1.0:1789395268.068632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5258 00000100:00100000:3.0:1789395268.075920:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.075987:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.076103:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231929856 00000100:00100000:2.0:1789395268.076116:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231929856 00000100:00100000:2.0:1789395268.076197:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1421 00000100:00100000:2.0:1789395268.076209:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:2398:x1876316231929856:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.076232:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.076261:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e104 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106885 expref: 59 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.076285:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.076289:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.076360:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:2398:x1876316231929856:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 153us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.076368:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1421 00000100:00100000:1.0:1789395268.077244:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231929984 00000100:00100000:1.0:1789395268.077254:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231929984 00002000:00100000:1.0:1789395268.077303:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c825b100 x1876316231929984/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.077323:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825b100 with x1876316231929984 ext(0->8191) 00002000:00010000:1.0:1789395268.077329:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c825b100 00000100:00100000:1.0:1789395268.077361:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 77 00000100:00100000:1.0:1789395268.077370:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231929984:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.078760:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231929984:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1382us (2763us total) trans 4294969968 rc 0/0 00000100:00100000:1.0:1789395268.078774:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 77 00002000:00100000:1.0:1789395268.078788:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c825b100 x1876316231929984/t4294969968(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.078798:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825b100 with x1876316231929984 ext(0->8191) 00002000:00010000:1.0:1789395268.078804:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c825b100 00000100:00100000:3.0:1789395268.084363:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.084565:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231930112 00000100:00100000:0.0:1789395268.084580:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231930112 00000100:00100000:0.0:1789395268.084640:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5397 00000100:00100000:0.0:1789395268.084652:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231930112:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:2.0:1789395268.086743:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969968 is committed 00000100:00100000:0.0:1789395268.087045:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231930112:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2388us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.087060:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5397 00000100:00100000:3.0:1789395268.095675:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.095871:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231930368 00000100:00100000:0.0:1789395268.095884:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231930368 00000100:00100000:0.0:1789395268.095969:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23955 00000100:00100000:0.0:1789395268.095981:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22255:x1876316231930368:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395268.096010:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395268.096038:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e112 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210688c expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096187:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096202:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096215:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096229:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096242:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096248:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096321:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e127 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096331:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e127 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096339:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e127 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395268.096350:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1789395268.096501:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096509:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096517:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096524:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.096529:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096537:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096556:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041000) 00010000:00010000:0.0:1789395268.096560:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.096564:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096571:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e119 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096589:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096596:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096602:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096607:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.096610:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096617:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096623:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4cb041200) 00010000:00010000:0.0:1789395268.096626:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.096629:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096635:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e120 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096689:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e112 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210688c expref: 61 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096706:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e127 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210688c expref: 60 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.096714:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.096717:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395268.096719:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377800, rc 0) 00000100:00100000:0.0:1789395268.096803:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:22255:x1876316231930368:12345-192.168.203.54@tcp:101:dd.0 Request processed in 824us (1142us total) trans 4294968648 rc 0/0 00000100:00100000:0.0:1789395268.096812:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23955 00000100:00100000:3.0:1789395268.106914:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.106997:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.107118:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231930496 00000100:00100000:0.0:1789395268.107132:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231930496 00000100:00100000:0.0:1789395268.107226:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1422 00000100:00100000:0.0:1789395268.107238:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:2396:x1876316231930496:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395268.107259:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395268.107286:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e127 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210688c expref: 60 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.107319:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.107331:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395268.107460:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:2396:x1876316231930496:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 224us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.107469:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1422 00000100:00100000:1.0:1789395268.108106:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231930752 00000100:00100000:1.0:1789395268.108115:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231930752 00000100:00100000:1.0:1789395268.108167:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5259 00000100:00100000:1.0:1789395268.108176:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:22255:x1876316231930752:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395268.108487:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:22255:x1876316231930752:12345-192.168.203.54@tcp:35:dd.0 Request processed in 310us (1488us total) trans 4294968649 rc 0/0 00000100:00100000:1.0:1789395268.108494:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5259 00000100:00100000:3.0:1789395268.118633:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.118776:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231930880 00000100:00100000:0.0:1789395268.118789:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231930880 00002000:00100000:0.0:1789395268.118854:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c825ad80 x1876316231930880/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.118866:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825ad80 with x1876316231930880 ext(0->8191) 00002000:00010000:0.0:1789395268.118873:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c825ad80 00000100:00100000:0.0:1789395268.118957:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 78 00000100:00100000:0.0:1789395268.118967:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231930880:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395268.120005:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231930880:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1031us (1378us total) trans 4294969969 rc 0/0 00000100:00100000:0.0:1789395268.120018:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 78 00002000:00100000:0.0:1789395268.120029:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c825ad80 x1876316231930880/t4294969969(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.120040:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825ad80 with x1876316231930880 ext(0->8191) 00002000:00010000:0.0:1789395268.120046:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c825ad80 00000100:00100000:0.0:1789395268.125321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.126023:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231931008 00000100:00100000:2.0:1789395268.126039:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231931008 00000100:00100000:2.0:1789395268.126176:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5398 00000100:00100000:2.0:1789395268.126189:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231931008:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395268.127889:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969969 is committed 00000100:00100000:2.0:1789395268.128121:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231931008:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1928us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.128134:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5398 00000100:00100000:3.0:1789395268.138791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.138978:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231931264 00000100:00100000:1.0:1789395268.138994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231931264 00000100:00100000:1.0:1789395268.139077:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23956 00000100:00100000:1.0:1789395268.139090:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+60:22256:x1876316231931264:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395268.139131:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395268.139162:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e135 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106893 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139543:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139561:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139574:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139590:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139598:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139605:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139681:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e14a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139691:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e14a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139699:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e14a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395268.139711:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1789395268.139806:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139814:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139820:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139828:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139835:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395268.139841:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139912:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139927:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4e7d26b00) 00010000:00010000:1.0:1789395268.139938:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395268.139943:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139950:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e13c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139966:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139973:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139979:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139983:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395268.139987:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.139993:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.140000:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4e7d26100) 00010000:00010000:1.0:1789395268.140003:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395268.140007:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.140012:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e143 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.140068:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e135 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106893 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.140086:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e14a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106893 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.140094:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395268.140247:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395268.140252:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214000, rc 0) 00000100:00100000:1.0:1789395268.140539:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+62:22256:x1876316231931264:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1449us (1760us total) trans 4294968650 rc 0/0 00000100:00100000:1.0:1789395268.140548:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23956 00000100:00100000:3.0:1789395268.147537:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.147690:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231931648 00000100:00100000:2.0:1789395268.147702:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231931648 00000100:00100000:2.0:1789395268.147778:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1423 00000100:00100000:2.0:1789395268.147789:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+62:2396:x1876316231931648:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.147809:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.147835:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e14a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106893 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.147869:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.147874:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.147942:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+61:2396:x1876316231931648:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 154us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.147949:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1423 00000100:00100000:0.0:1789395268.150024:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.150118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231931520 00000100:00100000:2.0:1789395268.150131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231931520 00000100:00100000:2.0:1789395268.150198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5260 00000100:00100000:2.0:1789395268.150209:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+61:22256:x1876316231931520:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395268.150778:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+62:22256:x1876316231931520:12345-192.168.203.54@tcp:35:dd.0 Request processed in 570us (766us total) trans 4294968651 rc 0/0 00000100:00100000:2.0:1789395268.150789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5260 00000100:00100000:3.0:1789395268.159532:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.159644:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231931776 00000100:00100000:1.0:1789395268.159656:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231931776 00002000:00100000:1.0:1789395268.159714:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c8259c00 x1876316231931776/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.159727:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259c00 with x1876316231931776 ext(0->8191) 00002000:00010000:1.0:1789395268.159733:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8259c00 00000100:00100000:1.0:1789395268.159768:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 79 00000100:00100000:1.0:1789395268.159777:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231931776:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.161644:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231931776:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1856us (2113us total) trans 4294969970 rc 0/0 00000100:00100000:1.0:1789395268.161662:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 79 00002000:00100000:1.0:1789395268.161676:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c8259c00 x1876316231931776/t4294969970(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.161687:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259c00 with x1876316231931776 ext(0->8191) 00002000:00010000:1.0:1789395268.161694:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8259c00 00000100:00100000:3.0:1789395268.165804:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.165957:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231931904 00000100:00100000:0.0:1789395268.165969:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231931904 00000100:00100000:0.0:1789395268.166032:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5399 00000100:00100000:0.0:1789395268.166042:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231931904:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395268.167995:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969970 is committed 00000100:00100000:0.0:1789395268.168297:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231931904:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2247us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.168310:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5399 00000100:00100000:0.0:1789395268.180554:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.180668:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231932160 00000100:00100000:2.0:1789395268.180680:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231932160 00000100:00100000:2.0:1789395268.180748:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23957 00000100:00100000:2.0:1789395268.180759:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+62:22257:x1876316231932160:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.180791:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.180815:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e158 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210689a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.180978:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.180994:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181006:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181018:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181032:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181106:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e16d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e16d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181269:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e16d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395268.181284:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395268.181434:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181443:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181450:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181457:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181463:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.181469:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181478:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181492:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3ca366000) 00010000:00010000:2.0:1789395268.181496:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.181501:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181508:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e15f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181524:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181531:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181546:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181552:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.181555:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181561:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181568:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3ca366900) 00010000:00010000:2.0:1789395268.181571:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.181573:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181580:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e166 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181627:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e158 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210689a expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181641:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e16d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210689a expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.181649:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.181651:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395268.181654:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344a00, rc 0) 00000100:00100000:2.0:1789395268.181728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:22257:x1876316231932160:12345-192.168.203.54@tcp:101:dd.0 Request processed in 970us (1188us total) trans 4294968652 rc 0/0 00000100:00100000:2.0:1789395268.181741:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23957 00000100:00100000:3.0:1789395268.185911:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.186025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231932416 00000100:00100000:1.0:1789395268.186040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231932416 00000100:00100000:0.0:1789395268.186256:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5261 00000100:00100000:0.0:1789395268.186271:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:22257:x1876316231932416:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395268.186865:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+65:22257:x1876316231932416:12345-192.168.203.54@tcp:35:dd.0 Request processed in 595us (968us total) trans 4294968653 rc 0/0 00000100:00100000:0.0:1789395268.186875:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5261 00000100:00100000:3.0:1789395268.187736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.187839:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231932544 00000100:00100000:2.0:1789395268.187855:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231932544 00000100:00100000:2.0:1789395268.187924:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1424 00000100:00100000:2.0:1789395268.187944:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4df88b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+65:2398:x1876316231932544:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.187968:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.187997:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e16d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210689a expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.188019:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.188023:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.188079:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4df88b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:2398:x1876316231932544:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 137us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.188087:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1424 00000100:00100000:3.0:1789395268.193291:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.193606:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231932672 00000100:00100000:1.0:1789395268.193620:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231932672 00002000:00100000:1.0:1789395268.193690:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c8258380 x1876316231932672/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.193702:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8258380 with x1876316231932672 ext(0->8191) 00002000:00010000:1.0:1789395268.193709:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8258380 00000100:00100000:1.0:1789395268.193742:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 80 00000100:00100000:1.0:1789395268.193753:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231932672:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.195223:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231932672:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1461us (1946us total) trans 4294969971 rc 0/0 00000100:00100000:1.0:1789395268.195237:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 80 00002000:00100000:1.0:1789395268.195249:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c8258380 x1876316231932672/t4294969971(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.195259:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8258380 with x1876316231932672 ext(0->8191) 00002000:00010000:1.0:1789395268.195265:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8258380 00000100:00100000:0.0:1789395268.199512:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.199620:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231932800 00000100:00100000:1.0:1789395268.199634:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231932800 00000100:00100000:1.0:1789395268.199709:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5400 00000100:00100000:1.0:1789395268.199722:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231932800:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:2.0:1789395268.201328:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969971 is committed 00000100:00100000:1.0:1789395268.201545:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231932800:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1819us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395268.201556:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5400 00000100:00100000:0.0:1789395268.211801:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.211898:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231933056 00000100:00100000:2.0:1789395268.211911:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231933056 00000100:00100000:2.0:1789395268.211996:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23958 00000100:00100000:2.0:1789395268.212008:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+64:22258:x1876316231933056:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.212036:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.212063:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e17b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068a1 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212208:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212227:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212239:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212252:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212258:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212264:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212324:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e190 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212332:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e190 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.212339:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e190 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395268.212350:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395268.213028:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213040:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213047:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213054:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.213060:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213068:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213083:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3400) 00010000:00010000:2.0:1789395268.213086:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.213091:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213097:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e182 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213115:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213121:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213127:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213133:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.213135:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213140:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213151:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3c00) 00010000:00010000:2.0:1789395268.213153:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.213156:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213162:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e189 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213215:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e17b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068a1 expref: 67 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213230:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e190 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068a1 expref: 66 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.213238:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.213240:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395268.213243:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:2.0:1789395268.213381:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+66:22258:x1876316231933056:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1376us (1594us total) trans 4294968654 rc 0/0 00000100:00100000:2.0:1789395268.213416:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23958 00000100:00100000:3.0:1789395268.220982:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.221150:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.221465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231933440 00000100:00100000:2.0:1789395268.221485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231933440 00000100:00100000:2.0:1789395268.221547:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5262 00000100:00100000:2.0:1789395268.221560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+66:22258:x1876316231933440:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395268.221868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+67:22258:x1876316231933440:12345-192.168.203.54@tcp:35:dd.0 Request processed in 310us (717us total) trans 4294968655 rc 0/0 00000100:00100000:2.0:1789395268.221881:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5262 00000100:00100000:0.0:1789395268.222559:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231933184 00000100:00100000:0.0:1789395268.222568:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231933184 00000100:00100000:0.0:1789395268.222664:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1425 00000100:00100000:0.0:1789395268.222675:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+67:2396:x1876316231933184:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395268.222691:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395268.222718:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e190 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068a1 expref: 67 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.222740:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.222746:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395268.222793:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+66:2396:x1876316231933184:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 120us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.222800:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1425 00000100:00100000:3.0:1789395268.251859:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.252260:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231933568 00000100:00100000:0.0:1789395268.252287:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231933568 00002000:00100000:0.0:1789395268.252351:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c825b480 x1876316231933568/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.252363:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825b480 with x1876316231933568 ext(0->8191) 00002000:00010000:0.0:1789395268.252370:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c825b480 00000100:00100000:0.0:1789395268.252461:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 81 00000100:00100000:0.0:1789395268.252474:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231933568:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395268.253355:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231933568:12345-192.168.203.54@tcp:4:dd.0 Request processed in 877us (1503us total) trans 4294969972 rc 0/0 00000100:00100000:0.0:1789395268.253366:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 81 00002000:00100000:0.0:1789395268.253378:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c825b480 x1876316231933568/t4294969972(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.253418:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c825b480 with x1876316231933568 ext(0->8191) 00002000:00010000:0.0:1789395268.253423:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c825b480 00000100:00100000:3.0:1789395268.263752:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.263865:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231933696 00000100:00100000:2.0:1789395268.263879:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231933696 00000100:00100000:2.0:1789395268.263958:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5401 00000100:00100000:2.0:1789395268.263970:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231933696:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395268.269241:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969972 is committed 00000100:00100000:2.0:1789395268.269518:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231933696:12345-192.168.203.54@tcp:16:dd.0 Request processed in 5542us (5772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.269533:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5401 00000100:00100000:3.0:1789395268.286372:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.286609:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231933952 00000100:00100000:2.0:1789395268.286623:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231933952 00000100:00100000:2.0:1789395268.286695:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23959 00000100:00100000:2.0:1789395268.286708:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+66:22259:x1876316231933952:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.286738:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.286767:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e19e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068a8 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287295:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287311:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287324:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287342:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287354:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287361:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287473:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1b3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287483:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287491:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395268.287502:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395268.287605:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287613:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287620:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287626:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287632:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.287637:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287648:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287661:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3400) 00010000:00010000:2.0:1789395268.287664:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.287668:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287675:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1a5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287690:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287696:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287701:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287706:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.287708:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287715:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287721:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3c00) 00010000:00010000:2.0:1789395268.287723:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.287726:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287732:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1ac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287782:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e19e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068a8 expref: 69 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287798:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068a8 expref: 68 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.287805:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.287808:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395268.287811:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344a00, rc 0) 00000100:00100000:2.0:1789395268.287905:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:22259:x1876316231933952:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1199us (1545us total) trans 4294968656 rc 0/0 00000100:00100000:2.0:1789395268.287914:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23959 00000100:00100000:3.0:1789395268.294520:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.294578:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.294682:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231934208 00000100:00100000:0.0:1789395268.294695:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231934208 00000100:00100000:0.0:1789395268.294781:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5263 00000100:00100000:0.0:1789395268.294794:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d07850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:22259:x1876316231934208:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395268.295098:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d07850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+69:22259:x1876316231934208:12345-192.168.203.54@tcp:35:dd.0 Request processed in 306us (590us total) trans 4294968657 rc 0/0 00000100:00100000:0.0:1789395268.295108:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5263 00000100:00100000:2.0:1789395268.301183:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231934336 00000100:00100000:2.0:1789395268.301206:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231934336 00000100:00100000:1.0:1789395268.301513:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1426 00000100:00100000:1.0:1789395268.301526:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+69:2395:x1876316231934336:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395268.301547:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395268.301576:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1b3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068a8 expref: 69 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.301602:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395268.301607:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395268.301693:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:2395:x1876316231934336:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 169us (7113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395268.301702:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1426 00000100:00100000:0.0:1789395268.305631:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.305728:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231934464 00000100:00100000:1.0:1789395268.305741:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231934464 00002000:00100000:1.0:1789395268.305805:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca143800 x1876316231934464/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.305817:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca143800 with x1876316231934464 ext(0->8191) 00002000:00010000:1.0:1789395268.305824:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca143800 00000100:00100000:1.0:1789395268.305857:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 82 00000100:00100000:1.0:1789395268.305869:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231934464:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.307076:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231934464:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1199us (1449us total) trans 4294969973 rc 0/0 00000100:00100000:1.0:1789395268.307088:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 82 00002000:00100000:1.0:1789395268.307101:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca143800 x1876316231934464/t4294969973(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.307111:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca143800 with x1876316231934464 ext(0->8191) 00002000:00010000:1.0:1789395268.307118:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca143800 00000100:00100000:3.0:1789395268.315173:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.315290:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231934592 00000100:00100000:2.0:1789395268.315312:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231934592 00000100:00100000:2.0:1789395268.315438:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5402 00000100:00100000:2.0:1789395268.315451:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231934592:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395268.317297:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969973 is committed 00000100:00100000:1.0:1789395268.317534:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231934592:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2079us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395268.317545:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5402 00000100:00100000:3.0:1789395268.336628:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.336977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231934848 00000100:00100000:2.0:1789395268.336991:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231934848 00000100:00100000:2.0:1789395268.337075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23960 00000100:00100000:2.0:1789395268.337087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+68:22260:x1876316231934848:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.337116:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.337146:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e1c1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068af expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.337304:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.337320:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.337671:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789395268.337800:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.337822:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.337831:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.337839:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339082:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e1d6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339107:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339118:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395268.339134:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:3.0:1789395268.339264:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339272:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339279:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339291:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339297:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395268.339302:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339691:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339706:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3400) 00010000:00010000:3.0:1789395268.339709:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395268.339714:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339795:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e1c8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339818:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339826:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339832:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339837:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395268.339841:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339956:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339965:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3c00) 00010000:00010000:3.0:1789395268.339968:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395268.339971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.339976:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1cf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.340049:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e1c1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068af expref: 71 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.340066:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068af expref: 70 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.340074:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395268.340076:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395268.340079:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ac00, rc 0) 00000100:00100000:3.0:1789395268.340227:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+70:22260:x1876316231934848:12345-192.168.203.54@tcp:101:dd.0 Request processed in 3140us (3612us total) trans 4294968658 rc 0/0 00000100:00100000:3.0:1789395268.340238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23960 00000100:00100000:0.0:1789395268.345541:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.345575:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.345652:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231935232 00000100:00100000:2.0:1789395268.345664:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231935232 00000100:00100000:2.0:1789395268.345738:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1427 00000100:00100000:2.0:1789395268.345750:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+70:2398:x1876316231935232:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.345771:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.345801:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e1d6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068af expref: 70 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.345825:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.345832:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.345913:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+69:2398:x1876316231935232:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 166us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.345921:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1427 00000100:00100000:1.0:1789395268.347542:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231935104 00000100:00100000:1.0:1789395268.347560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231935104 00000100:00100000:1.0:1789395268.347625:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5264 00000100:00100000:1.0:1789395268.347636:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+69:22260:x1876316231935104:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395268.348040:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+70:22260:x1876316231935104:12345-192.168.203.54@tcp:35:dd.0 Request processed in 406us (2512us total) trans 4294968659 rc 0/0 00000100:00100000:1.0:1789395268.348048:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5264 00000100:00100000:0.0:1789395268.355628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.355740:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231935360 00000100:00100000:1.0:1789395268.355753:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231935360 00002000:00100000:1.0:1789395268.355817:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c8258e00 x1876316231935360/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.355829:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8258e00 with x1876316231935360 ext(0->8191) 00002000:00010000:1.0:1789395268.355836:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8258e00 00000100:00100000:1.0:1789395268.356085:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 83 00000100:00100000:1.0:1789395268.356097:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231935360:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.357291:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231935360:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1186us (1668us total) trans 4294969974 rc 0/0 00000100:00100000:1.0:1789395268.358346:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 83 00002000:00100000:1.0:1789395268.358369:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c8258e00 x1876316231935360/t4294969974(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.358380:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8258e00 with x1876316231935360 ext(0->8191) 00002000:00010000:1.0:1789395268.358405:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8258e00 00000100:00100000:3.0:1789395268.361651:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.361796:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231935488 00000100:00100000:0.0:1789395268.361809:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231935488 00000100:00100000:0.0:1789395268.361890:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5403 00000100:00100000:0.0:1789395268.361902:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231935488:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395268.363561:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969974 is committed 00000100:00100000:0.0:1789395268.363739:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231935488:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1835us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.363749:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5403 00000100:00100000:0.0:1789395268.382057:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.383915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231935744 00000100:00100000:2.0:1789395268.383946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231935744 00000100:00100000:2.0:1789395268.384055:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23961 00000100:00100000:2.0:1789395268.384067:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+70:22261:x1876316231935744:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.384097:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.384125:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1e4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068b6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.384271:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.384732:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.384745:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.384766:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385298:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385309:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385451:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e1f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385466:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e1f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385474:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e1f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395268.385485:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395268.385603:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385609:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385614:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385619:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385622:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.385627:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385636:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385648:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3700) 00010000:00010000:2.0:1789395268.385651:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.385656:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385662:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e1eb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385678:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385683:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385689:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385694:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.385696:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385701:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385707:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395268.385709:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.385713:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385719:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e1f2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385791:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e1e4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068b6 expref: 73 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385808:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e1f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068b6 expref: 72 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.385820:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.385822:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395268.385826:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4c148bc00, rc 0) 00000100:00100000:2.0:1789395268.385921:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:22261:x1876316231935744:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1855us (4159us total) trans 4294968660 rc 0/0 00000100:00100000:2.0:1789395268.385937:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23961 00000100:00100000:2.0:1789395268.393453:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.393533:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.393665:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231936000 00000100:00100000:1.0:1789395268.393678:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231936000 00000100:00100000:1.0:1789395268.393746:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5265 00000100:00100000:1.0:1789395268.393759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:22261:x1876316231936000:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395268.394067:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+73:22261:x1876316231936000:12345-192.168.203.54@tcp:35:dd.0 Request processed in 309us (629us total) trans 4294968661 rc 0/0 00000100:00100000:1.0:1789395268.394076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5265 00000100:00100000:0.0:1789395268.394237:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231936128 00000100:00100000:0.0:1789395268.394243:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231936128 00000100:00100000:0.0:1789395268.394290:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1428 00000100:00100000:0.0:1789395268.394297:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+73:2396:x1876316231936128:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395268.394309:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395268.394338:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e1f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068b6 expref: 73 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.394359:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.394364:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395268.394421:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:2396:x1876316231936128:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 124us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.394429:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1428 00000100:00100000:3.0:1789395268.416090:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.416686:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231936256 00000100:00100000:0.0:1789395268.416700:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231936256 00002000:00100000:0.0:1789395268.416770:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca3e1500 x1876316231936256/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.416783:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e1500 with x1876316231936256 ext(0->8191) 00002000:00010000:0.0:1789395268.416790:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e1500 00000100:00100000:0.0:1789395268.416831:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 84 00000100:00100000:0.0:1789395268.416842:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231936256:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395268.417564:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231936256:12345-192.168.203.54@tcp:4:dd.0 Request processed in 719us (1486us total) trans 4294969975 rc 0/0 00000100:00100000:0.0:1789395268.417578:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 84 00002000:00100000:0.0:1789395268.417588:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca3e1500 x1876316231936256/t4294969975(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.417597:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e1500 with x1876316231936256 ext(0->8191) 00002000:00010000:0.0:1789395268.417602:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e1500 00000100:00100000:0.0:1789395268.424957:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.433735:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231936384 00000100:00100000:2.0:1789395268.433757:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231936384 00000100:00100000:3.0:1789395268.436606:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5404 00000100:00100000:3.0:1789395268.436624:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231936384:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395268.444224:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969975 is committed 00000100:00100000:1.0:1789395268.452794:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231936384:12345-192.168.203.54@tcp:16:dd.0 Request processed in 16165us (27843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395268.452809:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5404 00000100:00100000:2.0:1789395268.477742:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.477915:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231936640 00000100:00100000:1.0:1789395268.477939:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231936640 00000100:00100000:1.0:1789395268.478075:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23962 00000100:00100000:1.0:1789395268.478086:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+72:22262:x1876316231936640:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395268.478115:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395268.478141:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e207 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068bd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478263:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478290:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478304:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478318:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478325:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478341:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478663:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e21c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478673:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e21c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478681:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e21c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395268.478692:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1789395268.478775:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478800:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478807:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478815:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478821:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395268.478826:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478835:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478848:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4e7d26f00) 00010000:00010000:1.0:1789395268.478851:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395268.478856:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478863:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e20e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478877:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478883:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478889:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478894:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395268.478897:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478903:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478911:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4e7d26100) 00010000:00010000:1.0:1789395268.478914:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395268.478916:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478923:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e215 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.478984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e207 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068bd expref: 75 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.479001:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e21c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068bd expref: 74 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.479651:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395268.479655:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395268.479657:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214400, rc 0) 00000100:00100000:1.0:1789395268.479762:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:22262:x1876316231936640:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1677us (2034us total) trans 4294968662 rc 0/0 00000100:00100000:1.0:1789395268.479770:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23962 00000100:00100000:2.0:1789395268.490286:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.491528:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.491703:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231937024 00000100:00100000:0.0:1789395268.491718:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231937024 00000100:00100000:0.0:1789395268.491800:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5266 00000100:00100000:0.0:1789395268.491812:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:22262:x1876316231937024:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395268.492080:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:22262:x1876316231937024:12345-192.168.203.54@tcp:35:dd.0 Request processed in 268us (1808us total) trans 4294968663 rc 0/0 00000100:00100000:0.0:1789395268.492090:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5266 00000100:00100000:1.0:1789395268.492740:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231936768 00000100:00100000:1.0:1789395268.492755:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231936768 00000100:00100000:1.0:1789395268.492834:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1429 00000100:00100000:1.0:1789395268.492858:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:2395:x1876316231936768:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395268.492875:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395268.492903:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e21c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068bd expref: 75 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395268.492945:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395268.492951:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395268.493010:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:2395:x1876316231936768:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 167us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395268.493017:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1429 00000100:00100000:2.0:1789395268.516825:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.516941:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231937152 00000100:00100000:1.0:1789395268.516952:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231937152 00002000:00100000:1.0:1789395268.517006:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a4cbfe7b80 x1876316231937152/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.517027:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe7b80 with x1876316231937152 ext(0->8191) 00002000:00010000:1.0:1789395268.517033:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4cbfe7b80 00000100:00100000:1.0:1789395268.517064:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 85 00000100:00100000:1.0:1789395268.517074:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231937152:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.517994:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231937152:12345-192.168.203.54@tcp:4:dd.0 Request processed in 917us (1174us total) trans 4294969976 rc 0/0 00000100:00100000:1.0:1789395268.518004:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 85 00002000:00100000:1.0:1789395268.518022:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a4cbfe7b80 x1876316231937152/t4294969976(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.518036:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4cbfe7b80 with x1876316231937152 ext(0->8191) 00002000:00010000:1.0:1789395268.518040:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4cbfe7b80 00000100:00100000:3.0:1789395268.525200:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.528059:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231937280 00000100:00100000:0.0:1789395268.528075:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231937280 00000100:00100000:0.0:1789395268.528160:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5405 00000100:00100000:0.0:1789395268.528170:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231937280:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395268.534756:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969976 is committed 00000100:00100000:2.0:1789395268.535581:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231937280:12345-192.168.203.54@tcp:16:dd.0 Request processed in 7404us (10521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.535592:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5405 00000100:00100000:3.0:1789395268.557640:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.557827:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231937536 00000100:00100000:0.0:1789395268.557844:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231937536 00000100:00100000:0.0:1789395268.557937:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23963 00000100:00100000:0.0:1789395268.557949:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+74:22263:x1876316231937536:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395268.557978:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395268.558003:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e22a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068c4 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558119:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558136:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558149:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558175:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558183:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558190:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558241:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e23f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558250:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e23f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.558257:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e23f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395268.558266:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1789395268.561050:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561073:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561080:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561088:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561094:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.561099:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561109:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561127:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041000) 00010000:00010000:0.0:1789395268.561130:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.561135:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561142:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e231 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561158:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561165:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561171:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561177:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.561181:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561187:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561195:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4cb041200) 00010000:00010000:0.0:1789395268.561198:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.561201:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561207:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e238 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561271:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e22a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068c4 expref: 77 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561290:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e23f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068c4 expref: 76 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.561297:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.561299:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395268.561302:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376400, rc 0) 00000100:00100000:0.0:1789395268.561440:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:22263:x1876316231937536:12345-192.168.203.54@tcp:101:dd.0 Request processed in 3493us (3815us total) trans 4294968664 rc 0/0 00000100:00100000:0.0:1789395268.561449:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23963 00000100:00100000:0.0:1789395268.574185:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.574228:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.574583:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231937920 00000100:00100000:2.0:1789395268.574593:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231937920 00000100:00100000:2.0:1789395268.574667:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1430 00000100:00100000:2.0:1789395268.574678:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:2397:x1876316231937920:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.574695:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.574722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e23f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068c4 expref: 76 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.574750:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.574756:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.574817:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:2397:x1876316231937920:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 141us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.574825:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1430 00000100:00100000:3.0:1789395268.574884:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231937792 00000100:00100000:3.0:1789395268.574891:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231937792 00000100:00100000:3.0:1789395268.574936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5267 00000100:00100000:3.0:1789395268.574948:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+75:22263:x1876316231937792:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:3.0:1789395268.575143:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:22263:x1876316231937792:12345-192.168.203.54@tcp:35:dd.0 Request processed in 198us (967us total) trans 4294968665 rc 0/0 00000100:00100000:3.0:1789395268.575151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5267 00000100:00100000:3.0:1789395268.587510:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.587747:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231938048 00000100:00100000:1.0:1789395268.587758:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231938048 00002000:00100000:1.0:1789395268.587812:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca3e1880 x1876316231938048/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.587823:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e1880 with x1876316231938048 ext(0->8191) 00002000:00010000:1.0:1789395268.587829:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e1880 00000100:00100000:1.0:1789395268.587861:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 86 00000100:00100000:1.0:1789395268.587871:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231938048:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.588687:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231938048:12345-192.168.203.54@tcp:4:dd.0 Request processed in 813us (1183us total) trans 4294969977 rc 0/0 00000100:00100000:1.0:1789395268.588696:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 86 00002000:00100000:1.0:1789395268.588703:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca3e1880 x1876316231938048/t4294969977(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.588712:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e1880 with x1876316231938048 ext(0->8191) 00002000:00010000:1.0:1789395268.588717:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e1880 00000100:00100000:1.0:1789395268.598673:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.598760:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231938176 00000100:00100000:3.0:1789395268.598770:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231938176 00000100:00100000:3.0:1789395268.598829:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5406 00000100:00100000:3.0:1789395268.598840:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231938176:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395268.604273:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969977 is committed 00000100:00100000:3.0:1789395268.604486:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231938176:12345-192.168.203.54@tcp:16:dd.0 Request processed in 5642us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395268.604497:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5406 00000100:00100000:0.0:1789395268.629797:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.629895:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231938432 00000100:00100000:2.0:1789395268.629904:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231938432 00000100:00100000:2.0:1789395268.629973:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23964 00000100:00100000:2.0:1789395268.629983:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+76:22264:x1876316231938432:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.630009:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.630036:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e24d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068cb expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630165:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630181:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630193:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630206:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630212:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630222:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630277:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e262 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630287:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e262 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630295:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e262 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395268.630316:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395268.630455:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630464:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630471:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630477:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.630481:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630490:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630503:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3700) 00010000:00010000:2.0:1789395268.630506:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.630511:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630517:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e254 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630531:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630537:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630542:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630547:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.630550:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630556:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630564:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395268.630566:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.630569:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630580:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e25b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630621:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e24d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068cb expref: 79 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630641:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e262 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068cb expref: 78 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.630649:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.630652:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395268.630654:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:2.0:1789395268.630703:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+78:22264:x1876316231938432:12345-192.168.203.54@tcp:101:dd.0 Request processed in 722us (915us total) trans 4294968666 rc 0/0 00000100:00100000:2.0:1789395268.630711:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23964 00000100:00100000:0.0:1789395268.636216:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.636294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231938816 00000100:00100000:2.0:1789395268.636313:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231938816 00000100:00100000:2.0:1789395268.636457:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5268 00000100:00100000:2.0:1789395268.636468:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+78:22264:x1876316231938816:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395268.636697:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+79:22264:x1876316231938816:12345-192.168.203.54@tcp:35:dd.0 Request processed in 230us (489us total) trans 4294968667 rc 0/0 00000100:00100000:2.0:1789395268.636705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5268 00000100:00100000:1.0:1789395268.640779:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.640885:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231938560 00000100:00100000:3.0:1789395268.640896:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231938560 00000100:00100000:3.0:1789395268.640973:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1431 00000100:00100000:3.0:1789395268.640983:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4df888050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+79:2395:x1876316231938560:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395268.641004:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395268.641030:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e262 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068cb expref: 79 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.641203:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395268.641210:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395268.641268:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4df888050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+78:2395:x1876316231938560:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 286us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395268.641276:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1431 00000100:00100000:1.0:1789395268.655019:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.655479:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231938944 00000100:00100000:3.0:1789395268.655489:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231938944 00002000:00100000:3.0:1789395268.655540:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15f480 x1876316231938944/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395268.655551:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15f480 with x1876316231938944 ext(0->8191) 00002000:00010000:3.0:1789395268.655558:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15f480 00000100:00100000:3.0:1789395268.655591:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 87 00000100:00100000:3.0:1789395268.655600:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231938944:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395268.657295:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231938944:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1688us (2278us total) trans 4294969978 rc 0/0 00000100:00100000:3.0:1789395268.657315:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 87 00002000:00100000:3.0:1789395268.657325:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15f480 x1876316231938944/t4294969978(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395268.657335:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15f480 with x1876316231938944 ext(0->8191) 00002000:00010000:3.0:1789395268.657341:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15f480 00000100:00100000:1.0:1789395268.673209:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.673330:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231939072 00000100:00100000:3.0:1789395268.673339:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231939072 00000100:00100000:3.0:1789395268.673418:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5407 00000100:00100000:3.0:1789395268.673429:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231939072:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395268.674962:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969978 is committed 00000100:00100000:3.0:1789395268.675128:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231939072:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1698us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395268.675137:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5407 00000100:00100000:0.0:1789395268.707884:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.708103:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231939328 00000100:00100000:2.0:1789395268.708113:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231939328 00000100:00100000:2.0:1789395268.708170:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23965 00000100:00100000:2.0:1789395268.708180:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+78:22265:x1876316231939328:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395268.708207:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395268.708234:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e270 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068d2 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708346:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708376:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708682:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708700:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708708:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708715:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708765:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e285 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708773:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e285 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708779:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e285 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395268.708788:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1789395268.708855:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708862:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708869:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708876:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708882:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.708886:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708894:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708905:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3700) 00010000:00010000:2.0:1789395268.708908:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.708913:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708918:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e277 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708941:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708948:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.708954:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709775:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395268.709780:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709793:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709805:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395268.709808:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395268.709811:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709818:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e27e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709875:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e270 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068d2 expref: 81 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709891:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e285 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068d2 expref: 80 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.709899:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.709902:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395268.709904:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4c148b400, rc 0) 00000100:00100000:2.0:1789395268.709988:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:22265:x1876316231939328:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1809us (2113us total) trans 4294968668 rc 0/0 00000100:00100000:2.0:1789395268.709996:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23965 00000100:00100000:1.0:1789395268.718116:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.718259:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.718288:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231939456 00000100:00100000:3.0:1789395268.718302:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231939456 00000100:00100000:3.0:1789395268.718381:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1432 00000100:00100000:3.0:1789395268.718440:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:2396:x1876316231939456:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395268.718462:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395268.718496:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e285 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068d2 expref: 80 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.718569:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395268.718576:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395268.718662:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+79:2396:x1876316231939456:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 217us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395268.718672:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1432 00000100:00100000:0.0:1789395268.719052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231939712 00000100:00100000:0.0:1789395268.719060:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231939712 00000100:00100000:0.0:1789395268.719105:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5269 00000100:00100000:0.0:1789395268.719114:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+79:22265:x1876316231939712:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395268.719500:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:22265:x1876316231939712:12345-192.168.203.54@tcp:35:dd.0 Request processed in 386us (1239us total) trans 4294968669 rc 0/0 00000100:00100000:0.0:1789395268.719508:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5269 00000100:00100000:1.0:1789395268.725544:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.725648:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231939840 00000100:00100000:2.0:1789395268.725663:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231939840 00002000:00100000:2.0:1789395268.725724:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15d880 x1876316231939840/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395268.725740:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15d880 with x1876316231939840 ext(0->8191) 00002000:00010000:2.0:1789395268.725745:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15d880 00000100:00100000:2.0:1789395268.725780:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 88 00000100:00100000:2.0:1789395268.725790:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231939840:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395268.726739:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231939840:12345-192.168.203.54@tcp:4:dd.0 Request processed in 942us (1203us total) trans 4294969979 rc 0/0 00000100:00100000:2.0:1789395268.726754:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 88 00002000:00100000:2.0:1789395268.726768:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15d880 x1876316231939840/t4294969979(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395268.726778:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15d880 with x1876316231939840 ext(0->8191) 00002000:00010000:2.0:1789395268.726784:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15d880 00000100:00100000:1.0:1789395268.729681:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.729747:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231939968 00000100:00100000:2.0:1789395268.729760:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231939968 00000100:00100000:2.0:1789395268.729875:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5408 00000100:00100000:2.0:1789395268.729888:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231939968:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395268.731366:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969979 is committed 00000100:00100000:2.0:1789395268.731704:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231939968:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1813us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.731715:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5408 00000100:00100000:1.0:1789395268.740090:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.740194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231940224 00000100:00100000:3.0:1789395268.740210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231940224 00000100:00100000:3.0:1789395268.740328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23966 00000100:00100000:3.0:1789395268.740340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+80:22266:x1876316231940224:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395268.740368:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395268.740436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e293 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740589:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740611:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740624:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740639:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740647:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740654:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740724:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e2a8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740734:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e2a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740739:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e2a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395268.740749:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:3.0:1789395268.740838:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740846:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740853:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740861:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740868:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395268.740873:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740882:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740895:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395268.740899:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395268.740903:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740910:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e29a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740937:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740944:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740950:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740955:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395268.740958:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740968:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740975:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d500) 00010000:00010000:3.0:1789395268.740978:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395268.740980:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.740986:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2a1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.741042:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e293 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068d9 expref: 83 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.741060:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068d9 expref: 82 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.741067:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395268.741070:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395268.741073:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ac00, rc 0) 00000100:00100000:3.0:1789395268.741151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+82:22266:x1876316231940224:12345-192.168.203.54@tcp:101:dd.0 Request processed in 813us (1076us total) trans 4294968670 rc 0/0 00000100:00100000:3.0:1789395268.741159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23966 00000100:00100000:1.0:1789395268.748218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.749095:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.749316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231940480 00000100:00100000:3.0:1789395268.749330:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231940480 00000100:00100000:3.0:1789395268.749431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5270 00000100:00100000:3.0:1789395268.749443:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+82:22266:x1876316231940480:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:3.0:1789395268.749726:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+83:22266:x1876316231940480:12345-192.168.203.54@tcp:35:dd.0 Request processed in 285us (635us total) trans 4294968671 rc 0/0 00000100:00100000:3.0:1789395268.749736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5270 00000100:00100000:2.0:1789395268.750979:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231940608 00000100:00100000:2.0:1789395268.750995:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231940608 00000100:00100000:2.0:1789395268.751078:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1433 00000100:00100000:2.0:1789395268.751089:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+83:2396:x1876316231940608:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.751106:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.751135:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e2a8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068d9 expref: 83 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.751156:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.751162:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.751269:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+82:2396:x1876316231940608:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 182us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.751277:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1433 00000100:00100000:1.0:1789395268.759273:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.759381:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231940736 00000100:00100000:0.0:1789395268.759441:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231940736 00002000:00100000:0.0:1789395268.759507:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15e300 x1876316231940736/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.759520:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15e300 with x1876316231940736 ext(0->8191) 00002000:00010000:0.0:1789395268.759527:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15e300 00000100:00100000:0.0:1789395268.759560:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 89 00000100:00100000:0.0:1789395268.759570:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231940736:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395268.764322:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231940736:12345-192.168.203.54@tcp:4:dd.0 Request processed in 4734us (5044us total) trans 4294969980 rc 0/0 00000100:00100000:0.0:1789395268.764343:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 89 00002000:00100000:0.0:1789395268.764362:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3ca15e300 x1876316231940736/t4294969980(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.764380:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15e300 with x1876316231940736 ext(0->8191) 00002000:00010000:0.0:1789395268.764407:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15e300 00000100:00100000:1.0:1789395268.768842:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.769021:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231940864 00000100:00100000:2.0:1789395268.769035:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231940864 00000100:00100000:2.0:1789395268.769111:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5409 00000100:00100000:2.0:1789395268.769123:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2395:x1876316231940864:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395268.771636:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969980 is committed 00000100:00100000:2.0:1789395268.771881:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231940864:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2753us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.771894:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5409 00000100:00100000:2.0:1789395268.783518:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.783663:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231941120 00000100:00100000:0.0:1789395268.783676:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231941120 00000100:00100000:0.0:1789395268.783749:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23967 00000100:00100000:0.0:1789395268.783761:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+82:22267:x1876316231941120:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395268.783788:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395268.783819:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e2b6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068e0 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784125:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784140:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784153:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784167:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784174:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784181:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784255:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e2cb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784265:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e2cb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784273:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e2cb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395268.784285:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1789395268.784382:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784565:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784573:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784581:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.784586:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784596:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784609:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041000) 00010000:00010000:0.0:1789395268.784613:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.784618:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784628:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e2bd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784645:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784653:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784660:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784666:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.784669:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784675:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784681:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4cb041200) 00010000:00010000:0.0:1789395268.784684:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.784687:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784693:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e2c4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784746:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e2b6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068e0 expref: 85 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784768:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e2cb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068e0 expref: 84 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.784777:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.784779:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395268.784782:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377c00, rc 0) 00000100:00100000:0.0:1789395268.785127:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4cbfe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:22267:x1876316231941120:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1367us (1621us total) trans 4294968672 rc 0/0 00000100:00100000:0.0:1789395268.785137:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23967 00000100:00100000:1.0:1789395268.791644:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.791742:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231941376 00000100:00100000:0.0:1789395268.791754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231941376 00000100:00100000:0.0:1789395268.791823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5271 00000100:00100000:0.0:1789395268.791834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:22267:x1876316231941376:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395268.792139:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+85:22267:x1876316231941376:12345-192.168.203.54@tcp:35:dd.0 Request processed in 305us (506us total) trans 4294968673 rc 0/0 00000100:00100000:0.0:1789395268.792147:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5271 00000100:00100000:1.0:1789395268.801715:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.801915:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231941504 00000100:00100000:3.0:1789395268.801937:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231941504 00000100:00100000:3.0:1789395268.802022:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1434 00000100:00100000:3.0:1789395268.802033:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+85:2395:x1876316231941504:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395268.802052:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395268.802080:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e2cb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068e0 expref: 85 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.802106:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395268.802111:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395268.802183:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:2395:x1876316231941504:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 152us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395268.802191:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1434 00000100:00100000:2.0:1789395268.806935:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.807022:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231941632 00000100:00100000:3.0:1789395268.807035:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231941632 00002000:00100000:3.0:1789395268.807100:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c9e18380 x1876316231941632/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395268.807114:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9e18380 with x1876316231941632 ext(0->8191) 00002000:00010000:3.0:1789395268.807120:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9e18380 00000100:00100000:3.0:1789395268.807163:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 90 00000100:00100000:3.0:1789395268.807175:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231941632:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395268.808212:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231941632:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1032us (1295us total) trans 4294969981 rc 0/0 00000100:00100000:3.0:1789395268.808225:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 90 00002000:00100000:3.0:1789395268.808235:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a3c9e18380 x1876316231941632/t4294969981(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395268.808245:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9e18380 with x1876316231941632 ext(0->8191) 00002000:00010000:3.0:1789395268.808250:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9e18380 00000100:00100000:1.0:1789395268.813020:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.813184:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231941760 00000100:00100000:3.0:1789395268.813196:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231941760 00000100:00100000:3.0:1789395268.813266:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5410 00000100:00100000:3.0:1789395268.813277:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231941760:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395268.817704:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969981 is committed 00000100:00100000:3.0:1789395268.817966:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231941760:12345-192.168.203.54@tcp:16:dd.0 Request processed in 4682us (4953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395268.817980:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5410 00000100:00100000:1.0:1789395268.832600:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.832804:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231942016 00000100:00100000:3.0:1789395268.832818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231942016 00000100:00100000:3.0:1789395268.839145:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23968 00000100:00100000:3.0:1789395268.839177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+84:22268:x1876316231942016:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395268.839209:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395268.839238:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e2d9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068e7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839422:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839439:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839456:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839471:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839479:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839485:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839553:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e2ee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839562:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e2ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839570:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e2ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395268.839582:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:3.0:1789395268.839680:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839688:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839694:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839701:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839707:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395268.839712:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839720:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839736:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d200) 00010000:00010000:3.0:1789395268.839739:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395268.839744:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839751:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e2e0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839765:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839771:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839776:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839781:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395268.839784:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839790:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839802:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d500) 00010000:00010000:3.0:1789395268.839805:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395268.839808:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839814:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e2e7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839866:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e2d9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068e7 expref: 87 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839883:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e2ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068e7 expref: 86 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395268.839890:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395268.839893:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395268.839895:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ba00, rc 0) 00000100:00100000:3.0:1789395268.839992:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+86:22268:x1876316231942016:12345-192.168.203.54@tcp:101:dd.0 Request processed in 834us (7403us total) trans 4294968674 rc 0/0 00000100:00100000:3.0:1789395268.840000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23968 00000100:00100000:2.0:1789395268.852187:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.854341:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231942272 00000100:00100000:3.0:1789395268.854345:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.854355:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231942272 00000100:00100000:2.0:1789395268.854448:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231942400 00000100:00100000:2.0:1789395268.854453:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231942400 00000100:00100000:1.0:1789395268.854457:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5272 00000100:00100000:1.0:1789395268.854479:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+87:22268:x1876316231942272:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395268.854497:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1435 00000100:00100000:2.0:1789395268.854504:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+87:2395:x1876316231942400:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395268.854519:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395268.854547:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e2ee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068e7 expref: 87 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395268.854568:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395268.854573:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395268.854636:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+86:2395:x1876316231942400:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 133us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395268.854643:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1435 00000100:00100000:1.0:1789395268.854702:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c904ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+86:22268:x1876316231942272:12345-192.168.203.54@tcp:35:dd.0 Request processed in 236us (2530us total) trans 4294968675 rc 0/0 00000100:00100000:1.0:1789395268.854709:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5272 00000100:00100000:2.0:1789395268.869156:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.869226:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231942528 00000100:00100000:1.0:1789395268.869239:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231942528 00002000:00100000:1.0:1789395268.869312:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a501db2680 x1876316231942528/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.869325:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2680 with x1876316231942528 ext(0->8191) 00002000:00010000:1.0:1789395268.869332:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db2680 00000100:00100000:1.0:1789395268.869633:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 91 00000100:00100000:1.0:1789395268.869646:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231942528:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395268.870592:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231942528:12345-192.168.203.54@tcp:4:dd.0 Request processed in 942us (1440us total) trans 4294969982 rc 0/0 00000100:00100000:1.0:1789395268.870603:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 91 00002000:00100000:1.0:1789395268.870614:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a501db2680 x1876316231942528/t4294969982(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395268.870624:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db2680 with x1876316231942528 ext(0->8191) 00002000:00010000:1.0:1789395268.870629:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db2680 00000100:00100000:2.0:1789395268.881142:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.881206:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231942656 00000100:00100000:0.0:1789395268.881220:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231942656 00000100:00100000:0.0:1789395268.881343:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5411 00000100:00100000:0.0:1789395268.881357:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2396:x1876316231942656:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395268.884181:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969982 is committed 00000100:00100000:0.0:1789395268.884472:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231942656:12345-192.168.203.54@tcp:16:dd.0 Request processed in 3110us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.884486:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5411 00000100:00100000:3.0:1789395268.899147:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.899491:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231942912 00000100:00100000:0.0:1789395268.899505:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231942912 00000100:00100000:0.0:1789395268.899580:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23969 00000100:00100000:0.0:1789395268.899591:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+86:22269:x1876316231942912:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395268.899619:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395268.899648:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e2fc lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068ee expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.899793:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.899809:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.899821:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.899835:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.899842:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900060:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900142:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e311 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900152:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e311 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900164:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e311 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395268.900176:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1789395268.900649:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900659:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900666:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900674:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900681:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.900686:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900695:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900708:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041e00) 00010000:00010000:0.0:1789395268.900712:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.900717:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900725:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e303 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900747:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900754:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900760:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900765:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395268.900768:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900774:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900782:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4cb041200) 00010000:00010000:0.0:1789395268.900785:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395268.900787:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.900794:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e30a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.901124:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e2fc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068ee expref: 89 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.901147:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e311 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068ee expref: 88 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.901160:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.901163:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395268.901166:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377c00, rc 0) 00000100:00100000:0.0:1789395268.901560:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:22269:x1876316231942912:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1969us (2426us total) trans 4294968676 rc 0/0 00000100:00100000:0.0:1789395268.901571:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23969 00000100:00100000:2.0:1789395268.910881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395268.910965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395268.911093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231943168 00000100:00100000:3.0:1789395268.911107:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231943168 00000100:00100000:0.0:1789395268.911116:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231943296 00000100:00100000:0.0:1789395268.911124:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231943296 00000100:00100000:3.0:1789395268.911170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5273 00000100:00100000:3.0:1789395268.911184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+89:22269:x1876316231943168:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395268.911192:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1436 00000100:00100000:0.0:1789395268.911202:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+89:2395:x1876316231943296:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395268.911219:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395268.911257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e311 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068ee expref: 89 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395268.911282:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395268.911288:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395268.911356:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:2395:x1876316231943296:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 155us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395268.911364:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1436 00000100:00100000:3.0:1789395268.911464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:22269:x1876316231943168:12345-192.168.203.54@tcp:35:dd.0 Request processed in 283us (599us total) trans 4294968677 rc 0/0 00000100:00100000:3.0:1789395268.911472:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5273 00000100:00100000:2.0:1789395268.920358:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395268.920820:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231943424 00000100:00100000:0.0:1789395268.920834:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231943424 00002000:00100000:0.0:1789395268.920900:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a501db0a80 x1876316231943424/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/0 e 0 to 0 dl 1789395279 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.920912:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0a80 with x1876316231943424 ext(0->8191) 00002000:00010000:0.0:1789395268.920919:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db0a80 00000100:00100000:0.0:1789395268.920975:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 92 00000100:00100000:0.0:1789395268.920986:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231943424:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395268.921888:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2398:x1876316231943424:12345-192.168.203.54@tcp:4:dd.0 Request processed in 898us (1540us total) trans 4294969983 rc 0/0 00000100:00100000:0.0:1789395268.921899:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 92 00002000:00100000:0.0:1789395268.921908:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff89a501db0a80 x1876316231943424/t4294969983(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:734/0 lens 8680/448 e 0 to 0 dl 1789395279 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395268.921916:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0a80 with x1876316231943424 ext(0->8191) 00002000:00010000:0.0:1789395268.921921:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db0a80 00000100:00100000:3.0:1789395268.930972:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395268.931372:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231943552 00000100:00100000:1.0:1789395268.931428:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231943552 00000100:00100000:1.0:1789395268.931510:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5412 00000100:00100000:1.0:1789395268.931525:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231943552:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:3.0:1789395268.934576:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969983 is committed 00000100:00100000:1.0:1789395268.934954:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231943552:12345-192.168.203.54@tcp:16:dd.0 Request processed in 3424us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395268.934969:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5412 00000100:00100000:2.0:1789395269.053531:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.053637:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231943808 00000100:00100000:0.0:1789395269.053651:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231943808 00000100:00100000:0.0:1789395269.053740:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23970 00000100:00100000:0.0:1789395269.053753:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+88:22276:x1876316231943808:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395269.053780:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395269.053806:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e31f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068f5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.053954:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.053971:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.053985:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.053999:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054007:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054014:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054083:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e334 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054093:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e334 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054100:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e334 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395269.054111:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1789395269.054201:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054209:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054215:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054222:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054227:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395269.054231:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054242:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054256:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4cb041e00) 00010000:00010000:0.0:1789395269.054259:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395269.054263:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054270:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e326 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054286:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054292:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054298:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054303:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395269.054305:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054311:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054318:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4cb041200) 00010000:00010000:0.0:1789395269.054321:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395269.054324:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e32d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054378:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e31f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068f5 expref: 91 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054447:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e334 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068f5 expref: 90 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.054455:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395269.054457:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395269.054460:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376a00, rc 0) 00000100:00100000:0.0:1789395269.054536:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+90:22276:x1876316231943808:12345-192.168.203.54@tcp:101:dd.0 Request processed in 786us (1020us total) trans 4294968678 rc 0/0 00000100:00100000:0.0:1789395269.054545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23970 00000100:00080000:2.0:1789395269.055169:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395269.062677:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.062734:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.062809:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231944192 00000100:00100000:0.0:1789395269.062821:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231944192 00000100:00100000:0.0:1789395269.062897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5274 00000100:00100000:0.0:1789395269.062908:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+90:22276:x1876316231944192:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395269.064007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+91:22276:x1876316231944192:12345-192.168.203.54@tcp:35:dd.0 Request processed in 1092us (1337us total) trans 4294968679 rc 0/0 00000100:00100000:0.0:1789395269.064021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5274 00000100:00100000:3.0:1789395269.064126:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231943936 00000100:00100000:3.0:1789395269.064137:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231943936 00000100:00100000:3.0:1789395269.064199:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1437 00000100:00100000:3.0:1789395269.064208:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+91:2396:x1876316231943936:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395269.064221:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395269.064248:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e334 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068f5 expref: 91 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.064272:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.064278:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395269.064314:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+90:2396:x1876316231943936:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 108us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.064321:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1437 00000100:00100000:3.0:1789395269.080234:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.080364:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231944320 00000100:00100000:2.0:1789395269.080377:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231944320 00002000:00100000:2.0:1789395269.080500:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (4096->12287) req@ffff89a3ca3e2d80 x1876316231944320/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.080513:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e2d80 with x1876316231944320 ext(4096->12287) 00002000:00010000:2.0:1789395269.080519:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e2d80 00000100:00100000:2.0:1789395269.080566:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 93 00000100:00100000:2.0:1789395269.080579:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231944320:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:0.0:1789395269.080718:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789395269.082134:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231944320:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1546us (1904us total) trans 4294969985 rc 0/0 00000100:00100000:2.0:1789395269.082149:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 93 00002000:00100000:2.0:1789395269.082163:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (4096->12287) req@ffff89a3ca3e2d80 x1876316231944320/t4294969985(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.082182:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e2d80 with x1876316231944320 ext(4096->12287) 00002000:00010000:2.0:1789395269.082189:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e2d80 00000100:00100000:1.0:1789395269.095238:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.095365:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231944448 00000100:00100000:3.0:1789395269.095378:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231944448 00000100:00100000:3.0:1789395269.095483:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5413 00000100:00100000:3.0:1789395269.095494:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231944448:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.102743:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969985 is committed 00000100:00100000:2.0:1789395269.117956:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231944448:12345-192.168.203.54@tcp:16:dd.0 Request processed in 22447us (22717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.117972:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5413 00000100:00100000:1.0:1789395269.146333:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.146425:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231944704 00000100:00100000:3.0:1789395269.146439:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231944704 00000100:00100000:3.0:1789395269.146510:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23971 00000100:00100000:3.0:1789395269.146520:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+90:22277:x1876316231944704:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395269.146553:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395269.146578:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e342 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021068fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146713:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146727:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146739:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146751:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146757:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146764:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146822:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e357 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146830:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e357 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146836:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e357 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395269.146847:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:3.0:1789395269.146945:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146953:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146960:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146967:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146973:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.146977:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146985:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.146998:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d300) 00010000:00010000:3.0:1789395269.147001:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.147005:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147012:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e349 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147027:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147034:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147046:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147053:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.147055:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147062:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147069:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d500) 00010000:00010000:3.0:1789395269.147071:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.147074:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147081:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e350 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147133:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e342 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068fc expref: 93 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147150:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e357 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068fc expref: 92 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.147158:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.147161:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395269.147164:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51bc00, rc 0) 00000100:00100000:3.0:1789395269.147241:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:22277:x1876316231944704:12345-192.168.203.54@tcp:101:dd.0 Request processed in 722us (922us total) trans 4294968680 rc 0/0 00000100:00100000:3.0:1789395269.147252:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23971 00000100:00100000:3.0:1789395269.157934:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.158002:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.158899:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231944832 00000100:00100000:2.0:1789395269.158915:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231944832 00000100:00100000:2.0:1789395269.159016:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1438 00000100:00100000:2.0:1789395269.159028:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4c3880c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:2397:x1876316231944832:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395269.159048:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395269.159087:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e357 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021068fc expref: 92 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.159112:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.159118:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395269.159199:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4c3880c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+91:2397:x1876316231944832:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 173us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.159207:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1438 00000100:00100000:1.0:1789395269.159472:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231945088 00000100:00100000:1.0:1789395269.159478:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231945088 00000100:00100000:1.0:1789395269.159513:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5275 00000100:00100000:1.0:1789395269.159521:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+91:22277:x1876316231945088:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395269.159842:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:22277:x1876316231945088:12345-192.168.203.54@tcp:35:dd.0 Request processed in 321us (1938us total) trans 4294968681 rc 0/0 00000100:00100000:1.0:1789395269.159850:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5275 00000100:00100000:0.0:1789395269.170326:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.170428:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231945216 00000100:00100000:1.0:1789395269.170442:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231945216 00002000:00100000:1.0:1789395269.170515:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (8192->16383) req@ffff89a4f783c850 x1876316231945216/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.170529:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f783c850 with x1876316231945216 ext(8192->16383) 00002000:00010000:1.0:1789395269.170537:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4f783c850 00000100:00100000:1.0:1789395269.170577:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 94 00000100:00100000:1.0:1789395269.170588:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231945216:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395269.172292:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231945216:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1692us (1967us total) trans 4294969987 rc 0/0 00000100:00100000:1.0:1789395269.172308:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 94 00002000:00100000:1.0:1789395269.172323:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (8192->16383) req@ffff89a4f783c850 x1876316231945216/t4294969987(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.172335:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4f783c850 with x1876316231945216 ext(8192->16383) 00002000:00010000:1.0:1789395269.172342:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4f783c850 00000100:00100000:3.0:1789395269.178602:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.178755:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231945344 00000100:00100000:2.0:1789395269.178768:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231945344 00000100:00100000:2.0:1789395269.178840:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5414 00000100:00100000:2.0:1789395269.178852:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231945344:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.183676:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969987 is committed 00000100:00100000:2.0:1789395269.188665:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231945344:12345-192.168.203.54@tcp:16:dd.0 Request processed in 9798us (10062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.188682:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5414 00000100:00100000:3.0:1789395269.202864:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.203162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231945600 00000100:00100000:2.0:1789395269.203177:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231945600 00000100:00100000:2.0:1789395269.203266:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23972 00000100:00100000:2.0:1789395269.203280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+92:22278:x1876316231945600:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395269.203311:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395269.203343:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e365 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106903 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205543:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205574:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205588:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205609:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205617:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205623:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205690:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e37a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205700:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e37a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205706:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e37a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395269.205721:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 12288 00010000:00010000:3.0:1789395269.205821:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205830:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205837:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205845:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205851:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.205856:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205865:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205879:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3700) 00010000:00010000:3.0:1789395269.205882:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.205887:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205893:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e36c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205908:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205919:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205936:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205941:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.205944:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205950:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205958:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d300) 00010000:00010000:3.0:1789395269.205960:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.205971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.205978:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e373 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.206039:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e365 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106903 expref: 95 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.206074:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e37a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106903 expref: 94 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.206083:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.206085:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395269.206089:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51aa00, rc 0) 00000100:00100000:3.0:1789395269.206248:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+94:22278:x1876316231945600:12345-192.168.203.54@tcp:101:dd.0 Request processed in 2971us (3404us total) trans 4294968682 rc 0/0 00000100:00100000:3.0:1789395269.206259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23972 00000100:00100000:0.0:1789395269.214362:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.214470:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.214564:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231945728 00000100:00100000:2.0:1789395269.214577:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231945728 00000100:00100000:3.0:1789395269.214649:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231945984 00000100:00100000:3.0:1789395269.214654:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231945984 00000100:00100000:2.0:1789395269.214658:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1439 00000100:00100000:2.0:1789395269.214668:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+95:2398:x1876316231945728:12345-192.168.203.54@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789395269.214683:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5276 00010000:00010000:2.0:1789395269.214689:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789395269.214690:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+95:22278:x1876316231945984:12345-192.168.203.54@tcp:35:dd.0 00010000:00010000:2.0:1789395269.214716:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e37a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106903 expref: 95 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.214738:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.214744:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395269.214811:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+94:2398:x1876316231945728:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 143us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.214819:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1439 00000100:00100000:3.0:1789395269.217166:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+94:22278:x1876316231945984:12345-192.168.203.54@tcp:35:dd.0 Request processed in 2396us (2739us total) trans 4294968683 rc 0/0 00000100:00100000:3.0:1789395269.217187:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5276 00000100:00100000:0.0:1789395269.241759:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.242246:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231946112 00000100:00100000:1.0:1789395269.242256:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231946112 00002000:00100000:1.0:1789395269.242309:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (12288->20479) req@ffff89a3ca20ca80 x1876316231946112/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.242320:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20ca80 with x1876316231946112 ext(12288->20479) 00002000:00010000:1.0:1789395269.242327:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20ca80 00000100:00100000:1.0:1789395269.242375:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 95 00000100:00100000:1.0:1789395269.242414:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231946112:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395269.248526:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231946112:12345-192.168.203.54@tcp:4:dd.0 Request processed in 6125us (6759us total) trans 4294969989 rc 0/0 00000100:00100000:1.0:1789395269.248547:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 95 00002000:00100000:1.0:1789395269.248565:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (12288->20479) req@ffff89a3ca20ca80 x1876316231946112/t4294969989(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.248577:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20ca80 with x1876316231946112 ext(12288->20479) 00002000:00010000:1.0:1789395269.248585:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20ca80 00000100:00100000:2.0:1789395269.253866:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.253976:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231946240 00000100:00100000:0.0:1789395269.253994:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231946240 00000100:00100000:0.0:1789395269.254079:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5415 00000100:00100000:0.0:1789395269.254100:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231946240:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395269.263878:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969989 is committed 00000100:00100000:0.0:1789395269.264289:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231946240:12345-192.168.203.54@tcp:16:dd.0 Request processed in 10191us (10424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395269.264303:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5415 00000100:00100000:1.0:1789395269.282721:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.283046:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231946496 00000100:00100000:0.0:1789395269.283071:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231946496 00000100:00100000:0.0:1789395269.283149:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23973 00000100:00100000:0.0:1789395269.283161:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+94:22279:x1876316231946496:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395269.283190:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395269.283216:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e388 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210690a expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283356:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283371:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283405:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283420:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283431:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283438:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283503:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e39d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283513:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e39d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283521:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e39d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395269.283533:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 16384 00010000:00010000:0.0:1789395269.283620:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283629:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283635:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283641:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395269.283646:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283654:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283670:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89500) 00010000:00010000:0.0:1789395269.283673:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395269.283678:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283684:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e38f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283701:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283707:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283712:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283716:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395269.283719:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283725:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283732:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4fbb89200) 00010000:00010000:0.0:1789395269.283735:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395269.283738:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283743:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e396 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283792:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e388 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210690a expref: 97 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283810:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e39d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210690a expref: 96 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.283817:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395269.283820:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395269.283823:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376000, rc 0) 00000100:00100000:0.0:1789395269.283908:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22279:x1876316231946496:12345-192.168.203.54@tcp:101:dd.0 Request processed in 749us (1200us total) trans 4294968684 rc 0/0 00000100:00100000:0.0:1789395269.283917:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23973 00000100:00100000:3.0:1789395269.292929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.292984:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.293084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231946880 00000100:00100000:2.0:1789395269.293099:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231946880 00000100:00100000:2.0:1789395269.293179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5277 00000100:00100000:2.0:1789395269.293193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22279:x1876316231946880:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395269.293207:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231946624 00000100:00100000:1.0:1789395269.293227:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231946624 00000100:00100000:1.0:1789395269.293300:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1440 00000100:00100000:1.0:1789395269.293313:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+97:2395:x1876316231946624:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395269.293331:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395269.293360:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e39d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210690a expref: 97 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.293445:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395269.293452:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395269.293519:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+97:2395:x1876316231946624:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 208us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395269.293530:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1440 00000100:00100000:2.0:1789395269.293563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22279:x1876316231946880:12345-192.168.203.54@tcp:35:dd.0 Request processed in 371us (573us total) trans 4294968685 rc 0/0 00000100:00100000:2.0:1789395269.293573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5277 00000100:00100000:1.0:1789395269.306641:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.306767:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231947008 00000100:00100000:2.0:1789395269.306782:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231947008 00002000:00100000:2.0:1789395269.306846:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (16384->24575) req@ffff89a3cadc5880 x1876316231947008/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.306858:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc5880 with x1876316231947008 ext(16384->24575) 00002000:00010000:2.0:1789395269.306865:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc5880 00000100:00100000:2.0:1789395269.306949:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 96 00000100:00100000:2.0:1789395269.306960:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231947008:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395269.321636:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231947008:12345-192.168.203.54@tcp:4:dd.0 Request processed in 14659us (14993us total) trans 4294969991 rc 0/0 00000100:00100000:2.0:1789395269.321655:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 96 00002000:00100000:2.0:1789395269.321673:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (16384->24575) req@ffff89a3cadc5880 x1876316231947008/t4294969991(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.321686:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc5880 with x1876316231947008 ext(16384->24575) 00002000:00010000:2.0:1789395269.321695:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc5880 00000100:00100000:1.0:1789395269.335202:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.335480:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231947136 00000100:00100000:3.0:1789395269.335494:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231947136 00000100:00100000:3.0:1789395269.335573:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5416 00000100:00100000:3.0:1789395269.335585:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231947136:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395269.337571:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969991 is committed 00000100:00100000:3.0:1789395269.338772:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231947136:12345-192.168.203.54@tcp:16:dd.0 Request processed in 3176us (3580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.338790:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5416 00000100:00100000:0.0:1789395269.365695:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.366024:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231947392 00000100:00100000:3.0:1789395269.366037:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231947392 00000100:00100000:3.0:1789395269.366113:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23974 00000100:00100000:3.0:1789395269.366125:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+96:22280:x1876316231947392:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395269.366155:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395269.366191:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e3ab lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106911 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.366886:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.366905:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.366928:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.366945:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.366953:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.366960:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.367026:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e3c0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.367036:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e3c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.367044:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e3c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395269.367057:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 20480 00010000:00010000:3.0:1789395269.367152:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.367163:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.367171:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.367178:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369756:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.369768:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369782:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369803:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395269.369807:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.369812:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369821:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e3b2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369856:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369865:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369871:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369878:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.369882:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369888:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369896:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d600) 00010000:00010000:3.0:1789395269.369899:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.369902:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.369908:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e3b9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.370002:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e3ab lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106911 expref: 99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.370021:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e3c0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106911 expref: 98 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.370028:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.370031:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395269.370034:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51bc00, rc 0) 00000100:00100000:3.0:1789395269.370209:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+98:22280:x1876316231947392:12345-192.168.203.54@tcp:101:dd.0 Request processed in 4084us (4528us total) trans 4294968686 rc 0/0 00000100:00100000:3.0:1789395269.370219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23974 00010000:00010000:2.0:1789395269.371174:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395269.382129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.383023:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.383138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231947648 00000100:00100000:0.0:1789395269.383151:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231947648 00000100:00100000:0.0:1789395269.383231:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5278 00000100:00100000:0.0:1789395269.383242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+98:22280:x1876316231947648:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395269.383676:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+99:22280:x1876316231947648:12345-192.168.203.54@tcp:35:dd.0 Request processed in 434us (658us total) trans 4294968687 rc 0/0 00000100:00100000:0.0:1789395269.383686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5278 00000100:00100000:3.0:1789395269.383709:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231947776 00000100:00100000:3.0:1789395269.383717:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231947776 00000100:00100000:3.0:1789395269.383827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1441 00000100:00100000:3.0:1789395269.383838:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+99:2397:x1876316231947776:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395269.383851:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395269.383879:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e3c0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106911 expref: 99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.383901:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.383907:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395269.384014:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+98:2397:x1876316231947776:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 179us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.384023:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1441 00000100:00100000:1.0:1789395269.397651:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.398121:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231947904 00000100:00100000:2.0:1789395269.398137:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231947904 00002000:00100000:2.0:1789395269.398212:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (20480->28671) req@ffff89a3cadc6a00 x1876316231947904/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.398224:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc6a00 with x1876316231947904 ext(20480->28671) 00002000:00010000:2.0:1789395269.398231:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc6a00 00000100:00100000:2.0:1789395269.398276:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 97 00000100:00100000:2.0:1789395269.398288:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231947904:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395269.399979:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231947904:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1677us (2327us total) trans 4294969993 rc 0/0 00000100:00100000:2.0:1789395269.399996:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 97 00002000:00100000:2.0:1789395269.400010:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (20480->28671) req@ffff89a3cadc6a00 x1876316231947904/t4294969993(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.400021:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc6a00 with x1876316231947904 ext(20480->28671) 00002000:00010000:2.0:1789395269.400029:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc6a00 00000100:00100000:0.0:1789395269.414202:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.414527:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231948032 00000100:00100000:2.0:1789395269.414540:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231948032 00000100:00100000:2.0:1789395269.414606:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5417 00000100:00100000:2.0:1789395269.414618:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231948032:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.416150:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969993 is committed 00000100:00100000:2.0:1789395269.416429:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231948032:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1807us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.416442:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5417 00000100:00100000:0.0:1789395269.435519:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.435624:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231948288 00000100:00100000:3.0:1789395269.435639:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231948288 00000100:00100000:2.0:1789395269.436596:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23975 00000100:00100000:2.0:1789395269.436613:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+98:22281:x1876316231948288:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395269.436643:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395269.436671:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e3ce lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106918 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436819:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436835:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436848:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436863:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436871:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436878:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436957:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e3e3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436967:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e3e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.436975:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e3e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395269.436986:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 24576 00010000:00010000:2.0:1789395269.437096:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437105:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437111:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437118:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437125:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.437130:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437139:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437153:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395269.437156:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.437161:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437167:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e3d5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437183:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437189:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437195:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437199:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.437202:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437208:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437219:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3200) 00010000:00010000:2.0:1789395269.437221:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.437223:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437229:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e3dc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.437278:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e3ce lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106918 expref: 101 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.440673:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106918 expref: 100 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.440707:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.440711:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395269.440716:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1000, rc 0) 00000100:00100000:2.0:1789395269.440913:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:22281:x1876316231948288:12345-192.168.203.54@tcp:101:dd.0 Request processed in 4298us (5401us total) trans 4294968688 rc 0/0 00000100:00100000:2.0:1789395269.440937:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23975 00000100:00100000:1.0:1789395269.446864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.447341:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231948544 00000100:00100000:0.0:1789395269.447356:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231948544 00000100:00100000:0.0:1789395269.447539:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5279 00000100:00100000:0.0:1789395269.447729:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:22281:x1876316231948544:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395269.448451:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+101:22281:x1876316231948544:12345-192.168.203.54@tcp:35:dd.0 Request processed in 898us (1597us total) trans 4294968689 rc 0/0 00000100:00100000:0.0:1789395269.448471:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5279 00000100:00100000:0.0:1789395269.451042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.451160:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231948672 00000100:00100000:2.0:1789395269.451172:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231948672 00000100:00100000:2.0:1789395269.451439:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1442 00000100:00100000:2.0:1789395269.451452:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+101:2397:x1876316231948672:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395269.451636:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395269.451666:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e3e3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106918 expref: 101 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.451694:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.451699:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395269.451776:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:2397:x1876316231948672:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 327us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.451785:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1442 00000100:00100000:2.0:1789395269.465219:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.465791:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231948800 00000100:00100000:1.0:1789395269.465804:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231948800 00002000:00100000:1.0:1789395269.465951:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (24576->32767) req@ffff89a3c9a6dc00 x1876316231948800/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.465965:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6dc00 with x1876316231948800 ext(24576->32767) 00002000:00010000:1.0:1789395269.465973:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6dc00 00000100:00100000:1.0:1789395269.466065:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 98 00000100:00100000:1.0:1789395269.466077:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231948800:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395269.468116:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231948800:12345-192.168.203.54@tcp:4:dd.0 Request processed in 2026us (2897us total) trans 4294969995 rc 0/0 00000100:00100000:1.0:1789395269.468132:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 98 00002000:00100000:1.0:1789395269.468146:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (24576->32767) req@ffff89a3c9a6dc00 x1876316231948800/t4294969995(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.468157:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6dc00 with x1876316231948800 ext(24576->32767) 00002000:00010000:1.0:1789395269.468165:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6dc00 00000100:00100000:1.0:1789395269.479246:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.479536:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231948928 00000100:00100000:3.0:1789395269.479548:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231948928 00000100:00100000:3.0:1789395269.479628:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5418 00000100:00100000:3.0:1789395269.479641:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231948928:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.483724:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969995 is committed 00000100:00100000:3.0:1789395269.484322:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231948928:12345-192.168.203.54@tcp:16:dd.0 Request processed in 4675us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.484336:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5418 00000100:00100000:0.0:1789395269.504939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.505078:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231949184 00000100:00100000:1.0:1789395269.505091:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231949184 00000100:00100000:1.0:1789395269.505165:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23976 00000100:00100000:1.0:1789395269.505176:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+100:22282:x1876316231949184:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395269.505203:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395269.505229:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e3f1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210691f expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505381:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505434:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505446:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505460:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505467:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505473:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505537:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e406 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505546:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e406 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505552:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e406 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395269.505562:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 28672 00010000:00010000:1.0:1789395269.505644:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505657:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505664:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505670:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395269.505675:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505683:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505695:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4e7d26f00) 00010000:00010000:1.0:1789395269.505697:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395269.505701:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505708:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e3f8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505723:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505729:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505735:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505740:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395269.505744:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505751:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505757:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4e7d26100) 00010000:00010000:1.0:1789395269.505759:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395269.505761:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505766:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e3ff lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505812:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e3f1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210691f expref: 103 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505826:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e406 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210691f expref: 102 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.505833:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395269.505835:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395269.505837:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215200, rc 0) 00000100:00100000:1.0:1789395269.505913:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+102:22282:x1876316231949184:12345-192.168.203.54@tcp:101:dd.0 Request processed in 739us (1003us total) trans 4294968690 rc 0/0 00000100:00100000:1.0:1789395269.505930:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23976 00000100:00100000:2.0:1789395269.512846:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.513715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231949440 00000100:00100000:3.0:1789395269.513729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231949440 00000100:00100000:3.0:1789395269.513811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5280 00000100:00100000:3.0:1789395269.513824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+102:22282:x1876316231949440:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395269.514104:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.514233:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231949568 00000100:00100000:1.0:1789395269.514240:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231949568 00000100:00100000:1.0:1789395269.514290:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1443 00000100:00100000:1.0:1789395269.514301:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:2395:x1876316231949568:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395269.514316:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789395269.514322:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22282:x1876316231949440:12345-192.168.203.54@tcp:35:dd.0 Request processed in 498us (1489us total) trans 4294968691 rc 0/0 00000100:00100000:3.0:1789395269.514333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5280 00010000:00010000:1.0:1789395269.514346:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e406 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210691f expref: 104 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.514369:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395269.514374:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395269.514448:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+102:2395:x1876316231949568:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 150us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395269.514455:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1443 00000100:00100000:2.0:1789395269.525982:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.526122:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231949696 00000100:00100000:3.0:1789395269.526136:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231949696 00002000:00100000:3.0:1789395269.526195:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (28672->36863) req@ffff89a3c9a6c380 x1876316231949696/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395269.526208:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6c380 with x1876316231949696 ext(28672->36863) 00002000:00010000:3.0:1789395269.526215:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6c380 00000100:00100000:3.0:1789395269.526255:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 99 00000100:00100000:3.0:1789395269.526265:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231949696:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395269.533587:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231949696:12345-192.168.203.54@tcp:4:dd.0 Request processed in 7307us (7605us total) trans 4294969997 rc 0/0 00000100:00100000:2.0:1789395269.533604:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 99 00002000:00100000:2.0:1789395269.533621:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (28672->36863) req@ffff89a3c9a6c380 x1876316231949696/t4294969997(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.533632:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6c380 with x1876316231949696 ext(28672->36863) 00002000:00010000:2.0:1789395269.533640:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6c380 00000100:00100000:2.0:1789395269.546545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.546670:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231949824 00000100:00100000:0.0:1789395269.546683:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231949824 00000100:00100000:0.0:1789395269.546817:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5419 00000100:00100000:0.0:1789395269.546829:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231949824:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.556847:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969997 is committed 00000100:00100000:2.0:1789395269.557251:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231949824:12345-192.168.203.54@tcp:16:dd.0 Request processed in 10416us (10712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.557265:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5419 00000100:00100000:0.0:1789395269.573513:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.573689:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231950080 00000100:00100000:2.0:1789395269.573702:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231950080 00000100:00100000:2.0:1789395269.573772:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23977 00000100:00100000:2.0:1789395269.573782:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+102:22283:x1876316231950080:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395269.573809:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395269.573836:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e414 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106926 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574036:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574051:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574212:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574231:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574239:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574246:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574313:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e429 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574322:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e429 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574329:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e429 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395269.574339:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 32768 00010000:00010000:2.0:1789395269.574473:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574487:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574493:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574500:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574506:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.574511:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574519:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574531:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395269.574534:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.574538:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574545:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e41b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574560:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574565:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574571:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574577:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.574581:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574586:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574592:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3200) 00010000:00010000:2.0:1789395269.574594:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.574597:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574602:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e422 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574647:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e414 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106926 expref: 105 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574661:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e429 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106926 expref: 104 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.574668:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.574670:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395269.574673:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4c148bc00, rc 0) 00000100:00100000:2.0:1789395269.574738:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22283:x1876316231950080:12345-192.168.203.54@tcp:101:dd.0 Request processed in 957us (1241us total) trans 4294968692 rc 0/0 00000100:00100000:2.0:1789395269.574746:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23977 00000100:00100000:0.0:1789395269.582713:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.582854:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231950336 00000100:00100000:1.0:1789395269.582866:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231950336 00000100:00100000:1.0:1789395269.582940:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5281 00000100:00100000:1.0:1789395269.582952:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d07450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22283:x1876316231950336:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395269.584622:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d07450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+105:22283:x1876316231950336:12345-192.168.203.54@tcp:35:dd.0 Request processed in 1661us (1913us total) trans 4294968693 rc 0/0 00000100:00100000:0.0:1789395269.584636:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5281 00000100:00100000:0.0:1789395269.591785:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.591881:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231950464 00000100:00100000:3.0:1789395269.591895:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231950464 00000100:00100000:3.0:1789395269.592115:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1444 00000100:00100000:3.0:1789395269.592129:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+105:2397:x1876316231950464:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395269.592149:0:8441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395269.592178:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e429 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106926 expref: 105 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.592203:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.592209:0:8441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395269.592285:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:2397:x1876316231950464:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 159us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.592294:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1444 00000100:00100000:1.0:1789395269.598832:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.598947:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231950592 00000100:00100000:2.0:1789395269.598960:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231950592 00002000:00100000:2.0:1789395269.599034:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (32768->40959) req@ffff89a3cadc4380 x1876316231950592/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.599046:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc4380 with x1876316231950592 ext(32768->40959) 00002000:00010000:2.0:1789395269.599054:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc4380 00000100:00100000:2.0:1789395269.599091:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 100 00000100:00100000:2.0:1789395269.599102:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231950592:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395269.604556:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231950592:12345-192.168.203.54@tcp:4:dd.0 Request processed in 5439us (5724us total) trans 4294969999 rc 0/0 00000100:00100000:2.0:1789395269.604573:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 100 00002000:00100000:2.0:1789395269.604589:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (32768->40959) req@ffff89a3cadc4380 x1876316231950592/t4294969999(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.604601:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc4380 with x1876316231950592 ext(32768->40959) 00002000:00010000:2.0:1789395269.604609:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc4380 00000100:00100000:0.0:1789395269.611354:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.611525:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231950720 00000100:00100000:2.0:1789395269.611538:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231950720 00000100:00100000:2.0:1789395269.611606:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5420 00000100:00100000:2.0:1789395269.611616:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231950720:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.618602:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969999 is committed 00000100:00100000:2.0:1789395269.618875:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231950720:12345-192.168.203.54@tcp:16:dd.0 Request processed in 7252us (7526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.618889:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5420 00000100:00100000:0.0:1789395269.666836:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.666943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231950976 00000100:00100000:3.0:1789395269.666956:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231950976 00000100:00100000:3.0:1789395269.667030:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23978 00000100:00100000:3.0:1789395269.667044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+104:22284:x1876316231950976:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395269.667083:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395269.667112:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e437 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210692d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667259:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667276:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667289:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667303:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667311:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667317:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667581:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e44c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667592:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e44c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667600:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e44c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395269.667616:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 36864 00010000:00010000:3.0:1789395269.667707:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667715:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667720:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667726:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667731:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.667736:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667742:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667753:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395269.667756:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.667759:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667766:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e43e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667781:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667790:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667795:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667799:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.667801:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667807:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667813:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d600) 00010000:00010000:3.0:1789395269.667815:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.667817:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667822:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e445 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667871:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e437 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210692d expref: 107 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667888:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e44c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210692d expref: 106 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.667895:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.667897:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395269.667901:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b000, rc 0) 00000100:00100000:3.0:1789395269.668000:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+106:22284:x1876316231950976:12345-192.168.203.54@tcp:101:dd.0 Request processed in 958us (1180us total) trans 4294968694 rc 0/0 00000100:00100000:3.0:1789395269.668009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23978 00000100:00100000:1.0:1789395269.685576:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.685636:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.685719:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231951232 00000100:00100000:3.0:1789395269.685731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231951232 00000100:00100000:3.0:1789395269.685809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5282 00000100:00100000:3.0:1789395269.685820:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+106:22284:x1876316231951232:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:3.0:1789395269.686216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+107:22284:x1876316231951232:12345-192.168.203.54@tcp:35:dd.0 Request processed in 396us (653us total) trans 4294968695 rc 0/0 00000100:00100000:3.0:1789395269.686225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5282 00000100:00100000:0.0:1789395269.690437:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231951360 00000100:00100000:0.0:1789395269.690458:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231951360 00000100:00100000:0.0:1789395269.690575:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1445 00000100:00100000:0.0:1789395269.690586:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4dfa90450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+107:2397:x1876316231951360:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395269.690606:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395269.690633:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e44c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210692d expref: 107 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395269.690656:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395269.690661:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395269.690858:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4dfa90450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+106:2397:x1876316231951360:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 273us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395269.690867:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1445 00000100:00100000:1.0:1789395269.702291:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.702437:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231951488 00000100:00100000:0.0:1789395269.702451:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231951488 00002000:00100000:0.0:1789395269.702517:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (36864->45055) req@ffff89a3cadc7b80 x1876316231951488/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395269.702530:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc7b80 with x1876316231951488 ext(36864->45055) 00002000:00010000:0.0:1789395269.702537:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc7b80 00000100:00100000:0.0:1789395269.702573:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 101 00000100:00100000:0.0:1789395269.702584:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231951488:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395269.706234:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231951488:12345-192.168.203.54@tcp:4:dd.0 Request processed in 3633us (3938us total) trans 4294970001 rc 0/0 00000100:00100000:0.0:1789395269.706254:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 101 00002000:00100000:0.0:1789395269.706274:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (36864->45055) req@ffff89a3cadc7b80 x1876316231951488/t4294970001(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395269.706286:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc7b80 with x1876316231951488 ext(36864->45055) 00002000:00010000:0.0:1789395269.706307:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc7b80 00000100:00100000:1.0:1789395269.722519:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.722645:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231951616 00000100:00100000:0.0:1789395269.722658:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231951616 00000100:00100000:0.0:1789395269.722732:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5421 00000100:00100000:0.0:1789395269.722744:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231951616:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395269.726450:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970001 is committed 00000100:00100000:0.0:1789395269.727199:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231951616:12345-192.168.203.54@tcp:16:dd.0 Request processed in 4447us (4685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395269.727214:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5421 00000100:00100000:2.0:1789395269.755219:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.757790:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231951872 00000100:00100000:1.0:1789395269.757810:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231951872 00000100:00100000:1.0:1789395269.757904:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23979 00000100:00100000:1.0:1789395269.757926:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+106:22285:x1876316231951872:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395269.757955:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395269.758290:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e45a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106934 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758470:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758487:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758501:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758518:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758525:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758533:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758600:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e46f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758611:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e46f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758619:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e46f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395269.758631:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 40960 00010000:00010000:1.0:1789395269.758727:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758740:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758747:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758753:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395269.758758:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758766:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758779:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4e7d26100) 00010000:00010000:1.0:1789395269.758783:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395269.758787:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758794:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e461 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758811:0:21735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758818:0:21735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758824:0:21735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758829:0:21735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395269.758833:0:21735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758839:0:21735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758846:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4e7d26b00) 00010000:00010000:1.0:1789395269.758849:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395269.758852:0:21735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758857:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e468 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758907:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e45a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106934 expref: 109 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758937:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e46f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106934 expref: 108 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.758945:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395269.758947:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395269.758950:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214200, rc 0) 00000100:00100000:1.0:1789395269.759237:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+108:22285:x1876316231951872:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1322us (4034us total) trans 4294968696 rc 0/0 00000100:00100000:1.0:1789395269.759247:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23979 00000100:00100000:1.0:1789395269.766210:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.766257:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.766566:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231952000 00000100:00100000:3.0:1789395269.766580:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231952000 00000100:00100000:3.0:1789395269.766665:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1446 00000100:00100000:3.0:1789395269.766677:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+108:2396:x1876316231952000:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395269.766696:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395269.766723:0:20671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e46f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106934 expref: 108 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.766748:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.766753:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789395269.766906:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+107:2396:x1876316231952000:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 230us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.766915:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1446 00000100:00100000:0.0:1789395269.767007:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231952256 00000100:00100000:0.0:1789395269.767012:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231952256 00000100:00100000:0.0:1789395269.767052:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5283 00000100:00100000:0.0:1789395269.767068:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+107:22285:x1876316231952256:12345-192.168.203.54@tcp:35:dd.0 00000001:00080000:0.0:1789395269.767344:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968697 00000100:00100000:0.0:1789395269.767471:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+109:22285:x1876316231952256:12345-192.168.203.54@tcp:35:dd.0 Request processed in 411us (1212us total) trans 4294968698 rc 0/0 00000100:00100000:0.0:1789395269.767478:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5283 00000020:00080000:0.0:1789395269.767482:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395269.784561:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.784780:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231952384 00000100:00100000:2.0:1789395269.784794:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231952384 00002000:00100000:2.0:1789395269.784859:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (40960->49151) req@ffff89a3ca20d500 x1876316231952384/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.784871:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20d500 with x1876316231952384 ext(40960->49151) 00002000:00010000:2.0:1789395269.784878:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20d500 00000100:00100000:2.0:1789395269.784926:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 102 00000100:00100000:2.0:1789395269.784938:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231952384:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395269.786651:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231952384:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1705us (2095us total) trans 4294970003 rc 0/0 00000100:00100000:2.0:1789395269.786667:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 102 00002000:00100000:2.0:1789395269.786681:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (40960->49151) req@ffff89a3ca20d500 x1876316231952384/t4294970003(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395269.786691:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20d500 with x1876316231952384 ext(40960->49151) 00002000:00010000:2.0:1789395269.786698:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20d500 00000100:00100000:2.0:1789395269.803649:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.803841:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231952512 00000100:00100000:3.0:1789395269.803854:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231952512 00000100:00100000:3.0:1789395269.803935:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5422 00000100:00100000:3.0:1789395269.803948:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231952512:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.807856:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970003 is committed 00000100:00100000:3.0:1789395269.809869:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231952512:12345-192.168.203.54@tcp:16:dd.0 Request processed in 5907us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.809886:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5422 00000100:00100000:1.0:1789395269.829077:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.829676:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231952768 00000100:00100000:2.0:1789395269.829689:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231952768 00000100:00100000:2.0:1789395269.829768:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23980 00000100:00100000:2.0:1789395269.829780:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+109:22286:x1876316231952768:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395269.829808:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395269.829832:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e47d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210693b expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830701:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830721:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830734:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830750:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830757:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830764:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830834:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e492 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830843:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e492 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830850:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e492 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395269.830861:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 45056 00010000:00010000:2.0:1789395269.830967:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830981:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830988:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.830995:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831002:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.831008:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831016:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831028:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395269.831031:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.831035:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831041:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e484 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831056:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831063:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831068:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831073:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.831075:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831081:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831092:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3200) 00010000:00010000:2.0:1789395269.831095:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.831097:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831104:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e48b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831158:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e47d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210693b expref: 112 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831172:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e492 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210693b expref: 111 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.831179:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.831182:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395269.831184:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1800, rc 0) 00000100:00100000:2.0:1789395269.831258:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+111:22286:x1876316231952768:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1481us (2208us total) trans 4294968699 rc 0/0 00000100:00100000:2.0:1789395269.831267:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23980 00000100:00100000:0.0:1789395269.836872:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.836983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231953024 00000100:00100000:1.0:1789395269.836995:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231953024 00000100:00100000:1.0:1789395269.837059:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5284 00000100:00100000:1.0:1789395269.837070:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+111:22286:x1876316231953024:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395269.837625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+112:22286:x1876316231953024:12345-192.168.203.54@tcp:35:dd.0 Request processed in 554us (765us total) trans 4294968700 rc 0/0 00000100:00100000:1.0:1789395269.837634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5284 00000100:00100000:0.0:1789395269.840466:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.840615:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231953152 00000100:00100000:2.0:1789395269.840628:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231953152 00000100:00100000:2.0:1789395269.840707:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1447 00000100:00100000:2.0:1789395269.840719:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+112:2398:x1876316231953152:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395269.840738:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395269.840767:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e492 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210693b expref: 112 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.840795:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.840801:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395269.840871:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+111:2398:x1876316231953152:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 154us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.840879:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1447 00000100:00100000:2.0:1789395269.846930:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.847124:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231953280 00000100:00100000:1.0:1789395269.847136:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231953280 00002000:00100000:1.0:1789395269.847204:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (45056->53247) req@ffff89a3c9a6c000 x1876316231953280/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.847218:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6c000 with x1876316231953280 ext(45056->53247) 00002000:00010000:1.0:1789395269.847225:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6c000 00000100:00100000:1.0:1789395269.847269:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 103 00000100:00100000:1.0:1789395269.847280:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231953280:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395269.848752:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231953280:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1464us (1837us total) trans 4294970005 rc 0/0 00000100:00100000:1.0:1789395269.848766:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 103 00002000:00100000:1.0:1789395269.848779:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (45056->53247) req@ffff89a3c9a6c000 x1876316231953280/t4294970005(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.848790:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6c000 with x1876316231953280 ext(45056->53247) 00002000:00010000:1.0:1789395269.848797:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6c000 00000100:00100000:0.0:1789395269.858868:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.859054:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231953408 00000100:00100000:2.0:1789395269.859078:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231953408 00000100:00100000:2.0:1789395269.859149:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5423 00000100:00100000:2.0:1789395269.859160:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231953408:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395269.860944:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970005 is committed 00000100:00100000:2.0:1789395269.861421:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231953408:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2221us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.861435:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5423 00000100:00100000:0.0:1789395269.879202:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.879316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231953664 00000100:00100000:3.0:1789395269.879329:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231953664 00000100:00100000:3.0:1789395269.879442:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23981 00000100:00100000:3.0:1789395269.879455:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+111:22287:x1876316231953664:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395269.879483:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395269.879509:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e4a0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106942 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879795:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879811:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879823:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879837:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879844:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879849:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879930:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e4b5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e4b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.879948:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e4b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395269.879959:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 49152 00010000:00010000:3.0:1789395269.880052:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880068:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880076:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880082:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880088:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.880093:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880100:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880113:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395269.880116:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.880121:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880127:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4a7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880142:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880148:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880153:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880159:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.880161:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880165:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d600) 00010000:00010000:3.0:1789395269.880173:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.880176:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880182:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ae lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880228:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e4a0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106942 expref: 114 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880247:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e4b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106942 expref: 113 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.880255:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.880257:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395269.880260:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ba00, rc 0) 00000100:00100000:3.0:1789395269.880327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+113:22287:x1876316231953664:12345-192.168.203.54@tcp:101:dd.0 Request processed in 876us (1139us total) trans 4294968701 rc 0/0 00000100:00100000:3.0:1789395269.880335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23981 00000100:00100000:1.0:1789395269.892121:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.892174:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.892269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231953920 00000100:00100000:3.0:1789395269.892283:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231953920 00000100:00100000:3.0:1789395269.892365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5285 00000100:00100000:3.0:1789395269.892377:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+113:22287:x1876316231953920:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:3.0:1789395269.892775:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+114:22287:x1876316231953920:12345-192.168.203.54@tcp:35:dd.0 Request processed in 399us (668us total) trans 4294968702 rc 0/0 00000100:00100000:3.0:1789395269.892784:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5285 00000100:00100000:2.0:1789395269.892960:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231954048 00000100:00100000:2.0:1789395269.892966:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231954048 00000100:00100000:2.0:1789395269.893019:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1448 00000100:00100000:2.0:1789395269.893027:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+114:2397:x1876316231954048:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395269.893037:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395269.893065:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e4b5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106942 expref: 114 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.893085:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.893090:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395269.893113:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+113:2397:x1876316231954048:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 88us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.893124:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1448 00000100:00100000:0.0:1789395269.902711:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.902834:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231954176 00000100:00100000:1.0:1789395269.902860:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231954176 00002000:00100000:1.0:1789395269.902934:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (49152->57343) req@ffff89a3ca20ed80 x1876316231954176/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.902946:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20ed80 with x1876316231954176 ext(49152->57343) 00002000:00010000:1.0:1789395269.902953:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20ed80 00000100:00100000:1.0:1789395269.902985:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 104 00000100:00100000:1.0:1789395269.902995:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231954176:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395269.904786:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231954176:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1780us (2076us total) trans 4294970007 rc 0/0 00000100:00100000:1.0:1789395269.904801:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 104 00002000:00100000:1.0:1789395269.904815:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (49152->57343) req@ffff89a3ca20ed80 x1876316231954176/t4294970007(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395269.904826:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20ed80 with x1876316231954176 ext(49152->57343) 00002000:00010000:1.0:1789395269.904832:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20ed80 00000100:00100000:0.0:1789395269.910080:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.910192:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231954304 00000100:00100000:3.0:1789395269.910206:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231954304 00000100:00100000:3.0:1789395269.910285:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5424 00000100:00100000:3.0:1789395269.910511:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231954304:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395269.914644:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970007 is committed 00000100:00100000:3.0:1789395269.914856:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231954304:12345-192.168.203.54@tcp:16:dd.0 Request processed in 4553us (4784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395269.914870:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5424 00000100:00100000:2.0:1789395269.937585:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.937745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231954560 00000100:00100000:3.0:1789395269.937760:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231954560 00000100:00100000:3.0:1789395269.937830:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23982 00000100:00100000:3.0:1789395269.937842:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+113:22288:x1876316231954560:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395269.937884:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395269.937927:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e4c3 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106949 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938079:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938096:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938108:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938123:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938129:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938135:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938220:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e4d8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938231:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e4d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938239:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e4d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395269.938251:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 53248 00010000:00010000:3.0:1789395269.938347:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938355:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938362:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938369:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938375:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.938430:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938439:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938454:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395269.938457:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.938462:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938469:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e4ca lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938485:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938496:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938501:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938506:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395269.938509:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938516:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938523:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d600) 00010000:00010000:3.0:1789395269.938526:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395269.938528:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938535:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e4d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938585:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e4c3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106949 expref: 116 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938602:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e4d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106949 expref: 115 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395269.938609:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395269.938611:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395269.938614:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ac00, rc 0) 00000100:00100000:3.0:1789395269.938689:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+115:22288:x1876316231954560:12345-192.168.203.54@tcp:101:dd.0 Request processed in 850us (1119us total) trans 4294968703 rc 0/0 00000100:00100000:3.0:1789395269.938698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23982 00000100:00100000:0.0:1789395269.945026:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395269.945090:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395269.945315:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231954688 00000100:00100000:1.0:1789395269.945328:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231954688 00000100:00100000:1.0:1789395269.945431:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1449 00000100:00100000:1.0:1789395269.945444:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+115:2396:x1876316231954688:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395269.945465:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395269.945493:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e4d8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106949 expref: 115 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395269.945518:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395269.945523:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395269.945598:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+114:2396:x1876316231954688:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 156us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395269.945605:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1449 00000100:00100000:2.0:1789395269.946707:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231954944 00000100:00100000:2.0:1789395269.946720:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231954944 00000100:00100000:2.0:1789395269.946777:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5286 00000100:00100000:2.0:1789395269.946786:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+114:22288:x1876316231954944:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:2.0:1789395269.947164:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+115:22288:x1876316231954944:12345-192.168.203.54@tcp:35:dd.0 Request processed in 377us (2071us total) trans 4294968704 rc 0/0 00000100:00100000:2.0:1789395269.947173:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5286 00000100:00100000:0.0:1789395269.955817:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395269.956059:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231955072 00000100:00100000:3.0:1789395269.956072:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231955072 00002000:00100000:3.0:1789395269.956142:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (53248->61439) req@ffff89a4ffb6f800 x1876316231955072/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/0 e 0 to 0 dl 1789395280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395269.956155:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb6f800 with x1876316231955072 ext(53248->61439) 00002000:00010000:3.0:1789395269.956162:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4ffb6f800 00000100:00100000:3.0:1789395269.956204:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 105 00000100:00100000:3.0:1789395269.956214:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231955072:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395269.961113:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231955072:12345-192.168.203.54@tcp:4:dd.0 Request processed in 4883us (5294us total) trans 4294970009 rc 0/0 00000100:00100000:3.0:1789395269.961133:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 105 00002000:00100000:3.0:1789395269.961150:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (53248->61439) req@ffff89a4ffb6f800 x1876316231955072/t4294970009(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:735/0 lens 8680/448 e 0 to 0 dl 1789395280 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395269.961162:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ffb6f800 with x1876316231955072 ext(53248->61439) 00002000:00010000:3.0:1789395269.961170:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4ffb6f800 00000100:00100000:0.0:1789395269.965703:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.966011:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231955200 00000100:00100000:2.0:1789395269.966028:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231955200 00000100:00100000:2.0:1789395269.966106:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5425 00000100:00100000:2.0:1789395269.966118:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231955200:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395269.968642:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970009 is committed 00000100:00100000:2.0:1789395269.968871:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231955200:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2747us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395269.968885:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5425 00000100:00100000:0.0:1789395269.983727:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395269.984037:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231955456 00000100:00100000:2.0:1789395269.984051:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231955456 00000100:00100000:2.0:1789395269.984169:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23983 00000100:00100000:2.0:1789395269.984181:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+115:22289:x1876316231955456:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395269.984209:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395269.984237:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e4e6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106950 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984446:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984463:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984477:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984492:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984499:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984505:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984570:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e4fb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984580:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e4fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984587:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e4fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395269.984598:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 57344 00010000:00010000:2.0:1789395269.984689:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984697:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984704:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984712:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984718:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.984723:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984731:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984744:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3e00) 00010000:00010000:2.0:1789395269.984748:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.984753:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984760:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e4ed lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984776:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984782:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984787:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984792:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e0800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395269.984795:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984806:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984814:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4c92e3200) 00010000:00010000:2.0:1789395269.984817:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395269.984819:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.984825:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e4f4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.985111:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e4e6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106950 expref: 118 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.985130:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e4fb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106950 expref: 117 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395269.985138:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395269.985141:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789395269.985144:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4c148b400, rc 0) 00000100:00100000:2.0:1789395269.985334:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+117:22289:x1876316231955456:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1154us (1620us total) trans 4294968705 rc 0/0 00000100:00100000:2.0:1789395269.985343:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23983 00000100:00100000:0.0:1789395270.000640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.000770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.000866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231955840 00000100:00100000:1.0:1789395270.000878:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231955840 00000100:00100000:1.0:1789395270.000964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5287 00000100:00100000:1.0:1789395270.000977:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+117:22289:x1876316231955840:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:1.0:1789395270.001359:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+118:22289:x1876316231955840:12345-192.168.203.54@tcp:35:dd.0 Request processed in 383us (586us total) trans 4294968706 rc 0/0 00000100:00100000:1.0:1789395270.001368:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5287 00000100:00100000:2.0:1789395270.006817:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231955584 00000100:00100000:2.0:1789395270.006837:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231955584 00000100:00100000:2.0:1789395270.007003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1450 00000100:00100000:2.0:1789395270.007016:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+118:2398:x1876316231955584:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395270.007037:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395270.007069:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e4fb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106950 expref: 118 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.007093:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395270.007099:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395270.007216:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+117:2398:x1876316231955584:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 203us (6592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.007224:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1450 00000100:00100000:0.0:1789395270.010243:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.010437:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231955968 00000100:00100000:1.0:1789395270.010450:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231955968 00002000:00100000:1.0:1789395270.010515:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (57344->65535) req@ffff89a4e7f60700 x1876316231955968/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395270.010529:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f60700 with x1876316231955968 ext(57344->65535) 00002000:00010000:1.0:1789395270.010536:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4e7f60700 00000100:00100000:1.0:1789395270.010712:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 106 00000100:00100000:1.0:1789395270.010724:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231955968:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395270.012663:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231955968:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1927us (2421us total) trans 4294970011 rc 0/0 00000100:00100000:1.0:1789395270.012679:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 106 00002000:00100000:1.0:1789395270.012696:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (57344->65535) req@ffff89a4e7f60700 x1876316231955968/t4294970011(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395270.012707:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f60700 with x1876316231955968 ext(57344->65535) 00002000:00010000:1.0:1789395270.012716:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4e7f60700 00000100:00100000:0.0:1789395270.017182:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.017289:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231956096 00000100:00100000:2.0:1789395270.017369:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231956096 00000100:00100000:2.0:1789395270.017587:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5426 00000100:00100000:2.0:1789395270.017600:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231956096:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395270.019142:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970011 is committed 00000100:00100000:2.0:1789395270.019643:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231956096:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2039us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.019656:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5426 00000100:00100000:0.0:1789395270.031150:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.031237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231956352 00000100:00100000:3.0:1789395270.031250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231956352 00000100:00100000:3.0:1789395270.031331:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23984 00000100:00100000:3.0:1789395270.031344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+117:22290:x1876316231956352:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395270.031373:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.031618:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e509 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106957 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031770:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031787:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031801:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031816:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031823:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031831:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031910:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e51e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031931:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e51e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.031938:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e51e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395270.031950:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 61440 00010000:00010000:3.0:1789395270.032050:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032062:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032069:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032076:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032081:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395270.032086:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032094:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032106:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:3.0:1789395270.032110:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395270.032114:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032121:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e510 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032135:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032141:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032146:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032151:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395270.032154:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032159:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032166:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d600) 00010000:00010000:3.0:1789395270.032168:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395270.032171:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e517 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032228:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e509 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106957 expref: 120 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032244:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e51e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106957 expref: 119 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.032252:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395270.032255:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395270.032258:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ac00, rc 0) 00000100:00100000:3.0:1789395270.032330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+119:22290:x1876316231956352:12345-192.168.203.54@tcp:101:dd.0 Request processed in 987us (1194us total) trans 4294968707 rc 0/0 00000100:00100000:3.0:1789395270.032338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23984 00000100:00100000:1.0:1789395270.039050:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.039100:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.039182:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231956480 00000100:00100000:2.0:1789395270.039195:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231956480 00000100:00100000:2.0:1789395270.039276:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1451 00000100:00100000:2.0:1789395270.039287:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+119:2395:x1876316231956480:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395270.039313:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395270.039341:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e51e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106957 expref: 119 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.039362:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395270.039369:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395270.039493:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+118:2395:x1876316231956480:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 207us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.039501:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1451 00000100:00100000:3.0:1789395270.040020:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231956736 00000100:00100000:3.0:1789395270.040027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231956736 00000100:00100000:3.0:1789395270.040077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5288 00000100:00100000:3.0:1789395270.040085:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+118:22290:x1876316231956736:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:3.0:1789395270.040446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+119:22290:x1876316231956736:12345-192.168.203.54@tcp:35:dd.0 Request processed in 361us (1411us total) trans 4294968708 rc 0/0 00000100:00100000:3.0:1789395270.040454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5288 00000100:00100000:1.0:1789395270.053650:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.053754:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231956864 00000100:00100000:0.0:1789395270.053766:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231956864 00002000:00100000:0.0:1789395270.053830:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (61440->69631) req@ffff89a3cadc6d80 x1876316231956864/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395270.053842:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc6d80 with x1876316231956864 ext(61440->69631) 00002000:00010000:0.0:1789395270.053850:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc6d80 00000100:00100000:0.0:1789395270.053885:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 107 00000100:00100000:0.0:1789395270.053895:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231956864:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:0.0:1789395270.055737:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231956864:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1826us (2088us total) trans 4294970013 rc 0/0 00000100:00100000:0.0:1789395270.055753:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 107 00002000:00100000:0.0:1789395270.055768:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (61440->69631) req@ffff89a3cadc6d80 x1876316231956864/t4294970013(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395270.055779:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc6d80 with x1876316231956864 ext(61440->69631) 00002000:00010000:0.0:1789395270.055786:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc6d80 00000100:00100000:2.0:1789395270.062757:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.062855:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231956992 00000100:00100000:0.0:1789395270.062867:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231956992 00000100:00100000:0.0:1789395270.062948:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5427 00000100:00100000:0.0:1789395270.062961:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231956992:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395270.067430:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970013 is committed 00000100:00100000:0.0:1789395270.067764:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231956992:12345-192.168.203.54@tcp:16:dd.0 Request processed in 4798us (5012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.067778:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5427 00000100:00100000:2.0:1789395270.080874:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.081015:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231957248 00000100:00100000:3.0:1789395270.081029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231957248 00000100:00100000:3.0:1789395270.081098:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23985 00000100:00100000:3.0:1789395270.081111:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+119:22291:x1876316231957248:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395270.081140:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.081168:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e52c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210695e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.081319:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.081335:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.081346:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.081359:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.081366:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.081372:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082110:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e541 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082126:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e541 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082135:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e541 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395270.082146:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 65536 00010000:00010000:0.0:1789395270.082246:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082254:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082260:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082267:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082273:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.082279:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082298:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082312:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d000) 00010000:00010000:0.0:1789395270.082315:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.082320:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e533 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082345:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082352:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082358:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082364:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.082367:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082373:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082437:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d600) 00010000:00010000:0.0:1789395270.082440:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.082443:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082449:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e53a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082641:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e52c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210695e expref: 122 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082659:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e541 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210695e expref: 121 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.082668:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395270.082670:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395270.082673:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377a00, rc 0) 00000100:00100000:0.0:1789395270.082769:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+121:22291:x1876316231957248:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1660us (1907us total) trans 4294968709 rc 0/0 00000100:00100000:0.0:1789395270.082780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23985 00000100:00100000:1.0:1789395270.088700:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.088787:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231957504 00000100:00100000:0.0:1789395270.088801:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231957504 00000100:00100000:0.0:1789395270.088883:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5289 00000100:00100000:0.0:1789395270.088896:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+121:22291:x1876316231957504:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395270.089280:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+122:22291:x1876316231957504:12345-192.168.203.54@tcp:35:dd.0 Request processed in 384us (593us total) trans 4294968710 rc 0/0 00000100:00100000:0.0:1789395270.089289:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5289 00000100:00100000:3.0:1789395270.096844:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.096972:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231957632 00000100:00100000:1.0:1789395270.096986:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231957632 00000100:00100000:1.0:1789395270.097070:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1452 00000100:00100000:1.0:1789395270.097084:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4dfa92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+122:2396:x1876316231957632:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395270.097105:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395270.097134:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e541 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210695e expref: 122 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.097159:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395270.097165:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395270.097246:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4dfa92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+121:2396:x1876316231957632:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.097255:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1452 00000100:00100000:2.0:1789395270.101249:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.101521:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231957760 00000100:00100000:3.0:1789395270.101536:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231957760 00002000:00100000:3.0:1789395270.101596:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (65536->73727) req@ffff89a3ca15dc00 x1876316231957760/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395270.101608:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15dc00 with x1876316231957760 ext(65536->73727) 00002000:00010000:3.0:1789395270.101614:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15dc00 00000100:00100000:3.0:1789395270.101702:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 108 00000100:00100000:3.0:1789395270.101713:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231957760:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395270.103804:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2398:x1876316231957760:12345-192.168.203.54@tcp:4:dd.0 Request processed in 2078us (2555us total) trans 4294970015 rc 0/0 00000100:00100000:3.0:1789395270.103820:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 108 00002000:00100000:3.0:1789395270.103835:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (65536->73727) req@ffff89a3ca15dc00 x1876316231957760/t4294970015(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395270.103993:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15dc00 with x1876316231957760 ext(65536->73727) 00002000:00010000:3.0:1789395270.104002:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15dc00 00000100:00100000:2.0:1789395270.108048:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.108159:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231957888 00000100:00100000:3.0:1789395270.108171:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231957888 00000100:00100000:2.0:1789395270.108344:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5428 00000100:00100000:2.0:1789395270.108355:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2397:x1876316231957888:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395270.109754:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970015 is committed 00000100:00100000:2.0:1789395270.110078:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231957888:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1718us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.110090:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5428 00000100:00100000:2.0:1789395270.125320:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.125424:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231958144 00000100:00100000:3.0:1789395270.125437:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231958144 00000100:00100000:3.0:1789395270.125516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23986 00000100:00100000:3.0:1789395270.125529:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+121:22292:x1876316231958144:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:3.0:1789395270.125556:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.125582:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e54f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125734:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125750:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125763:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125780:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125788:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125795:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125880:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e564 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125891:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e564 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.125899:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e564 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395270.125910:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 69632 00010000:00010000:3.0:1789395270.126017:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126030:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126036:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126043:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126050:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395270.126055:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126064:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126077:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3c8b1d400) 00010000:00010000:3.0:1789395270.126080:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395270.126084:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126091:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e556 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126108:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126115:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126121:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126127:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:3.0:1789395270.126130:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126136:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126142:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3c8b1d900) 00010000:00010000:3.0:1789395270.126145:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789395270.126148:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126154:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e55d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126208:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e54f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106965 expref: 124 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126224:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e564 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106965 expref: 123 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.126232:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:3.0:1789395270.126234:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789395270.126237:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51aa00, rc 0) 00000100:00100000:3.0:1789395270.126578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+123:22292:x1876316231958144:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1049us (1270us total) trans 4294968711 rc 0/0 00000100:00100000:3.0:1789395270.126588:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23986 00000100:00100000:1.0:1789395270.132141:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.132237:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.132517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231958400 00000100:00100000:0.0:1789395270.132531:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231958400 00000100:00100000:0.0:1789395270.132599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5290 00000100:00100000:0.0:1789395270.132612:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+123:22292:x1876316231958400:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395270.133231:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+124:22292:x1876316231958400:12345-192.168.203.54@tcp:35:dd.0 Request processed in 618us (1100us total) trans 4294968712 rc 0/0 00000100:00100000:0.0:1789395270.133246:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5290 00000100:00100000:2.0:1789395270.133505:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231958528 00000100:00100000:2.0:1789395270.133513:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231958528 00000100:00100000:2.0:1789395270.133569:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1453 00000100:00100000:2.0:1789395270.133578:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+124:2397:x1876316231958528:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395270.133591:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395270.133618:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e564 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106965 expref: 124 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.133639:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395270.133644:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395270.133670:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+123:2397:x1876316231958528:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 94us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.133681:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1453 00000100:00100000:1.0:1789395270.141745:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.142346:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231958656 00000100:00100000:3.0:1789395270.142360:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231958656 00002000:00100000:3.0:1789395270.142480:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (69632->77823) req@ffff89a3cadc7480 x1876316231958656/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395270.142492:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc7480 with x1876316231958656 ext(69632->77823) 00002000:00010000:3.0:1789395270.142499:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc7480 00000100:00100000:3.0:1789395270.142539:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 109 00000100:00100000:3.0:1789395270.142550:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231958656:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395270.143977:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231958656:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1418us (2235us total) trans 4294970017 rc 0/0 00000100:00100000:3.0:1789395270.143990:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 109 00002000:00100000:3.0:1789395270.144003:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (69632->77823) req@ffff89a3cadc7480 x1876316231958656/t4294970017(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395270.144014:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc7480 with x1876316231958656 ext(69632->77823) 00002000:00010000:3.0:1789395270.144020:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3cadc7480 00000100:00100000:1.0:1789395270.148139:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.148227:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231958784 00000100:00100000:0.0:1789395270.148240:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231958784 00000100:00100000:0.0:1789395270.148310:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5429 00000100:00100000:0.0:1789395270.148321:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231958784:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:0.0:1789395270.149991:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970017 is committed 00000100:00100000:1.0:1789395270.150169:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231958784:12345-192.168.203.54@tcp:16:dd.0 Request processed in 1844us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.150184:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5429 00000100:00100000:3.0:1789395270.161621:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.161794:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959040 00000100:00100000:2.0:1789395270.161809:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959040 00000100:00100000:2.0:1789395270.161978:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23987 00000100:00100000:2.0:1789395270.161992:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+123:22293:x1876316231959040:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:2.0:1789395270.162023:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395270.162052:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e572 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210696c expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.162206:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.162221:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.162234:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.162248:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.162255:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.162262:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163227:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e587 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163246:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e587 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163257:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e587 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395270.163270:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 73728 00010000:00010000:0.0:1789395270.163415:0:10512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163424:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163432:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163440:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163447:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.163452:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163461:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163475:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4f3d38700) 00010000:00010000:0.0:1789395270.163478:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.163483:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163489:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e579 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163505:0:10512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163511:0:10512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163517:0:10512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163522:0:10512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.163524:0:10512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163530:0:10512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163536:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4f3d38300) 00010000:00010000:0.0:1789395270.163538:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.163541:0:10512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163547:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e580 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163600:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e572 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210696c expref: 126 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163616:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e587 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210696c expref: 125 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.163623:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395270.163625:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395270.163628:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376c00, rc 0) 00000100:00100000:0.0:1789395270.163712:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+125:22293:x1876316231959040:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1723us (2107us total) trans 4294968713 rc 0/0 00000100:00100000:0.0:1789395270.163720:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23987 00000100:00100000:2.0:1789395270.168362:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.168455:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.168562:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959424 00000100:00100000:0.0:1789395270.168575:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959424 00000100:00100000:0.0:1789395270.168655:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1454 00000100:00100000:0.0:1789395270.168667:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+125:2397:x1876316231959424:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395270.168689:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395270.168718:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e587 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210696c expref: 125 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.168743:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395270.168748:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395270.168820:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+124:2397:x1876316231959424:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 155us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.168830:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1454 00000100:00100000:3.0:1789395270.169156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959296 00000100:00100000:3.0:1789395270.169162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959296 00000100:00100000:3.0:1789395270.169203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5291 00000100:00100000:3.0:1789395270.169210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+124:22293:x1876316231959296:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:3.0:1789395270.169567:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+125:22293:x1876316231959296:12345-192.168.203.54@tcp:35:dd.0 Request processed in 356us (1218us total) trans 4294968714 rc 0/0 00000100:00100000:3.0:1789395270.169575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5291 00000100:00100000:2.0:1789395270.179893:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.180012:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959552 00000100:00100000:0.0:1789395270.180026:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959552 00002000:00100000:0.0:1789395270.180090:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (73728->81919) req@ffff89a3ca15ea00 x1876316231959552/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395270.180102:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15ea00 with x1876316231959552 ext(73728->81919) 00002000:00010000:0.0:1789395270.180109:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15ea00 00000100:00100000:0.0:1789395270.180161:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 110 00000100:00100000:0.0:1789395270.180173:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231959552:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395270.187818:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231959552:12345-192.168.203.54@tcp:4:dd.0 Request processed in 7633us (7923us total) trans 4294970019 rc 0/0 00000100:00100000:1.0:1789395270.187837:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 110 00002000:00100000:1.0:1789395270.187854:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (73728->81919) req@ffff89a3ca15ea00 x1876316231959552/t4294970019(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395270.187865:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca15ea00 with x1876316231959552 ext(73728->81919) 00002000:00010000:1.0:1789395270.187872:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca15ea00 00000100:00100000:0.0:1789395270.204239:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.204316:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.204353:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.204532:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959936 00000100:00100000:0.0:1789395270.204545:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959936 00000100:00100000:0.0:1789395270.204624:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 548 00000100:00100000:0.0:1789395270.204635:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231959936:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1789395270.204721:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231959936:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.204730:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 548 00000100:00080000:0.0:1789395270.204757:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789395270.204788:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.204812:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231960064 00000100:00100000:0.0:1789395270.204815:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231960064 00000100:00100000:0.0:1789395270.204841:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5430 00000100:00100000:0.0:1789395270.204847:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231960064:12345-192.168.203.54@tcp:16:dd.0 00000100:00100000:3.0:1789395270.205271:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959680 00000100:00100000:3.0:1789395270.205277:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959680 00000100:00100000:3.0:1789395270.205734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 489 00000100:00100000:3.0:1789395270.205744:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231959680:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1789395270.205792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1982440d-052f-4574-9279-fc90ec7de84f+10:2397:x1876316231959680:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 50us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395270.205799:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 489 00000100:00100000:2.0:1789395270.205898:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231959808 00000100:00100000:2.0:1789395270.205904:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231959808 00000100:00100000:2.0:1789395270.205968:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 798 00000100:00100000:2.0:1789395270.205976:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231959808:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1789395270.206011:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231959808:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 37us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.206018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 798 00000100:00080000:3.0:1789395270.208931:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789395270.210627:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970019 is committed 00000100:00100000:2.0:1789395270.210895:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231960064:12345-192.168.203.54@tcp:16:dd.0 Request processed in 6039us (6097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.210908:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5430 00000100:00100000:2.0:1789395270.235371:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.238802:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231960320 00000100:00100000:0.0:1789395270.238823:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231960320 00000100:00100000:1.0:1789395270.242257:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23988 00000100:00100000:1.0:1789395270.242276:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+125:22294:x1876316231960320:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395270.242318:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395270.242347:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e595 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106973 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242528:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242543:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242556:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242570:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242577:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242585:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242655:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e5aa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242666:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e5aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242673:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e5aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395270.242686:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 77824 00010000:00010000:1.0:1789395270.242786:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242794:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242800:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242806:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242813:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395270.242818:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.242826:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243620:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a3ca5d9200) 00010000:00010000:1.0:1789395270.243628:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395270.243635:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243646:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e59c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243668:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243675:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243681:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243687:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395270.243690:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243696:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243707:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a3ca5d9500) 00010000:00010000:1.0:1789395270.243709:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395270.243712:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.243718:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5a3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.244076:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e595 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106973 expref: 128 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.244098:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e5aa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106973 expref: 127 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.244107:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395270.244109:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395270.244112:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214e00, rc 0) 00000100:00100000:1.0:1789395270.244209:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+127:22294:x1876316231960320:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1936us (8852us total) trans 4294968715 rc 0/0 00000100:00100000:1.0:1789395270.244218:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23988 00000100:00100000:2.0:1789395270.255619:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.255782:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.256208:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231960704 00000100:00100000:1.0:1789395270.256223:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231960704 00000100:00100000:1.0:1789395270.256308:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1455 00000100:00100000:1.0:1789395270.256321:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+127:2398:x1876316231960704:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395270.256342:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395270.256372:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e5aa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106973 expref: 127 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.256427:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395270.256433:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395270.256509:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+126:2398:x1876316231960704:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 187us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.256520:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1455 00000100:00100000:0.0:1789395270.262561:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231960576 00000100:00100000:0.0:1789395270.262581:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231960576 00000100:00100000:0.0:1789395270.262716:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5292 00000100:00100000:0.0:1789395270.262728:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+126:22294:x1876316231960576:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395270.263127:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+127:22294:x1876316231960576:12345-192.168.203.54@tcp:35:dd.0 Request processed in 401us (7521us total) trans 4294968716 rc 0/0 00000100:00100000:0.0:1789395270.263136:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5292 00000100:00100000:2.0:1789395270.274220:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.274477:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231960832 00000100:00100000:3.0:1789395270.274490:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231960832 00002000:00100000:3.0:1789395270.274554:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (77824->86015) req@ffff89a501db1c00 x1876316231960832/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395270.274567:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db1c00 with x1876316231960832 ext(77824->86015) 00002000:00010000:3.0:1789395270.274574:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db1c00 00000100:00100000:3.0:1789395270.274613:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 111 00000100:00100000:3.0:1789395270.274625:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231960832:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395270.278924:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231960832:12345-192.168.203.54@tcp:4:dd.0 Request processed in 4275us (4694us total) trans 4294970021 rc 0/0 00000100:00100000:3.0:1789395270.278943:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 111 00002000:00100000:3.0:1789395270.278960:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (77824->86015) req@ffff89a501db1c00 x1876316231960832/t4294970021(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789395270.278972:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db1c00 with x1876316231960832 ext(77824->86015) 00002000:00010000:3.0:1789395270.278980:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a501db1c00 00000100:00100000:1.0:1789395270.293886:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.294054:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231960960 00000100:00100000:2.0:1789395270.294068:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231960960 00000100:00100000:2.0:1789395270.294137:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5431 00000100:00100000:2.0:1789395270.294149:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231960960:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395270.296034:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970021 is committed 00000100:00100000:2.0:1789395270.296874:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231960960:12345-192.168.203.54@tcp:16:dd.0 Request processed in 2717us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.296888:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5431 00000100:00100000:3.0:1789395270.328848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.329026:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231961216 00000100:00100000:0.0:1789395270.329040:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231961216 00000100:00100000:0.0:1789395270.329120:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23989 00000100:00100000:0.0:1789395270.329131:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+127:22295:x1876316231961216:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395270.329161:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.329188:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e5b8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210697a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329335:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329352:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329364:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329378:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329519:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329527:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329600:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e5cd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329611:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e5cd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329619:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e5cd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395270.329630:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 81920 00010000:00010000:0.0:1789395270.329720:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329728:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329735:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329742:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329749:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.329754:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329767:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329781:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89500) 00010000:00010000:0.0:1789395270.329784:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.329789:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329797:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e5bf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329814:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329820:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329825:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329830:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.329833:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329839:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329847:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4fbb89200) 00010000:00010000:0.0:1789395270.329850:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.329853:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.329859:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5c6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.330147:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e5b8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210697a expref: 130 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.330168:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e5cd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210697a expref: 129 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.330176:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395270.330179:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789395270.330182:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376600, rc 0) 00000100:00100000:0.0:1789395270.330300:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+129:22295:x1876316231961216:12345-192.168.203.54@tcp:101:dd.0 Request processed in 1170us (1467us total) trans 4294968717 rc 0/0 00000100:00100000:0.0:1789395270.330309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23989 00000100:00100000:0.0:1789395270.333897:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.334048:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231961344 00000100:00100000:2.0:1789395270.334062:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231961344 00000100:00100000:2.0:1789395270.334139:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1456 00000100:00100000:2.0:1789395270.334151:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+129:2397:x1876316231961344:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395270.334173:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395270.334200:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e5cd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210697a expref: 129 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.334224:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395270.334229:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395270.334302:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+128:2397:x1876316231961344:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 153us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.334310:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1456 00000100:00100000:1.0:1789395270.338276:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.338702:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231961600 00000100:00100000:0.0:1789395270.338717:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231961600 00000100:00100000:0.0:1789395270.339161:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5293 00000100:00100000:0.0:1789395270.339176:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d07c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+128:22295:x1876316231961600:12345-192.168.203.54@tcp:35:dd.0 00000100:00100000:0.0:1789395270.340258:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d07c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+129:22295:x1876316231961600:12345-192.168.203.54@tcp:35:dd.0 Request processed in 1078us (1987us total) trans 4294968718 rc 0/0 00000100:00100000:0.0:1789395270.340270:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5293 00000100:00100000:3.0:1789395270.347029:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.351019:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231961728 00000100:00100000:1.0:1789395270.351042:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231961728 00002000:00100000:1.0:1789395270.351125:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (81920->90111) req@ffff89a3ca3e3100 x1876316231961728/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/0 e 0 to 0 dl 1789395281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395270.351139:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e3100 with x1876316231961728 ext(81920->90111) 00002000:00010000:1.0:1789395270.351146:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e3100 00000100:00100000:1.0:1789395270.351269:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 112 00000100:00100000:1.0:1789395270.351281:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231961728:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395270.353561:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231961728:12345-192.168.203.54@tcp:4:dd.0 Request processed in 1988us (6254us total) trans 4294970023 rc 0/0 00000100:00100000:1.0:1789395270.353579:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 112 00002000:00100000:1.0:1789395270.353596:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc:0x0] (81920->90111) req@ffff89a3ca3e3100 x1876316231961728/t4294970023(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:736/0 lens 8680/448 e 0 to 0 dl 1789395281 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395270.353607:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e3100 with x1876316231961728 ext(81920->90111) 00002000:00010000:1.0:1789395270.353613:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e3100 00000100:00100000:2.0:1789395270.356998:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.359793:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231961856 00000100:00100000:0.0:1789395270.359816:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231961856 00000100:00100000:0.0:1789395270.360048:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5432 00000100:00100000:0.0:1789395270.360061:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2396:x1876316231961856:12345-192.168.203.54@tcp:16:dd.0 00000001:00080000:1.0:1789395270.362703:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970023 is committed 00000100:00100000:0.0:1789395270.363730:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231961856:12345-192.168.203.54@tcp:16:dd.0 Request processed in 3661us (6735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.363745:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5432 00010000:00010000:2.0:1789395270.385733:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395270.453614:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.453734:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231961984 00000100:00100000:0.0:1789395270.453747:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231961984 00000100:00100000:0.0:1789395270.453839:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23990 00000100:00100000:0.0:1789395270.453852:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+129:22302:x1876316231961984:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395270.453881:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.453910:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e5db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106981 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.454008:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5e2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.454023:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.454035:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395270.454096:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000004:00200000:0.0:1789395270.454100:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395270.454123:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.454155:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e5db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106981 expref: 131 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.454196:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106981 expref: 130 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.454206:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:0.0:1789395270.454210:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789395270.454214:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377000, rc 0) 00000100:00100000:0.0:1789395270.454297:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+130:22302:x1876316231961984:12345-192.168.203.54@tcp:101:ls.0 Request processed in 447us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.454305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23990 00000100:00100000:3.0:1789395270.462325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.462505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231962112 00000100:00100000:1.0:1789395270.462519:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231962112 00000100:00100000:1.0:1789395270.462595:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23991 00000100:00100000:1.0:1789395270.462606:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+130:22302:x1876316231962112:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:1.0:1789395270.462631:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395270.462657:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5e9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106988 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.462704:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e5f0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.462720:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e5f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.462731:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e5f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.463197:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e5e9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106988 expref: 132 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.463223:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214600/0xff35729af316e5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106988 expref: 131 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.463234:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:1.0:1789395270.463237:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789395270.463241:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214600, rc 0) 00000100:00100000:1.0:1789395270.463359:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+131:22302:x1876316231962112:12345-192.168.203.54@tcp:101:ls.0 Request processed in 753us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.463367:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23991 00000100:00100000:3.0:1789395270.475634:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.475742:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231962368 00000100:00100000:2.0:1789395270.475768:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231962368 00000100:00100000:2.0:1789395270.475840:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23992 00000100:00100000:2.0:1789395270.475861:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+131:22302:x1876316231962368:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:2.0:1789395270.475884:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395270.475921:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e5f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210698f expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395270.476052:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:2.0:1789395270.476168:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e5f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210698f expref: 133 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.476184:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395270.476188:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395270.476194:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e5f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210698f expref: 133 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.476216:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:2.0:1789395270.476291:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+132:22302:x1876316231962368:12345-192.168.203.54@tcp:101:ls.0 Request processed in 434us (709us total) trans 4294968719 rc 301/301 00000100:00100000:2.0:1789395270.476299:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23992 00000100:00100000:0.0:1789395270.487799:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.488245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231962496 00000100:00100000:1.0:1789395270.488260:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231962496 00000100:00100000:1.0:1789395270.488413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5294 00000100:00100000:1.0:1789395270.488428:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+132:22302:x1876316231962496:12345-192.168.203.54@tcp:37:ls.0 00000100:00100000:1.0:1789395270.496946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+132:22302:x1876316231962496:12345-192.168.203.54@tcp:37:ls.0 Request processed in 8505us (9143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.496967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5294 00000100:00100000:2.0:1789395270.509248:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.509475:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231962624 00000100:00100000:0.0:1789395270.509500:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231962624 00000100:00100000:0.0:1789395270.509563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23993 00000100:00100000:0.0:1789395270.509576:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+132:22302:x1876316231962624:12345-192.168.203.54@tcp:101:ls.0 00010000:00010000:0.0:1789395270.509600:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.509628:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e605 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106996 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509712:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509727:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509740:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509759:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509766:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509774:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509842:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509854:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 133 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509864:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509907:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 133 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.509932:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 133 pid: 21735 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395270.509948:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239803904:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395270.510082:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789395270.526427:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.526475:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.526559:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231962880 00000100:00100000:1.0:1789395270.526571:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231962880 00000100:00100000:1.0:1789395270.526648:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5295 00000100:00100000:1.0:1789395270.526660:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+134:6164:x1876316231962880:12345-192.168.203.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789395270.526770:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231963008 00000100:00100000:3.0:1789395270.526776:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231963008 00000100:00100000:3.0:1789395270.526814:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3634 00000100:00100000:3.0:1789395270.526822:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:2397:x1876316231963008:12345-192.168.203.54@tcp:63:ll_sa.0 00010000:00010000:3.0:1789395270.526849:0:20561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.526874:0:20561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e621 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa445840210699d expref: -99 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.526954:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.526971:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.526985:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.526998:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.527006:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.527014:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395270.527041:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+137:6164:x1876316231962880:12345-192.168.203.54@tcp:35:ldlm_bl.0 Request processed in 383us (661us total) trans 4294968720 rc 0/0 00000100:00100000:1.0:1789395270.527050:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5295 00010000:00010000:3.0:1789395270.527078:0:20561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e636 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.527089:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e636 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.527096:0:20561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e636 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395270.527153:0:20561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 90112 00000004:00200000:1.0:1789395270.527159:0:20561:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789395270.527181:0:20561:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e636 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527192:0:20561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e636 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527201:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527208:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527216:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527222:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51bc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395270.527227:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527238:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527251:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:1.0:1789395270.527254:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395270.527259:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527266:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e628 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527280:0:20561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527286:0:20561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527291:0:20561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527296:0:20561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395270.527299:0:20561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527305:0:20561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527313:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4fbb89500) 00010000:00010000:1.0:1789395270.527315:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395270.527318:0:20561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527325:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e62f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20561 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527348:0:20561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e621 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210699d expref: 137 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527361:0:20561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b800/0xff35729af316e636 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210699d expref: 136 pid: 20561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527369:0:20561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:1.0:1789395270.527371:0:20561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789395270.527374:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527381:0:20561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.527441:0:20561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51b800, rc 0) 00000100:00100000:1.0:1789395270.527473:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+136:2397:x1876316231963008:12345-192.168.203.54@tcp:63:ll_sa.0 Request processed in 652us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.527481:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3634 00000100:00100000:2.0:1789395270.527600:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6513:1876316239803904:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395270.527631:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395270.537658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.537830:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231963136 00000100:00100000:0.0:1789395270.537843:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231963136 00010000:00010000:0.0:1789395270.537895:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 136 pid: 21735 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395270.537953:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1606 00000100:00100000:0.0:1789395270.537964:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+136:2396:x1876316231963136:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395270.537984:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395270.537992:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 136 pid: 21735 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.538005:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 136 pid: 21735 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.538030:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e086 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106862 expref: 136 pid: 21735 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.538049:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:0.0:1789395270.538056:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.538067:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.538076:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.538117:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395270.538159:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538171:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395270.538199:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:2396:x1876316231963136:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 235us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.538209:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1606 00000004:00200000:2.0:1789395270.538236:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 90112 00000004:00200000:2.0:1789395270.538243:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789395270.538270:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538286:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538300:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538307:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538318:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538326:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538332:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395270.538338:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538346:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538358:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:2.0:1789395270.538362:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395270.538365:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538415:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e60c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538430:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538436:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538442:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538447:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:2.0:1789395270.538451:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538458:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538466:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff89a4fbb89500) 00010000:00010000:2.0:1789395270.538468:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789395270.538471:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538477:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e613 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538517:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e605 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106996 expref: 135 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538532:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376000/0xff35729af316e61a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106996 expref: 134 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.538538:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff89a3ca366100) 00010000:00010000:2.0:1789395270.538541:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395270.538543:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376000, rc 0) 00000100:00100000:2.0:1789395270.538573:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+134:22302:x1876316231962624:12345-192.168.203.54@tcp:101:ls.0 Request processed in 29001us (29340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.538580:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23993 00000100:00100000:3.0:1789395270.599261:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.600277:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231963392 00000100:00100000:1.0:1789395270.600292:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231963392 00000100:00100000:1.0:1789395270.600377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5296 00000100:00100000:1.0:1789395270.600432:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+134:22302:x1876316231963392:12345-192.168.203.54@tcp:35:ls.0 00000100:00100000:1.0:1789395270.600714:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:22302:x1876316231963392:12345-192.168.203.54@tcp:35:ls.0 Request processed in 285us (1468us total) trans 4294968721 rc 0/0 00000100:00100000:1.0:1789395270.600728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5296 00000100:00100000:3.0:1789395270.673329:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.674107:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231963648 00000100:00100000:2.0:1789395270.674123:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231963648 00000100:00100000:2.0:1789395270.674212:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23994 00000100:00100000:2.0:1789395270.674223:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:22080:x1876316231963648:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395270.674257:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395270.674261:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789395270.674294:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e5e2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106981 expref: 135 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.674320:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:2.0:1789395270.674325:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395270.674340:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e63d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069a4 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.674546:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e644 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.674560:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e644 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.674572:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e644 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395270.674584:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 6 00010000:00010000:2.0:1789395270.674713:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e63d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069a4 expref: 137 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.674730:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e644 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069a4 expref: 136 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.674737:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:2.0:1789395270.674740:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395270.674742:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:2.0:1789395270.674823:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+136:22080:x1876316231963648:12345-192.168.203.54@tcp:101:bash.0 Request processed in 601us (1508us total) trans 4294968722 rc 0/0 00000100:00100000:2.0:1789395270.674832:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23994 00000100:00100000:3.0:1789395270.683136:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.683257:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231963776 00000100:00100000:1.0:1789395270.683270:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231963776 00000100:00100000:1.0:1789395270.683365:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1457 00000100:00100000:1.0:1789395270.683428:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+136:2398:x1876316231963776:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395270.683451:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395270.683481:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e644 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069a4 expref: 136 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.683503:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:1.0:1789395270.683509:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395270.683577:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:2398:x1876316231963776:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 202us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.683584:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1457 00000100:00100000:3.0:1789395270.689783:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.689960:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964032 00000100:00100000:2.0:1789395270.689973:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964032 00000100:00100000:2.0:1789395270.690062:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23995 00000100:00100000:2.0:1789395270.690078:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+135:22080:x1876316231964032:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:2.0:1789395270.690155:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395270.690193:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316da66 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106624 expref: 135 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.690225:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:2.0:1789395270.690231:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395270.691030:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.691054:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.691072:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395270.691126:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968723 00000004:00010000:2.0:1789395270.691150:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000351a069a reply state 00000000c833ba22 transno 4294968724 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.691164:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.691172:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:2.0:1789395270.691630:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395270.691635:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395270.692542:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+137:22080:x1876316231964032:12345-192.168.203.54@tcp:36:bash.0 Request processed in 2454us (2768us total) trans 4294968724 rc 0/0 00000100:00100000:2.0:1789395270.692553:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23995 00000020:00080000:2.0:1789395270.692561:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395270.699316:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.699430:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964160 00000100:00100000:2.0:1789395270.699444:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964160 00000100:00100000:2.0:1789395270.699505:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23996 00000100:00100000:2.0:1789395270.699515:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+137:22080:x1876316231964160:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395270.699542:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395270.699565:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e659 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069ab expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.699636:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e659 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ab expref: 138 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.699651:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0800/0xff35729af316e659 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ab expref: 138 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.699672:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:2.0:1789395270.699675:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789395270.699678:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0800, rc 0) 00000100:00100000:2.0:1789395270.699753:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+138:22080:x1876316231964160:12345-192.168.203.54@tcp:101:bash.0 Request processed in 239us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.699761:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23996 00000100:00100000:3.0:1789395270.706783:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.706898:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964288 00000100:00100000:1.0:1789395270.706920:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964288 00002000:00010000:1.0:1789395270.706986:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.706991:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e0380 with x1876316231964288 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.707004:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e0380. 00000100:00100000:1.0:1789395270.707040:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 113 00000100:00100000:1.0:1789395270.707050:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231964288:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395270.707665:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395270.707670:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.707673:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395270.707675:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.707679:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395270.707747:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231964288:12345-192.168.203.54@tcp:10:bash.0 Request processed in 696us (977us total) trans 4294970024 rc 0/0 00000100:00100000:1.0:1789395270.707755:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 113 00002000:00010000:1.0:1789395270.707759:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.707762:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca3e0380 with x1876316231964288 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.707767:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca3e0380. 00000100:00100000:3.0:1789395270.711846:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.713781:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964416 00000100:00100000:2.0:1789395270.713802:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964416 00000100:00100000:2.0:1789395270.713896:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5433 00000100:00100000:2.0:1789395270.713917:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2398:x1876316231964416:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:1.0:1789395270.717879:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970024 is committed 00000100:00100000:2.0:1789395270.718950:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231964416:12345-192.168.203.54@tcp:16:bash.0 Request processed in 5031us (7108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.718966:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5433 00000100:00100000:0.0:1789395270.723638:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.723730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964672 00000100:00100000:3.0:1789395270.723852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964672 00000100:00100000:3.0:1789395270.723937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5297 00000100:00100000:3.0:1789395270.724007:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+138:22080:x1876316231964672:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395270.724331:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+139:22080:x1876316231964672:12345-192.168.203.54@tcp:35:bash.0 Request processed in 326us (704us total) trans 4294968725 rc 0/0 00000100:00100000:3.0:1789395270.724339:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5297 00000100:00100000:3.0:1789395270.728057:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.728178:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964800 00000100:00100000:1.0:1789395270.728192:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964800 00000100:00100000:1.0:1789395270.728262:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23997 00000100:00100000:1.0:1789395270.728275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+139:22080:x1876316231964800:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395270.729158:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+139:22080:x1876316231964800:12345-192.168.203.54@tcp:44:bash.0 Request processed in 877us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.729169:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23997 00000100:00100000:2.0:1789395270.734567:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.734659:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231964928 00000100:00100000:0.0:1789395270.734672:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231964928 00000100:00100000:0.0:1789395270.734774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23998 00000100:00100000:0.0:1789395270.734786:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22080:x1876316231964928:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395270.734818:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.734853:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316e660 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069b2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.734953:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.734969:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.734982:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.734998:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735005:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735011:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735103:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316e675 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735113:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316e675 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735120:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316e675 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395270.735146:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316e675 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735163:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735170:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735177:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735185:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735191:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.735196:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735203:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735216:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a3ca366800) 00010000:00010000:0.0:1789395270.735219:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.735224:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377000/0xff35729af316e667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735247:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735253:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735259:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735264:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395270.735267:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735272:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735278:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff89a4fbb89900) 00010000:00010000:0.0:1789395270.735281:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395270.735283:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735598:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca376400/0xff35729af316e66e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735637:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377c00/0xff35729af316e660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069b2 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735651:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316e675 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069b2 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.735660:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3900) 00010000:00010000:0.0:1789395270.735662:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789395270.735665:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377800, rc 0) 00000100:00100000:0.0:1789395270.735736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22080:x1876316231964928:12345-192.168.203.54@tcp:101:bash.0 Request processed in 952us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.735743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23998 00000100:00100000:3.0:1789395270.739984:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.741345:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.741436:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231965184 00000100:00100000:3.0:1789395270.741450:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231965184 00000100:00100000:3.0:1789395270.741527:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1458 00000100:00100000:3.0:1789395270.741539:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4dfa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2398:x1876316231965184:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789395270.741556:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395270.741586:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a3ca377800/0xff35729af316e675 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069b2 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395270.741620:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231965056 00010000:00010000:3.0:1789395270.741622:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4c92e3900) 00000100:00100000:2.0:1789395270.741629:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231965056 00010000:00010000:3.0:1789395270.741631:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395270.741683:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23999 00000100:00100000:2.0:1789395270.741693:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+139:22080:x1876316231965056:12345-192.168.203.54@tcp:101:bash.0 00000100:00100000:3.0:1789395270.741700:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4dfa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231965184:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 162us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395270.741711:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1458 00010000:00010000:2.0:1789395270.741713:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395270.741735:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e67c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069b9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.741806:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e683 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.741890:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e683 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.741905:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e683 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395270.741970:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000004:00200000:2.0:1789395270.742267:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1789395270.742479:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e67c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069b9 expref: 141 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.742501:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e0a00/0xff35729af316e683 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069b9 expref: 140 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.742511:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:2.0:1789395270.742514:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1789395270.742517:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e0a00, rc 0) 00000100:00100000:2.0:1789395270.742554:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+140:22080:x1876316231965056:12345-192.168.203.54@tcp:101:bash.0 Request processed in 863us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.742561:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23999 00000100:00100000:2.0:1789395270.750275:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.750512:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231965440 00000100:00100000:3.0:1789395270.750526:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231965440 00000100:00100000:3.0:1789395270.750625:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24000 00000100:00100000:3.0:1789395270.750637:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+140:22080:x1876316231965440:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395270.750661:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.750683:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e68a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069c0 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.750899:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e691 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.750926:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e691 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.750939:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e691 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395270.750953:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19b:0x0]: returning size 6 00010000:00010000:3.0:1789395270.751077:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e68a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069c0 expref: 143 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.751097:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e691 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069c0 expref: 142 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.751109:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:3.0:1789395270.751112:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395270.751116:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ac00, rc 0) 00000100:00100000:3.0:1789395270.751226:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+142:22080:x1876316231965440:12345-192.168.203.54@tcp:101:bash.0 Request processed in 591us (965us total) trans 4294968726 rc 0/0 00000100:00100000:3.0:1789395270.751234:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24000 00000100:00100000:1.0:1789395270.756038:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.756306:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231965568 00000100:00100000:0.0:1789395270.756319:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231965568 00000100:00100000:0.0:1789395270.756557:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1459 00000100:00100000:0.0:1789395270.756571:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+142:2396:x1876316231965568:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395270.756593:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395270.756621:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e691 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069c0 expref: 142 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.756642:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:0.0:1789395270.756649:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395270.756721:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+141:2396:x1876316231965568:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 154us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.756730:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1459 00000100:00100000:2.0:1789395270.759945:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.760044:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231965824 00000100:00100000:3.0:1789395270.760058:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231965824 00000100:00100000:3.0:1789395270.760175:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24001 00000100:00100000:3.0:1789395270.760187:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+141:22080:x1876316231965824:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395270.760300:0:10512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395270.760332:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316da89 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210662b expref: 141 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.760354:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:3.0:1789395270.760359:0:10512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395270.760604:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.760620:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.760631:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395270.760682:0:10512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968727 00000004:00010000:3.0:1789395270.760705:0:10512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baf830de reply state 000000006b501812 transno 4294968728 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.760718:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.760724:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:3.0:1789395270.760727:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395270.760729:0:10512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395270.761232:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+143:22080:x1876316231965824:12345-192.168.203.54@tcp:36:bash.0 Request processed in 658us (1010us total) trans 4294968728 rc 0/0 00000100:00100000:3.0:1789395270.761244:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24001 00000020:00080000:3.0:1789395270.761252:0:10512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395270.765157:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.765255:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231965952 00000100:00100000:0.0:1789395270.765266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231965952 00000100:00100000:1.0:1789395270.765737:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24002 00000100:00100000:1.0:1789395270.765752:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+143:22080:x1876316231965952:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395270.765779:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395270.765813:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214c00/0xff35729af316e6a6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069c7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.765884:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214c00/0xff35729af316e6a6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069c7 expref: 144 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.765899:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214c00/0xff35729af316e6a6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069c7 expref: 144 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.765932:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:1.0:1789395270.765936:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395270.765940:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214c00, rc 0) 00000100:00100000:1.0:1789395270.766052:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+144:22080:x1876316231965952:12345-192.168.203.54@tcp:101:bash.0 Request processed in 304us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.766059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24002 00000100:00100000:2.0:1789395270.771054:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.771158:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231966080 00000100:00100000:3.0:1789395270.771172:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231966080 00002000:00010000:3.0:1789395270.771222:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:3.0:1789395270.771228:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0a80 with x1876316231966080 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395270.771241:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db0a80. 00000100:00100000:3.0:1789395270.771320:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 114 00000100:00100000:3.0:1789395270.771332:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231966080:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:3.0:1789395270.771696:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395270.771700:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395270.771703:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395270.771705:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395270.771707:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395270.772280:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231966080:12345-192.168.203.54@tcp:10:bash.0 Request processed in 946us (1236us total) trans 4294969997 rc 0/0 00000100:00100000:3.0:1789395270.772546:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 114 00002000:00010000:3.0:1789395270.772554:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:3.0:1789395270.772558:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db0a80 with x1876316231966080 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395270.772566:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db0a80. 00000100:00100000:2.0:1789395270.776365:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.776561:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231966208 00000100:00100000:1.0:1789395270.776574:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231966208 00000100:00100000:1.0:1789395270.776675:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5434 00000100:00100000:1.0:1789395270.776687:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231966208:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395270.778196:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969997 is committed 00000100:00100000:1.0:1789395270.778640:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231966208:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1948us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.778652:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5434 00000100:00100000:2.0:1789395270.781604:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.781705:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231966464 00000100:00100000:0.0:1789395270.781719:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231966464 00000100:00100000:0.0:1789395270.781831:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5298 00000100:00100000:0.0:1789395270.781844:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+144:22080:x1876316231966464:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395270.782175:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+145:22080:x1876316231966464:12345-192.168.203.54@tcp:35:bash.0 Request processed in 333us (584us total) trans 4294968729 rc 0/0 00000100:00100000:0.0:1789395270.782185:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5298 00000100:00100000:2.0:1789395270.785360:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.785750:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231966592 00000100:00100000:0.0:1789395270.785764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231966592 00000100:00100000:0.0:1789395270.785868:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24003 00000100:00100000:0.0:1789395270.785879:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+145:22080:x1876316231966592:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395270.786059:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+145:22080:x1876316231966592:12345-192.168.203.54@tcp:44:bash.0 Request processed in 181us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.786068:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24003 00000100:00100000:2.0:1789395270.789663:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.789750:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231966848 00000100:00100000:1.0:1789395270.789764:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231966848 00000100:00100000:1.0:1789395270.789833:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24004 00000100:00100000:1.0:1789395270.789852:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+145:22080:x1876316231966848:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395270.789876:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395270.789902:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e6ad lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069ce expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.790055:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e6b4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.790071:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.790085:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395270.790097:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19c:0x0]: returning size 6 00010000:00010000:1.0:1789395270.790226:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e6ad lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ce expref: 148 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.790248:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ce expref: 147 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.790258:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:1.0:1789395270.790262:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395270.790265:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215800, rc 0) 00000100:00100000:1.0:1789395270.790346:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+147:22080:x1876316231966848:12345-192.168.203.54@tcp:101:bash.0 Request processed in 503us (696us total) trans 4294968730 rc 0/0 00000100:00100000:1.0:1789395270.790355:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24004 00000100:00100000:2.0:1789395270.794955:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.795288:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231967104 00000100:00100000:0.0:1789395270.795314:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231967104 00000100:00100000:0.0:1789395270.795488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24005 00000100:00100000:0.0:1789395270.795501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+147:22080:x1876316231967104:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395270.795572:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395270.795599:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e6b4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ce expref: 147 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.795618:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316daac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106632 expref: 146 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.795626:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395270.795630:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395270.795815:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.795834:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.795846:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395270.795894:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968731 00000004:00010000:0.0:1789395270.795926:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a95bea8d reply state 0000000023cd0b38 transno 4294968732 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.795939:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.795946:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395270.795949:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395270.795953:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395270.796055:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+148:22080:x1876316231967104:12345-192.168.203.54@tcp:36:bash.0 Request processed in 556us (1144us total) trans 4294968732 rc 0/0 00000100:00100000:0.0:1789395270.796063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24005 00000020:00080000:0.0:1789395270.796070:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395270.801511:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.801603:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231967232 00000100:00100000:3.0:1789395270.801617:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231967232 00000100:00100000:3.0:1789395270.801698:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24006 00000100:00100000:3.0:1789395270.801710:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+148:22080:x1876316231967232:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395270.801738:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.801761:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316e6c9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069d5 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.801834:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316e6c9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069d5 expref: 149 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.801863:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a600/0xff35729af316e6c9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069d5 expref: 149 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.801886:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:3.0:1789395270.801889:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789395270.801893:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a600, rc 0) 00000100:00100000:3.0:1789395270.801968:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+149:22080:x1876316231967232:12345-192.168.203.54@tcp:101:bash.0 Request processed in 259us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395270.801975:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24006 00000100:00100000:2.0:1789395270.807108:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.807259:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231967360 00000100:00100000:1.0:1789395270.807273:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231967360 00002000:00010000:1.0:1789395270.807340:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.807346:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259c00 with x1876316231967360 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.807360:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8259c00. 00000100:00100000:1.0:1789395270.807433:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 115 00000100:00100000:1.0:1789395270.807547:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231967360:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395270.807994:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395270.807999:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.808002:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395270.808005:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.808008:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395270.808513:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231967360:12345-192.168.203.54@tcp:10:bash.0 Request processed in 966us (1415us total) trans 4294970025 rc 0/0 00000100:00100000:1.0:1789395270.808980:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 115 00002000:00010000:1.0:1789395270.808988:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.808991:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259c00 with x1876316231967360 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.809001:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8259c00. 00000100:00100000:2.0:1789395270.813037:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.813133:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231967488 00000100:00100000:0.0:1789395270.813145:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231967488 00000100:00100000:0.0:1789395270.813253:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5435 00000100:00100000:0.0:1789395270.813264:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231967488:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395270.816044:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970025 is committed 00000100:00100000:1.0:1789395270.816899:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231967488:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3625us (3865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.816926:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5435 00000100:00100000:2.0:1789395270.821867:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.821995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231967744 00000100:00100000:3.0:1789395270.822008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231967744 00000100:00100000:3.0:1789395270.822114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5299 00000100:00100000:3.0:1789395270.822126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+149:22080:x1876316231967744:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395270.822651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+150:22080:x1876316231967744:12345-192.168.203.54@tcp:35:bash.0 Request processed in 525us (797us total) trans 4294968733 rc 0/0 00000100:00100000:3.0:1789395270.822661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5299 00000100:00100000:2.0:1789395270.827261:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.828663:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231967872 00000100:00100000:1.0:1789395270.828683:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231967872 00000100:00100000:1.0:1789395270.828783:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24007 00000100:00100000:1.0:1789395270.828855:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+150:22080:x1876316231967872:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395270.832176:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+150:22080:x1876316231967872:12345-192.168.203.54@tcp:44:bash.0 Request processed in 3368us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.832193:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24007 00000100:00100000:2.0:1789395270.841091:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.841208:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231968128 00000100:00100000:1.0:1789395270.841222:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231968128 00000100:00100000:1.0:1789395270.841302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24008 00000100:00100000:1.0:1789395270.841314:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+150:22080:x1876316231968128:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395270.841338:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395270.841362:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e6d0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.841557:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e6d7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.841574:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e6d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.841587:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e6d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395270.841601:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19d:0x0]: returning size 6 00010000:00010000:1.0:1789395270.841737:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e6d0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069dc expref: 153 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.841760:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069dc expref: 152 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.841769:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:1.0:1789395270.841772:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395270.841776:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214e00, rc 0) 00000100:00100000:1.0:1789395270.841848:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+152:22080:x1876316231968128:12345-192.168.203.54@tcp:101:bash.0 Request processed in 536us (773us total) trans 4294968734 rc 0/0 00000100:00100000:1.0:1789395270.841856:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24008 00000100:00100000:2.0:1789395270.848845:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.848989:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231968384 00000100:00100000:0.0:1789395270.849004:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231968384 00000100:00100000:0.0:1789395270.849082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24009 00000100:00100000:0.0:1789395270.849094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+152:22080:x1876316231968384:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395270.849198:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395270.849229:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e6d7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069dc expref: 152 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.849256:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316dacf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106639 expref: 151 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.849266:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:0.0:1789395270.849271:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395270.849539:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.849554:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.849566:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395270.849620:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968735 00000004:00010000:0.0:1789395270.849644:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5b97e10 reply state 00000000b0e020b6 transno 4294968736 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.849657:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.849664:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:0.0:1789395270.849667:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395270.849671:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395270.849789:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+153:22080:x1876316231968384:12345-192.168.203.54@tcp:36:bash.0 Request processed in 696us (957us total) trans 4294968736 rc 0/0 00000100:00100000:0.0:1789395270.849802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24009 00000020:00080000:0.0:1789395270.849807:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395270.855184:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.855527:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231968512 00000100:00100000:3.0:1789395270.855540:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231968512 00000100:00100000:2.0:1789395270.855694:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24010 00000100:00100000:2.0:1789395270.855707:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+153:22080:x1876316231968512:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395270.855737:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395270.855762:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5a00/0xff35729af316e6ec lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069e3 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.855838:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5a00/0xff35729af316e6ec lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069e3 expref: 154 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.855854:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5a00/0xff35729af316e6ec lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069e3 expref: 154 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.855878:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:2.0:1789395270.855882:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789395270.855886:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff5a00, rc 0) 00000100:00100000:2.0:1789395270.855984:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+154:22080:x1876316231968512:12345-192.168.203.54@tcp:101:bash.0 Request processed in 279us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.855992:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24010 00000100:00100000:2.0:1789395270.860274:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.861833:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231968640 00000100:00100000:1.0:1789395270.861852:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231968640 00002000:00010000:1.0:1789395270.861926:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.861932:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259180 with x1876316231968640 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.861945:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c8259180. 00000100:00100000:1.0:1789395270.862001:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 116 00000100:00100000:1.0:1789395270.862013:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2398:x1876316231968640:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395270.862339:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395270.862344:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.862346:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395270.862349:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.862351:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395270.862529:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231968640:12345-192.168.203.54@tcp:10:bash.0 Request processed in 518us (2270us total) trans 4294969998 rc 0/0 00000100:00100000:1.0:1789395270.862537:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 116 00002000:00010000:1.0:1789395270.862540:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.862543:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8259180 with x1876316231968640 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.862547:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c8259180. 00000100:00100000:3.0:1789395270.868042:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.868273:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231968768 00000100:00100000:2.0:1789395270.868295:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231968768 00000100:00100000:2.0:1789395270.868370:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5436 00000100:00100000:2.0:1789395270.868428:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231968768:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395270.872493:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969998 is committed 00000100:00100000:2.0:1789395270.875572:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231968768:12345-192.168.203.54@tcp:16:bash.0 Request processed in 7173us (7525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.875589:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5436 00000100:00100000:2.0:1789395270.881730:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.881888:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231969024 00000100:00100000:0.0:1789395270.881901:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231969024 00000100:00100000:0.0:1789395270.881982:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5300 00000100:00100000:0.0:1789395270.881994:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+154:22080:x1876316231969024:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395270.882337:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+155:22080:x1876316231969024:12345-192.168.203.54@tcp:35:bash.0 Request processed in 290us (564us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1789395270.882348:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5300 00000100:00100000:0.0:1789395270.885134:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.885297:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231969152 00000100:00100000:1.0:1789395270.885309:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231969152 00000100:00100000:1.0:1789395270.885420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24011 00000100:00100000:1.0:1789395270.885431:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+155:22080:x1876316231969152:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395270.885837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+155:22080:x1876316231969152:12345-192.168.203.54@tcp:44:bash.0 Request processed in 404us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.885845:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24011 00000100:00100000:3.0:1789395270.889760:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.890051:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231969408 00000100:00100000:0.0:1789395270.890064:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231969408 00000100:00100000:0.0:1789395270.890177:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24012 00000100:00100000:0.0:1789395270.890189:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+155:22080:x1876316231969408:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395270.890211:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.890236:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e6f3 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069ea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.890542:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e6fa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.890559:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.890570:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395270.890583:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19e:0x0]: returning size 6 00010000:00010000:0.0:1789395270.890713:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e6f3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ea expref: 158 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.890734:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e6fa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ea expref: 157 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.890745:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:0.0:1789395270.890748:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395270.890751:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376800, rc 0) 00000100:00100000:0.0:1789395270.890829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+157:22080:x1876316231969408:12345-192.168.203.54@tcp:101:bash.0 Request processed in 642us (1082us total) trans 4294968738 rc 0/0 00000100:00100000:0.0:1789395270.890837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24012 00000100:00100000:2.0:1789395270.895922:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.896168:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231969664 00000100:00100000:3.0:1789395270.896181:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231969664 00000100:00100000:3.0:1789395270.896255:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24013 00000100:00100000:3.0:1789395270.896267:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+157:22080:x1876316231969664:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395270.896348:0:21735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789395270.896603:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e6fa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ea expref: 157 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.896637:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316daf2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106640 expref: 156 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.896648:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:3.0:1789395270.896653:0:21735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395270.897063:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.897080:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.897091:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395270.897146:0:21735:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968739 00000004:00010000:3.0:1789395270.897171:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b918b8fd reply state 00000000afc396ac transno 4294968740 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.897184:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.897191:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:3.0:1789395270.897193:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395270.897196:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395270.897321:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+158:22080:x1876316231969664:12345-192.168.203.54@tcp:36:bash.0 Request processed in 1054us (1421us total) trans 4294968740 rc 0/0 00000100:00100000:3.0:1789395270.897330:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24013 00000020:00080000:3.0:1789395270.897336:0:21735:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395270.900848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.901070:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231969792 00000100:00100000:3.0:1789395270.901084:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231969792 00000100:00100000:3.0:1789395270.901164:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24014 00000100:00100000:3.0:1789395270.901175:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+158:22080:x1876316231969792:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395270.901203:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.901230:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e70f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069f1 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.901308:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e70f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069f1 expref: 159 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.901325:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51bc00/0xff35729af316e70f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069f1 expref: 159 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.901353:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:3.0:1789395270.901357:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789395270.901361:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51bc00, rc 0) 00000100:00100000:3.0:1789395270.901672:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+159:22080:x1876316231969792:12345-192.168.203.54@tcp:101:bash.0 Request processed in 498us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395270.901679:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24014 00000100:00100000:2.0:1789395270.906241:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.906603:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231969920 00000100:00100000:3.0:1789395270.906616:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231969920 00002000:00010000:2.0:1789395270.906728:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:2.0:1789395270.906734:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca141500 with x1876316231969920 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395270.906747:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca141500. 00000100:00100000:2.0:1789395270.906784:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 117 00000100:00100000:2.0:1789395270.906794:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231969920:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:2.0:1789395270.907132:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395270.907136:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:2.0:1789395270.907139:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395270.907142:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:2.0:1789395270.907144:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395270.907226:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231969920:12345-192.168.203.54@tcp:10:bash.0 Request processed in 432us (999us total) trans 4294970026 rc 0/0 00000100:00100000:2.0:1789395270.907235:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 117 00002000:00010000:2.0:1789395270.907239:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:2.0:1789395270.907243:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca141500 with x1876316231969920 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395270.907248:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca141500. 00000100:00100000:0.0:1789395270.911296:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395270.911728:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231970048 00000100:00100000:2.0:1789395270.911742:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231970048 00000100:00100000:2.0:1789395270.911816:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5437 00000100:00100000:2.0:1789395270.911828:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231970048:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395270.913278:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970026 is committed 00000100:00100000:2.0:1789395270.913633:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231970048:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1801us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395270.913645:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5437 00000100:00100000:0.0:1789395270.917231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.917325:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231970304 00000100:00100000:3.0:1789395270.917338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231970304 00000100:00100000:3.0:1789395270.917451:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5301 00000100:00100000:3.0:1789395270.917463:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+159:22080:x1876316231970304:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:3.0:1789395270.917741:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+160:22080:x1876316231970304:12345-192.168.203.54@tcp:35:bash.0 Request processed in 279us (523us total) trans 4294968741 rc 0/0 00000100:00100000:3.0:1789395270.917750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5301 00000100:00100000:3.0:1789395270.921258:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.922042:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231970432 00000100:00100000:0.0:1789395270.922056:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231970432 00000100:00100000:0.0:1789395270.922188:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24015 00000100:00100000:0.0:1789395270.922200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+160:22080:x1876316231970432:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395270.922424:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+160:22080:x1876316231970432:12345-192.168.203.54@tcp:44:bash.0 Request processed in 226us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.922431:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24015 00000100:00100000:2.0:1789395270.926353:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.926633:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231970688 00000100:00100000:0.0:1789395270.926646:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231970688 00000100:00100000:0.0:1789395270.926766:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24016 00000100:00100000:0.0:1789395270.926778:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+160:22080:x1876316231970688:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395270.926802:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.926827:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e716 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069f8 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.926977:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e71d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.926995:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e71d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.927008:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e71d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395270.927021:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19f:0x0]: returning size 6 00010000:00010000:0.0:1789395270.927148:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e716 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069f8 expref: 163 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.927174:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e71d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069f8 expref: 162 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.927183:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:0.0:1789395270.927185:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395270.927189:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377a00, rc 0) 00000100:00100000:0.0:1789395270.927269:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+162:22080:x1876316231970688:12345-192.168.203.54@tcp:101:bash.0 Request processed in 493us (928us total) trans 4294968742 rc 0/0 00000100:00100000:0.0:1789395270.927277:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24016 00000100:00100000:1.0:1789395270.932638:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.933049:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231970944 00000100:00100000:3.0:1789395270.933062:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231970944 00000100:00100000:2.0:1789395270.933897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24017 00000100:00100000:2.0:1789395270.934156:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+162:22080:x1876316231970944:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:2.0:1789395270.934234:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789395270.934267:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e71d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069f8 expref: 162 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.934293:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316db15 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106647 expref: 161 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.934306:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:2.0:1789395270.934311:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395270.934549:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.934565:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.934576:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395270.935795:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968743 00000004:00010000:2.0:1789395270.935857:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041962f7f reply state 000000007140c2a8 transno 4294968744 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.935879:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.935888:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:2.0:1789395270.935892:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395270.935896:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395270.936067:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+163:22080:x1876316231970944:12345-192.168.203.54@tcp:36:bash.0 Request processed in 2153us (3438us total) trans 4294968744 rc 0/0 00000100:00100000:2.0:1789395270.936077:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24017 00000020:00080000:2.0:1789395270.936085:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395270.939311:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.939374:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231971072 00000100:00100000:0.0:1789395270.939426:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231971072 00000100:00100000:0.0:1789395270.939504:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24018 00000100:00100000:0.0:1789395270.939516:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+163:22080:x1876316231971072:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395270.939543:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.939570:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e732 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa44584021069ff expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.939641:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e732 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ff expref: 164 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.939657:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376c00/0xff35729af316e732 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021069ff expref: 164 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.939746:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:0.0:1789395270.939750:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395270.939754:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376c00, rc 0) 00000100:00100000:0.0:1789395270.939826:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+164:22080:x1876316231971072:12345-192.168.203.54@tcp:101:bash.0 Request processed in 311us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.939833:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24018 00000100:00100000:0.0:1789395270.945328:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.945492:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231971200 00000100:00100000:1.0:1789395270.945504:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231971200 00002000:00010000:1.0:1789395270.945558:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.945563:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f63b80 with x1876316231971200 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.945576:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4e7f63b80. 00000100:00100000:1.0:1789395270.945626:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 118 00000100:00100000:1.0:1789395270.945638:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231971200:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395270.945970:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395270.945975:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.945978:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395270.945980:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395270.945982:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395270.946279:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231971200:12345-192.168.203.54@tcp:10:bash.0 Request processed in 641us (960us total) trans 4294969999 rc 0/0 00000100:00100000:1.0:1789395270.946289:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 118 00002000:00010000:1.0:1789395270.946293:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:1.0:1789395270.946295:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f63b80 with x1876316231971200 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395270.946301:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4e7f63b80. 00000100:00100000:2.0:1789395270.950097:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.950252:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231971328 00000100:00100000:0.0:1789395270.950264:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231971328 00000100:00100000:0.0:1789395270.950344:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5438 00000100:00100000:0.0:1789395270.950356:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231971328:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395270.953521:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969999 is committed 00000100:00100000:0.0:1789395270.953756:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231971328:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3394us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.953892:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5438 00000100:00100000:2.0:1789395270.957999:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.958106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231971584 00000100:00100000:1.0:1789395270.958118:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231971584 00000100:00100000:1.0:1789395270.958191:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5302 00000100:00100000:1.0:1789395270.958204:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+164:22080:x1876316231971584:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395270.958566:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+165:22080:x1876316231971584:12345-192.168.203.54@tcp:35:bash.0 Request processed in 362us (579us total) trans 4294968745 rc 0/0 00000100:00100000:1.0:1789395270.958574:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5302 00000100:00100000:2.0:1789395270.962601:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.962667:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231971712 00000100:00100000:3.0:1789395270.962803:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231971712 00000100:00100000:3.0:1789395270.962937:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24019 00000100:00100000:3.0:1789395270.962951:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+165:22080:x1876316231971712:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:3.0:1789395270.963129:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+165:22080:x1876316231971712:12345-192.168.203.54@tcp:44:bash.0 Request processed in 182us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395270.963140:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24019 00000100:00100000:2.0:1789395270.967899:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.968020:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231971968 00000100:00100000:3.0:1789395270.968033:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231971968 00000100:00100000:3.0:1789395270.968112:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24020 00000100:00100000:3.0:1789395270.968124:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+165:22080:x1876316231971968:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395270.968146:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395270.968170:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e739 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a06 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.968654:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e740 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.968671:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e740 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.968686:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e740 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395270.968700:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a0:0x0]: returning size 6 00010000:00010000:3.0:1789395270.968838:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e739 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a06 expref: 168 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.968862:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e740 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a06 expref: 167 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.968871:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:3.0:1789395270.968875:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395270.968878:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51ac00, rc 0) 00000100:00100000:3.0:1789395270.968966:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+167:22080:x1876316231971968:12345-192.168.203.54@tcp:101:bash.0 Request processed in 844us (1082us total) trans 4294968746 rc 0/0 00000100:00100000:3.0:1789395270.968974:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24020 00000100:00100000:2.0:1789395270.976012:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.976132:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231972096 00000100:00100000:1.0:1789395270.976144:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231972096 00000100:00100000:1.0:1789395270.976427:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1460 00000100:00100000:1.0:1789395270.976451:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+167:2397:x1876316231972096:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395270.976471:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395270.976503:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e740 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a06 expref: 167 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395270.976527:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:1.0:1789395270.976533:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395270.976604:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+166:2397:x1876316231972096:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 167us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395270.976612:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1460 00000100:00100000:2.0:1789395270.978871:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395270.979015:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231972352 00000100:00100000:3.0:1789395270.979028:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231972352 00000100:00100000:3.0:1789395270.979094:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24021 00000100:00100000:3.0:1789395270.979105:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+166:22080:x1876316231972352:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395270.979245:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395270.979276:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316db38 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210664e expref: 166 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395270.979299:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:3.0:1789395270.979305:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395270.980985:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.981012:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.981025:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395270.981090:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968747 00000004:00010000:2.0:1789395270.981118:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdf0e83c reply state 00000000e294b621 transno 4294968748 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.981132:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395270.981140:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:2.0:1789395270.981143:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395270.981148:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395270.981331:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+168:22080:x1876316231972352:12345-192.168.203.54@tcp:36:bash.0 Request processed in 2222us (2467us total) trans 4294968748 rc 0/0 00000100:00100000:2.0:1789395270.981341:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24021 00000020:00080000:2.0:1789395270.981348:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395270.984896:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.984994:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231972480 00000100:00100000:0.0:1789395270.985007:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231972480 00000100:00100000:0.0:1789395270.985088:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24022 00000100:00100000:0.0:1789395270.985100:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+168:22080:x1876316231972480:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395270.985131:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395270.985157:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e755 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a0d expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.985243:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e755 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a0d expref: 169 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.985260:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377e00/0xff35729af316e755 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a0d expref: 169 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395270.985283:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:0.0:1789395270.985287:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395270.985291:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377e00, rc 0) 00000100:00100000:0.0:1789395270.985364:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+169:22080:x1876316231972480:12345-192.168.203.54@tcp:101:bash.0 Request processed in 267us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395270.985373:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24022 00000100:00100000:3.0:1789395270.992747:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395270.992971:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231972608 00000100:00100000:0.0:1789395270.992984:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231972608 00002000:00010000:0.0:1789395270.993039:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/5 (0->18446744073709551615) 00002000:00100000:0.0:1789395270.993045:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7100 with x1876316231972608 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395270.993060:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7100. 00000100:00100000:0.0:1789395270.993164:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 119 00000100:00100000:0.0:1789395270.993177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231972608:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:0.0:1789395270.993575:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789395270.993580:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:0.0:1789395270.993582:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789395270.993585:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:0.0:1789395270.993587:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789395270.993670:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231972608:12345-192.168.203.54@tcp:10:bash.0 Request processed in 493us (935us total) trans 4294970027 rc 0/0 00000100:00100000:0.0:1789395270.993679:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 119 00002000:00010000:0.0:1789395270.993684:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/5 (0->18446744073709551615) 00002000:00100000:0.0:1789395270.993687:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf7100 with x1876316231972608 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395270.993692:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4fedf7100. 00000100:00100000:2.0:1789395270.998984:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395270.999095:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231972736 00000100:00100000:1.0:1789395270.999107:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231972736 00000100:00100000:1.0:1789395270.999180:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5439 00000100:00100000:1.0:1789395270.999193:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231972736:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.004059:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970027 is committed 00000100:00100000:1.0:1789395271.004356:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231972736:12345-192.168.203.54@tcp:16:bash.0 Request processed in 5088us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.004435:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5439 00000100:00100000:1.0:1789395271.009857:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.009992:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231972992 00000100:00100000:0.0:1789395271.010006:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231972992 00000100:00100000:0.0:1789395271.010132:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5303 00000100:00100000:0.0:1789395271.010145:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+169:22080:x1876316231972992:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395271.010479:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+170:22080:x1876316231972992:12345-192.168.203.54@tcp:35:bash.0 Request processed in 335us (636us total) trans 4294968749 rc 0/0 00000100:00100000:0.0:1789395271.010488:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5303 00000100:00080000:3.0:1789395271.011527:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789395271.015142:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.015501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231973120 00000100:00100000:1.0:1789395271.015514:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231973120 00000100:00100000:1.0:1789395271.015593:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24023 00000100:00100000:1.0:1789395271.015605:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+170:22080:x1876316231973120:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395271.015787:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+170:22080:x1876316231973120:12345-192.168.203.54@tcp:44:bash.0 Request processed in 183us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.015795:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24023 00000100:00100000:2.0:1789395271.023085:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.023575:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231973376 00000100:00100000:0.0:1789395271.023589:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231973376 00000100:00100000:0.0:1789395271.023668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24024 00000100:00100000:0.0:1789395271.023680:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+170:22080:x1876316231973376:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.023706:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.023738:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e75c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a14 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.023954:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e763 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.023970:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e763 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.023983:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e763 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395271.023997:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 6 00010000:00010000:0.0:1789395271.024129:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e75c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a14 expref: 173 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.024459:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e763 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a14 expref: 172 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.024470:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:0.0:1789395271.024474:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395271.024477:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377000, rc 0) 00000100:00100000:0.0:1789395271.027915:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+172:22080:x1876316231973376:12345-192.168.203.54@tcp:101:bash.0 Request processed in 4209us (4827us total) trans 4294968750 rc 0/0 00000100:00100000:0.0:1789395271.027932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24024 00000100:00100000:2.0:1789395271.038323:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.038368:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231973632 00000100:00100000:3.0:1789395271.038430:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231973632 00000100:00100000:3.0:1789395271.038500:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24025 00000100:00100000:3.0:1789395271.038512:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+172:22080:x1876316231973632:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395271.038584:0:21735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789395271.038615:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e763 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a14 expref: 172 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.038638:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57c00/0xff35729af316db5b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106655 expref: 171 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.038651:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:3.0:1789395271.038656:0:21735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395271.038889:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.038903:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.038925:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395271.038980:0:21735:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968751 00000004:00010000:3.0:1789395271.039004:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000142d71c0 reply state 000000008c6b6536 transno 4294968752 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.039017:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.039025:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:3.0:1789395271.039028:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395271.039031:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395271.039145:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+173:22080:x1876316231973632:12345-192.168.203.54@tcp:36:bash.0 Request processed in 635us (835us total) trans 4294968752 rc 0/0 00000100:00100000:3.0:1789395271.039153:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24025 00000020:00080000:3.0:1789395271.039159:0:21735:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.042136:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.042830:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231973760 00000100:00100000:1.0:1789395271.042939:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231973760 00000100:00100000:1.0:1789395271.043050:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24026 00000100:00100000:1.0:1789395271.043063:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+173:22080:x1876316231973760:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.043093:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.043119:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215600/0xff35729af316e778 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.043192:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215600/0xff35729af316e778 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a1b expref: 174 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.043207:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215600/0xff35729af316e778 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a1b expref: 174 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.043229:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:1.0:1789395271.043233:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395271.043236:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215600, rc 0) 00000100:00100000:1.0:1789395271.043321:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+174:22080:x1876316231973760:12345-192.168.203.54@tcp:101:bash.0 Request processed in 259us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.043329:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24026 00000100:00100000:2.0:1789395271.051602:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.051692:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231973888 00000100:00100000:3.0:1789395271.051705:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231973888 00002000:00010000:3.0:1789395271.051756:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.051771:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79f4000 with x1876316231973888 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.051785:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c79f4000. 00000100:00100000:3.0:1789395271.051821:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 120 00000100:00100000:3.0:1789395271.051834:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231973888:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:3.0:1789395271.052177:0:22628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395271.052181:0:22628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395271.052183:0:22628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395271.052185:0:22628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395271.052187:0:22628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395271.052273:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231973888:12345-192.168.203.54@tcp:10:bash.0 Request processed in 441us (685us total) trans 4294970000 rc 0/0 00000100:00100000:3.0:1789395271.052282:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 120 00002000:00010000:3.0:1789395271.052286:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.052289:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c79f4000 with x1876316231973888 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.052293:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c79f4000. 00000100:00100000:2.0:1789395271.058037:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.058156:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231974016 00000100:00100000:1.0:1789395271.058170:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231974016 00000100:00100000:1.0:1789395271.058284:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5440 00000100:00100000:1.0:1789395271.058296:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a500927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231974016:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395271.060245:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970000 is committed 00000100:00100000:1.0:1789395271.060713:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a500927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231974016:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2411us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.060727:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5440 00000100:00100000:0.0:1789395271.065279:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.065699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231974272 00000100:00100000:3.0:1789395271.065713:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231974272 00000100:00100000:2.0:1789395271.066028:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5304 00000100:00100000:2.0:1789395271.066041:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+174:22080:x1876316231974272:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:2.0:1789395271.066342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+175:22080:x1876316231974272:12345-192.168.203.54@tcp:35:bash.0 Request processed in 304us (1080us total) trans 4294968753 rc 0/0 00000100:00100000:2.0:1789395271.066351:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5304 00000100:00100000:2.0:1789395271.070928:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.071142:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231974400 00000100:00100000:0.0:1789395271.071155:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231974400 00000100:00100000:0.0:1789395271.071229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24027 00000100:00100000:0.0:1789395271.071240:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+175:22080:x1876316231974400:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395271.071645:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+175:22080:x1876316231974400:12345-192.168.203.54@tcp:44:bash.0 Request processed in 405us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.071654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24027 00000100:00100000:1.0:1789395271.075346:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.075685:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231974656 00000100:00100000:3.0:1789395271.075806:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231974656 00000100:00100000:2.0:1789395271.076088:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24028 00000100:00100000:2.0:1789395271.076101:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+175:22080:x1876316231974656:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395271.076126:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395271.076150:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e77f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a22 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.076302:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e786 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.076319:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e786 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.076332:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e786 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395271.076345:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a2:0x0]: returning size 6 00010000:00010000:2.0:1789395271.076673:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e77f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a22 expref: 178 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.076706:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e786 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a22 expref: 177 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.076715:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:2.0:1789395271.076718:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395271.076722:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff4400, rc 0) 00000100:00100000:2.0:1789395271.076807:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+177:22080:x1876316231974656:12345-192.168.203.54@tcp:101:bash.0 Request processed in 707us (1474us total) trans 4294968754 rc 0/0 00000100:00100000:2.0:1789395271.076815:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24028 00000100:00100000:1.0:1789395271.085638:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.085737:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231974912 00000100:00100000:3.0:1789395271.085751:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231974912 00000100:00100000:3.0:1789395271.085824:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24029 00000100:00100000:3.0:1789395271.085836:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+177:22080:x1876316231974912:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395271.085930:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789395271.085962:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e786 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a22 expref: 177 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.085992:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316db7e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210665c expref: 176 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.086009:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:3.0:1789395271.086014:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395271.086229:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.086244:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.086254:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395271.086303:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968755 00000004:00010000:3.0:1789395271.086328:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd5a35bc reply state 000000008bf900e4 transno 4294968756 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.086341:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.086348:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:3.0:1789395271.086351:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395271.086354:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395271.086532:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+178:22080:x1876316231974912:12345-192.168.203.54@tcp:36:bash.0 Request processed in 696us (907us total) trans 4294968756 rc 0/0 00000100:00100000:3.0:1789395271.086541:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24029 00000020:00080000:3.0:1789395271.086547:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.092776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.092987:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231975040 00000100:00100000:0.0:1789395271.093001:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231975040 00000100:00100000:0.0:1789395271.093085:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24030 00000100:00100000:0.0:1789395271.093096:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+178:22080:x1876316231975040:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.093124:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.093150:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e79b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a29 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.093226:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e79b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a29 expref: 179 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.093243:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377800/0xff35729af316e79b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a29 expref: 179 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.093267:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:0.0:1789395271.093270:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395271.093274:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377800, rc 0) 00000100:00100000:0.0:1789395271.093351:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+179:22080:x1876316231975040:12345-192.168.203.54@tcp:101:bash.0 Request processed in 256us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.093358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24030 00000100:00100000:1.0:1789395271.103636:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.103737:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231975168 00000100:00100000:3.0:1789395271.103751:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231975168 00002000:00010000:3.0:1789395271.103830:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/6 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.103835:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6ce00 with x1876316231975168 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.103850:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6ce00. 00000100:00100000:3.0:1789395271.103888:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 121 00000100:00100000:3.0:1789395271.103901:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231975168:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:3.0:1789395271.104258:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395271.104262:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395271.104265:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395271.104268:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395271.104270:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395271.104541:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231975168:12345-192.168.203.54@tcp:10:bash.0 Request processed in 642us (920us total) trans 4294970028 rc 0/0 00000100:00100000:3.0:1789395271.104550:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 121 00002000:00010000:3.0:1789395271.104555:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/6 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.104558:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c9a6ce00 with x1876316231975168 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.104565:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c9a6ce00. 00000100:00080000:0.0:1789395271.104920:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789395271.111876:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.114532:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231975296 00000100:00100000:0.0:1789395271.114550:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231975296 00000100:00100000:0.0:1789395271.114627:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5441 00000100:00100000:0.0:1789395271.114639:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2398:x1876316231975296:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:0.0:1789395271.116860:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970028 is committed 00000100:00100000:1.0:1789395271.117363:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231975296:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2717us (5493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.117426:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5441 00000100:00100000:1.0:1789395271.120564:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.120669:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231975552 00000100:00100000:0.0:1789395271.120682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231975552 00000100:00100000:0.0:1789395271.120754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5305 00000100:00100000:0.0:1789395271.120764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d06850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+179:22080:x1876316231975552:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395271.121063:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d06850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+180:22080:x1876316231975552:12345-192.168.203.54@tcp:35:bash.0 Request processed in 299us (510us total) trans 4294968757 rc 0/0 00000100:00100000:0.0:1789395271.121072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5305 00000100:00100000:2.0:1789395271.125007:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.125119:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231975680 00000100:00100000:0.0:1789395271.125132:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231975680 00000100:00100000:0.0:1789395271.125209:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24031 00000100:00100000:0.0:1789395271.125220:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+180:22080:x1876316231975680:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395271.125525:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+180:22080:x1876316231975680:12345-192.168.203.54@tcp:44:bash.0 Request processed in 306us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.125532:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24031 00000100:00100000:1.0:1789395271.133550:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.133630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231975936 00000100:00100000:3.0:1789395271.133643:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231975936 00000100:00100000:3.0:1789395271.133711:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24032 00000100:00100000:3.0:1789395271.133723:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+180:22080:x1876316231975936:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395271.133746:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395271.133772:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e7a2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a30 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.133935:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e7a9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.133951:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.133968:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789395271.133982:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a3:0x0]: returning size 6 00010000:00010000:3.0:1789395271.134123:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e7a2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a30 expref: 183 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.134145:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e7a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a30 expref: 182 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.134155:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:3.0:1789395271.134158:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789395271.134162:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344a00, rc 0) 00000100:00100000:3.0:1789395271.134512:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+182:22080:x1876316231975936:12345-192.168.203.54@tcp:101:bash.0 Request processed in 789us (976us total) trans 4294968758 rc 0/0 00000100:00100000:3.0:1789395271.134521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24032 00000100:00100000:1.0:1789395271.138689:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.138803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231976192 00000100:00100000:0.0:1789395271.138817:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231976192 00000100:00100000:0.0:1789395271.139025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24033 00000100:00100000:0.0:1789395271.139037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+182:22080:x1876316231976192:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395271.139114:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395271.139150:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e7a9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a30 expref: 182 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.139177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316dba1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106663 expref: 181 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.139188:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:0.0:1789395271.139194:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395271.139434:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.139456:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.139466:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395271.139515:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968759 00000004:00010000:0.0:1789395271.139539:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001cb5c3e reply state 00000000bf90b067 transno 4294968760 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.139552:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.139558:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:0.0:1789395271.139561:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.139564:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395271.139698:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+183:22080:x1876316231976192:12345-192.168.203.54@tcp:36:bash.0 Request processed in 662us (1023us total) trans 4294968760 rc 0/0 00000100:00100000:0.0:1789395271.139705:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24033 00000020:00080000:0.0:1789395271.139712:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.142223:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.142326:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231976320 00000100:00100000:1.0:1789395271.142338:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231976320 00000100:00100000:1.0:1789395271.142428:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24034 00000100:00100000:1.0:1789395271.142439:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+183:22080:x1876316231976320:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.142466:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.142493:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e7be lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a37 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.142560:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e7be lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a37 expref: 184 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.142576:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214000/0xff35729af316e7be lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a37 expref: 184 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.142598:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:1.0:1789395271.142601:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395271.142605:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214000, rc 0) 00000100:00100000:1.0:1789395271.142993:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+184:22080:x1876316231976320:12345-192.168.203.54@tcp:101:bash.0 Request processed in 553us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.143001:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24034 00000100:00100000:3.0:1789395271.148087:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.148138:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231976448 00000100:00100000:0.0:1789395271.148151:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231976448 00002000:00010000:0.0:1789395271.148203:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/6 (0->18446744073709551615) 00002000:00100000:0.0:1789395271.148209:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf4e00 with x1876316231976448 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395271.148223:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4fedf4e00. 00000100:00100000:0.0:1789395271.148264:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 122 00000100:00100000:0.0:1789395271.148275:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231976448:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:0.0:1789395271.148638:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789395271.148643:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:0.0:1789395271.148646:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789395271.148648:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:0.0:1789395271.148650:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789395271.148776:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231976448:12345-192.168.203.54@tcp:10:bash.0 Request processed in 501us (711us total) trans 4294970001 rc 0/0 00000100:00100000:0.0:1789395271.148784:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 122 00002000:00010000:0.0:1789395271.148787:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/6 (0->18446744073709551615) 00002000:00100000:0.0:1789395271.148790:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4fedf4e00 with x1876316231976448 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395271.148795:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4fedf4e00. 00000100:00100000:2.0:1789395271.154289:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.154370:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231976576 00000100:00100000:0.0:1789395271.154404:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231976576 00000100:00100000:0.0:1789395271.154512:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5442 00000100:00100000:0.0:1789395271.154525:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231976576:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.156526:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970001 is committed 00000100:00100000:0.0:1789395271.156705:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231976576:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2176us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.156716:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5442 00000100:00100000:2.0:1789395271.161577:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.161959:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231976832 00000100:00100000:0.0:1789395271.161972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231976832 00000100:00100000:0.0:1789395271.162118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5306 00000100:00100000:0.0:1789395271.162131:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+184:22080:x1876316231976832:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395271.162664:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+185:22080:x1876316231976832:12345-192.168.203.54@tcp:35:bash.0 Request processed in 533us (1098us total) trans 4294968761 rc 0/0 00000100:00100000:0.0:1789395271.162673:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5306 00000100:00100000:2.0:1789395271.166801:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.166925:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231976960 00000100:00100000:0.0:1789395271.166938:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231976960 00000100:00100000:0.0:1789395271.167118:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24035 00000100:00100000:0.0:1789395271.167130:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+185:22080:x1876316231976960:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395271.167502:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+185:22080:x1876316231976960:12345-192.168.203.54@tcp:44:bash.0 Request processed in 372us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.167511:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24035 00000100:00100000:2.0:1789395271.171513:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.172143:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231977216 00000100:00100000:1.0:1789395271.172158:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231977216 00000100:00100000:1.0:1789395271.172271:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24036 00000100:00100000:1.0:1789395271.172291:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+185:22080:x1876316231977216:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.172316:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.172339:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7c5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.172510:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e7cc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.172527:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e7cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.172539:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e7cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.172552:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a4:0x0]: returning size 7 00010000:00010000:1.0:1789395271.172699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7c5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a3e expref: 188 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.172721:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e7cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a3e expref: 187 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.172741:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:1.0:1789395271.172745:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.172749:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215a00, rc 0) 00000100:00100000:1.0:1789395271.172825:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+187:22080:x1876316231977216:12345-192.168.203.54@tcp:101:bash.0 Request processed in 544us (1326us total) trans 4294968762 rc 0/0 00000100:00100000:1.0:1789395271.172837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24036 00000100:00100000:2.0:1789395271.177531:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.178263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231977472 00000100:00100000:0.0:1789395271.178277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231977472 00000100:00100000:0.0:1789395271.178382:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24037 00000100:00100000:0.0:1789395271.178413:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+187:22080:x1876316231977472:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395271.178482:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395271.178512:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e7cc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a3e expref: 187 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.178538:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316dbc4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210666a expref: 186 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.178550:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:0.0:1789395271.178556:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395271.178792:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.178807:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.178818:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395271.179106:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968763 00000004:00010000:0.0:1789395271.179134:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d11d98eb reply state 00000000d3e938bd transno 4294968764 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.179147:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.179153:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:0.0:1789395271.179156:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.179165:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395271.179289:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+188:22080:x1876316231977472:12345-192.168.203.54@tcp:36:bash.0 Request processed in 877us (1770us total) trans 4294968764 rc 0/0 00000100:00100000:0.0:1789395271.179298:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24037 00000020:00080000:0.0:1789395271.179304:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.182626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.182997:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231977600 00000100:00100000:3.0:1789395271.183010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231977600 00000100:00100000:3.0:1789395271.183081:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24038 00000100:00100000:3.0:1789395271.183093:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+188:22080:x1876316231977600:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:3.0:1789395271.183121:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789395271.183145:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e7e1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a45 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.183380:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e7e1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a45 expref: 189 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.183500:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344400/0xff35729af316e7e1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a45 expref: 189 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.183526:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:3.0:1789395271.183532:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789395271.183536:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9344400, rc 0) 00000100:00100000:2.0:1789395271.185061:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+189:22080:x1876316231977600:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1957us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.185075:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24038 00000100:00100000:2.0:1789395271.189655:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.189774:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231977728 00000100:00100000:1.0:1789395271.189787:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231977728 00002000:00010000:1.0:1789395271.189843:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.189849:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8ba8e00 with x1876316231977728 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.189864:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8ba8e00. 00000100:00100000:1.0:1789395271.189952:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 123 00000100:00100000:1.0:1789395271.189965:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231977728:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395271.190318:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395271.190322:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.190325:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395271.190327:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.190329:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395271.190451:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231977728:12345-192.168.203.54@tcp:10:bash.0 Request processed in 488us (809us total) trans 4294970029 rc 0/0 00000100:00100000:1.0:1789395271.190460:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 123 00002000:00010000:1.0:1789395271.190464:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.190467:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8ba8e00 with x1876316231977728 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.190472:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c8ba8e00. 00000100:00100000:3.0:1789395271.194064:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.194243:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231977856 00000100:00100000:0.0:1789395271.194255:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231977856 00000100:00100000:0.0:1789395271.194343:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5443 00000100:00100000:0.0:1789395271.194356:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231977856:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:0.0:1789395271.196057:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970029 is committed 00000100:00100000:2.0:1789395271.196482:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231977856:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2121us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.196496:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5443 00000100:00100000:0.0:1789395271.199372:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.199584:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231978112 00000100:00100000:1.0:1789395271.199598:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231978112 00000100:00100000:1.0:1789395271.199700:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5307 00000100:00100000:1.0:1789395271.199712:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+189:22080:x1876316231978112:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395271.200045:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+190:22080:x1876316231978112:12345-192.168.203.54@tcp:35:bash.0 Request processed in 334us (686us total) trans 4294968765 rc 0/0 00000100:00100000:1.0:1789395271.200057:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5307 00000100:00100000:3.0:1789395271.202690:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.202782:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231978240 00000100:00100000:2.0:1789395271.202795:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231978240 00000100:00100000:2.0:1789395271.202860:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24039 00000100:00100000:2.0:1789395271.202871:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+190:22080:x1876316231978240:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:2.0:1789395271.203254:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4fedf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+190:22080:x1876316231978240:12345-192.168.203.54@tcp:44:bash.0 Request processed in 384us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.203263:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24039 00000100:00100000:3.0:1789395271.206739:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.206843:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231978496 00000100:00100000:1.0:1789395271.206865:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231978496 00000100:00100000:1.0:1789395271.207004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24040 00000100:00100000:1.0:1789395271.207018:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+190:22080:x1876316231978496:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.207044:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.207071:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e7e8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.207211:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7ef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.207228:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.207240:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.207252:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a5:0x0]: returning size 7 00010000:00010000:1.0:1789395271.207494:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e7e8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a4c expref: 193 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.207518:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7ef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a4c expref: 192 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.207527:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:1.0:1789395271.207530:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.207534:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214400, rc 0) 00000100:00100000:1.0:1789395271.207657:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+192:22080:x1876316231978496:12345-192.168.203.54@tcp:101:bash.0 Request processed in 641us (929us total) trans 4294968766 rc 0/0 00000100:00100000:1.0:1789395271.207665:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24040 00000100:00100000:0.0:1789395271.212504:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.212636:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231978752 00000100:00100000:2.0:1789395271.212649:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231978752 00000100:00100000:2.0:1789395271.212722:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24041 00000100:00100000:2.0:1789395271.212734:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+192:22080:x1876316231978752:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:2.0:1789395271.212843:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789395271.212886:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e7ef lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a4c expref: 192 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.212924:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316dbe7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106671 expref: 191 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.212942:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:2.0:1789395271.212947:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395271.213161:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.213177:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.213188:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395271.213233:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968767 00000004:00010000:2.0:1789395271.213258:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082b4fd32 reply state 00000000964d9722 transno 4294968768 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.213271:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.213278:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:2.0:1789395271.213281:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395271.213284:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395271.213435:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+193:22080:x1876316231978752:12345-192.168.203.54@tcp:36:bash.0 Request processed in 702us (943us total) trans 4294968768 rc 0/0 00000100:00100000:2.0:1789395271.213443:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24041 00000020:00080000:2.0:1789395271.213450:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395271.216968:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.217135:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231978880 00000100:00100000:0.0:1789395271.217148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231978880 00000100:00100000:0.0:1789395271.217223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24042 00000100:00100000:0.0:1789395271.217235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+193:22080:x1876316231978880:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.217263:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.217289:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e804 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a53 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.217361:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e804 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a53 expref: 194 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.217376:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376800/0xff35729af316e804 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a53 expref: 194 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.217438:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:0.0:1789395271.217442:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395271.217446:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca376800, rc 0) 00000100:00100000:0.0:1789395271.217518:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+194:22080:x1876316231978880:12345-192.168.203.54@tcp:101:bash.0 Request processed in 285us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.217525:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24042 00000100:00100000:3.0:1789395271.222963:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.223064:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231979008 00000100:00100000:1.0:1789395271.223077:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231979008 00002000:00010000:1.0:1789395271.223133:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.223138:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db1500 with x1876316231979008 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.223152:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db1500. 00000100:00100000:1.0:1789395271.223196:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 124 00000100:00100000:1.0:1789395271.223209:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231979008:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395271.223596:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395271.223601:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.223604:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395271.223606:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.223609:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395271.223679:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231979008:12345-192.168.203.54@tcp:10:bash.0 Request processed in 471us (729us total) trans 4294970002 rc 0/0 00000100:00100000:1.0:1789395271.223688:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 124 00002000:00010000:1.0:1789395271.223693:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.223696:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a501db1500 with x1876316231979008 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.223701:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a501db1500. 00000100:00100000:1.0:1789395271.228685:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.228783:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231979136 00000100:00100000:0.0:1789395271.228796:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231979136 00000100:00100000:0.0:1789395271.228874:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5444 00000100:00100000:0.0:1789395271.228885:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231979136:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.230628:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970002 is committed 00000100:00100000:0.0:1789395271.230914:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231979136:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2016us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.230928:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5444 00000100:00100000:3.0:1789395271.234547:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.234730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231979392 00000100:00100000:0.0:1789395271.234743:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231979392 00000100:00100000:0.0:1789395271.234844:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5308 00000100:00100000:0.0:1789395271.234855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+194:22080:x1876316231979392:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395271.235191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+195:22080:x1876316231979392:12345-192.168.203.54@tcp:35:bash.0 Request processed in 337us (830us total) trans 4294968769 rc 0/0 00000100:00100000:0.0:1789395271.235200:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5308 00000100:00100000:2.0:1789395271.241041:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.241134:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231979520 00000100:00100000:0.0:1789395271.241149:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231979520 00000100:00100000:0.0:1789395271.241220:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24043 00000100:00100000:0.0:1789395271.241232:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+195:22080:x1876316231979520:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395271.241455:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+195:22080:x1876316231979520:12345-192.168.203.54@tcp:44:bash.0 Request processed in 225us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.241463:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24043 00000100:00100000:2.0:1789395271.245205:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.245322:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231979776 00000100:00100000:0.0:1789395271.245335:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231979776 00000100:00100000:0.0:1789395271.245443:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24044 00000100:00100000:0.0:1789395271.245459:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+195:22080:x1876316231979776:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.245483:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.245507:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e80b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a5a expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.246325:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e812 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.246346:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e812 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.246361:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e812 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395271.246502:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a6:0x0]: returning size 7 00010000:00010000:0.0:1789395271.246647:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e80b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a5a expref: 198 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.246670:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e812 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a5a expref: 197 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.246687:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:0.0:1789395271.246691:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395271.246695:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377000, rc 0) 00000100:00100000:0.0:1789395271.246825:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+197:22080:x1876316231979776:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1367us (1634us total) trans 4294968770 rc 0/0 00000100:00100000:0.0:1789395271.246834:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24044 00000100:00100000:2.0:1789395271.253982:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.254990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231980032 00000100:00100000:0.0:1789395271.255009:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231980032 00000100:00100000:0.0:1789395271.255154:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24045 00000100:00100000:0.0:1789395271.255167:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+197:22080:x1876316231980032:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395271.255254:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395271.255287:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e812 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a5a expref: 197 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.255315:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316dc0a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106678 expref: 196 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.255327:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:0.0:1789395271.255332:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395271.255640:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.255657:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.255668:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395271.255719:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968771 00000004:00010000:0.0:1789395271.255751:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000614edf5d reply state 000000000fa55162 transno 4294968772 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.255764:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.255771:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:0.0:1789395271.255774:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.255777:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395271.255895:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+198:22080:x1876316231980032:12345-192.168.203.54@tcp:36:bash.0 Request processed in 729us (1927us total) trans 4294968772 rc 0/0 00000100:00100000:0.0:1789395271.255903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24045 00000020:00080000:0.0:1789395271.255922:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.265010:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.271626:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231980160 00000100:00100000:0.0:1789395271.271647:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231980160 00000100:00100000:0.0:1789395271.271759:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24046 00000100:00100000:0.0:1789395271.271770:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+198:22080:x1876316231980160:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.271797:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.271822:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e827 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a61 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.271893:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e827 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a61 expref: 199 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.271919:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377000/0xff35729af316e827 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a61 expref: 199 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.271947:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:0.0:1789395271.271951:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395271.271955:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca377000, rc 0) 00000100:00100000:0.0:1789395271.272087:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+199:22080:x1876316231980160:12345-192.168.203.54@tcp:101:bash.0 Request processed in 318us (7093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.272095:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24046 00000100:00100000:1.0:1789395271.278066:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.278166:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231980288 00000100:00100000:3.0:1789395271.278181:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231980288 00002000:00010000:3.0:1789395271.278236:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/8 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.278242:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20c700 with x1876316231980288 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.278257:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20c700. 00000100:00100000:3.0:1789395271.278300:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 125 00000100:00100000:3.0:1789395271.278312:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231980288:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:2.0:1789395271.279157:0:22628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395271.279165:0:22628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:2.0:1789395271.279167:0:22628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395271.279169:0:22628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:2.0:1789395271.279171:0:22628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395271.279257:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231980288:12345-192.168.203.54@tcp:10:bash.0 Request processed in 943us (1201us total) trans 4294970030 rc 0/0 00000100:00100000:2.0:1789395271.279266:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 125 00002000:00010000:2.0:1789395271.279271:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/8 (0->18446744073709551615) 00002000:00100000:2.0:1789395271.279274:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3ca20c700 with x1876316231980288 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395271.279280:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3ca20c700. 00000100:00100000:2.0:1789395271.287169:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.287599:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231980416 00000100:00100000:1.0:1789395271.287613:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231980416 00000100:00100000:1.0:1789395271.287715:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5445 00000100:00100000:1.0:1789395271.287727:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231980416:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.289474:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970030 is committed 00000100:00100000:1.0:1789395271.289844:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231980416:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2113us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.289857:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5445 00000100:00100000:0.0:1789395271.293860:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.294145:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231980672 00000100:00100000:1.0:1789395271.294158:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231980672 00000100:00100000:1.0:1789395271.294227:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5309 00000100:00100000:1.0:1789395271.294237:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+199:22080:x1876316231980672:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395271.295234:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+200:22080:x1876316231980672:12345-192.168.203.54@tcp:35:bash.0 Request processed in 991us (1382us total) trans 4294968773 rc 0/0 00000100:00100000:1.0:1789395271.295245:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5309 00000100:00100000:2.0:1789395271.300169:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.300284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231980800 00000100:00100000:1.0:1789395271.300297:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231980800 00000100:00100000:1.0:1789395271.300440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24047 00000100:00100000:1.0:1789395271.300451:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+200:22080:x1876316231980800:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395271.300612:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+200:22080:x1876316231980800:12345-192.168.203.54@tcp:44:bash.0 Request processed in 163us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.300620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24047 00000100:00100000:2.0:1789395271.305667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.306113:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231981056 00000100:00100000:1.0:1789395271.306127:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231981056 00000100:00100000:1.0:1789395271.306246:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24048 00000100:00100000:1.0:1789395271.306258:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+200:22080:x1876316231981056:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.306292:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.306316:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e82e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a68 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.306519:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e835 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.306536:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e835 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.306548:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e835 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.306560:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a7:0x0]: returning size 7 00010000:00010000:1.0:1789395271.306687:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e82e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a68 expref: 203 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.306716:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e835 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a68 expref: 202 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.306726:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:1.0:1789395271.306729:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.306732:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214a00, rc 0) 00000100:00100000:1.0:1789395271.306799:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+202:22080:x1876316231981056:12345-192.168.203.54@tcp:101:bash.0 Request processed in 543us (1147us total) trans 4294968774 rc 0/0 00000100:00100000:1.0:1789395271.306807:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24048 00000100:00100000:2.0:1789395271.315073:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.315153:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231981312 00000100:00100000:0.0:1789395271.315166:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231981312 00000100:00100000:0.0:1789395271.315274:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24049 00000100:00100000:0.0:1789395271.315287:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+202:22080:x1876316231981312:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395271.315435:0:21735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395271.315468:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e835 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a68 expref: 202 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.315496:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316dc2d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210667f expref: 201 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.315507:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395271.315513:0:21735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395271.315757:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.315772:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.315788:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395271.315841:0:21735:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968775 00000004:00010000:0.0:1789395271.315866:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4137802 reply state 00000000d81fcadb transno 4294968776 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.315880:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.315887:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395271.315890:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.315893:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395271.316030:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+203:22080:x1876316231981312:12345-192.168.203.54@tcp:36:bash.0 Request processed in 745us (971us total) trans 4294968776 rc 0/0 00000100:00100000:0.0:1789395271.316038:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24049 00000020:00080000:0.0:1789395271.316045:0:21735:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.319924:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.320014:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231981440 00000100:00100000:0.0:1789395271.320027:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231981440 00000100:00100000:0.0:1789395271.320105:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24050 00000100:00100000:0.0:1789395271.320117:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+203:22080:x1876316231981440:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.320144:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.320171:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316e84a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a6f expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.320242:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316e84a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a6f expref: 204 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.320259:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51a000/0xff35729af316e84a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a6f expref: 204 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.320287:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395271.320291:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395271.320296:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca51a000, rc 0) 00000100:00100000:0.0:1789395271.320372:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+204:22080:x1876316231981440:12345-192.168.203.54@tcp:101:bash.0 Request processed in 255us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.320380:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24050 00000100:00100000:2.0:1789395271.326975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.327090:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231981568 00000100:00100000:1.0:1789395271.327104:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231981568 00002000:00010000:1.0:1789395271.327159:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.327164:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8ba9880 with x1876316231981568 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.327178:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c8ba9880. 00000100:00100000:1.0:1789395271.327219:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 126 00000100:00100000:1.0:1789395271.327231:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231981568:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395271.330594:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395271.330607:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.330611:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395271.330614:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.330616:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395271.331463:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231981568:12345-192.168.203.54@tcp:10:bash.0 Request processed in 4223us (4493us total) trans 4294970003 rc 0/0 00000100:00100000:1.0:1789395271.331478:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 126 00002000:00010000:1.0:1789395271.331485:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.331489:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c8ba9880 with x1876316231981568 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.331499:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c8ba9880. 00000100:00100000:2.0:1789395271.338538:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.338801:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231981696 00000100:00100000:1.0:1789395271.338814:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231981696 00000100:00100000:1.0:1789395271.338891:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5446 00000100:00100000:1.0:1789395271.338912:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231981696:12345-192.168.203.54@tcp:16:bash.0 00000100:00100000:3.0:1789395271.350179:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789395271.350210:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239804032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395271.350304:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1789395271.350323:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970003 is committed 00000100:00100000:0.0:1789395271.350682:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231981696:12345-192.168.203.54@tcp:16:bash.0 Request processed in 11777us (12154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.350694:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5446 00000100:00100000:1.0:1789395271.350825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239804032 00000100:00100000:1.0:1789395271.350835:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239804032 00000100:00100000:1.0:1789395271.350898:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635 00000100:00100000:1.0:1789395271.350917:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239804032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789395271.350961:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443876864 avail 1297637376 00000100:00100000:1.0:1789395271.351026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:3637:x1876316239804032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.351032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635 00000100:00100000:3.0:1789395271.351210:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4e7f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1876316239804032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789395271.360525:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.360578:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231981952 00000100:00100000:0.0:1789395271.360592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231981952 00000100:00100000:0.0:1789395271.361160:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5310 00000100:00100000:0.0:1789395271.361175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+204:22080:x1876316231981952:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395271.362755:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+205:22080:x1876316231981952:12345-192.168.203.54@tcp:35:bash.0 Request processed in 1571us (2230us total) trans 4294968777 rc 0/0 00000100:00100000:0.0:1789395271.362770:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5310 00000100:00100000:2.0:1789395271.367241:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.367368:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231982080 00000100:00100000:0.0:1789395271.367381:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231982080 00000100:00100000:0.0:1789395271.367489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24051 00000100:00100000:0.0:1789395271.367501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+205:22080:x1876316231982080:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:0.0:1789395271.367681:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+205:22080:x1876316231982080:12345-192.168.203.54@tcp:44:bash.0 Request processed in 181us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.367689:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24051 00000100:00100000:2.0:1789395271.376266:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.378275:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231982336 00000100:00100000:1.0:1789395271.378299:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231982336 00000100:00100000:1.0:1789395271.378441:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24052 00000100:00100000:1.0:1789395271.378454:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+205:22080:x1876316231982336:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.378480:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.378508:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e851 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a76 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.378648:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e858 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.378665:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e858 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.378677:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e858 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.378689:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a8:0x0]: returning size 7 00010000:00010000:1.0:1789395271.378822:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e851 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a76 expref: 208 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.378845:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e858 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a76 expref: 207 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.378854:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:1.0:1789395271.378858:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.378861:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215400, rc 0) 00000100:00100000:1.0:1789395271.378949:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+207:22080:x1876316231982336:12345-192.168.203.54@tcp:101:bash.0 Request processed in 497us (2697us total) trans 4294968778 rc 0/0 00000100:00100000:1.0:1789395271.378956:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24052 00000100:00100000:2.0:1789395271.387545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.387714:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231982592 00000100:00100000:0.0:1789395271.387729:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231982592 00000100:00100000:0.0:1789395271.387795:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24053 00000100:00100000:0.0:1789395271.387807:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+207:22080:x1876316231982592:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395271.387879:0:7813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395271.388007:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e858 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a76 expref: 207 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.388038:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535e00/0xff35729af316dc50 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106686 expref: 206 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.388051:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:0.0:1789395271.388057:0:7813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395271.388276:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.388292:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.388302:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395271.388364:0:7813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968779 00000004:00010000:0.0:1789395271.392200:0:7813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000db13cad reply state 00000000f98afd83 transno 4294968780 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.392239:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.392251:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:0.0:1789395271.392255:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.392261:0:7813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395271.392878:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+208:22080:x1876316231982592:12345-192.168.203.54@tcp:36:bash.0 Request processed in 5062us (5337us total) trans 4294968780 rc 0/0 00000100:00100000:0.0:1789395271.392889:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24053 00000020:00080000:0.0:1789395271.392897:0:7813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.403993:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.404075:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231982720 00000100:00100000:0.0:1789395271.404088:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231982720 00000100:00100000:0.0:1789395271.404161:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24054 00000100:00100000:0.0:1789395271.404174:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+208:22080:x1876316231982720:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.404203:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.404235:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316e86d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.404321:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316e86d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a7d expref: 209 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.404338:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df400/0xff35729af316e86d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a7d expref: 209 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.404361:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:0.0:1789395271.404365:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395271.404368:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df400, rc 0) 00000100:00100000:0.0:1789395271.404479:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+209:22080:x1876316231982720:12345-192.168.203.54@tcp:101:bash.0 Request processed in 307us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.404487:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24054 00010000:00010000:3.0:1789395271.409798:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395271.411218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.411324:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231982848 00000100:00100000:0.0:1789395271.411338:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231982848 00002000:00010000:0.0:1789395271.411544:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/9 (0->18446744073709551615) 00002000:00100000:0.0:1789395271.411550:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ce00 with x1876316231982848 ext(0->18446744073709551615) 00002000:00010000:0.0:1789395271.411565:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c988ce00. 00000100:00100000:2.0:1789395271.412576:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 127 00000100:00100000:2.0:1789395271.412604:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231982848:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:2.0:1789395271.413196:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789395271.413202:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:2.0:1789395271.413204:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789395271.413207:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:2.0:1789395271.413209:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789395271.413527:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231982848:12345-192.168.203.54@tcp:10:bash.0 Request processed in 936us (2319us total) trans 4294970031 rc 0/0 00000100:00100000:2.0:1789395271.413539:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 127 00002000:00010000:2.0:1789395271.413545:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/9 (0->18446744073709551615) 00002000:00100000:2.0:1789395271.413549:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ce00 with x1876316231982848 ext(0->18446744073709551615) 00002000:00010000:2.0:1789395271.413556:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c988ce00. 00000100:00100000:2.0:1789395271.427622:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.427779:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231982976 00000100:00100000:1.0:1789395271.427792:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231982976 00000100:00100000:1.0:1789395271.427898:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5447 00000100:00100000:1.0:1789395271.427919:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231982976:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:0.0:1789395271.429965:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970031 is committed 00000100:00100000:1.0:1789395271.430581:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231982976:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2655us (3297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.430594:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5447 00000100:00100000:2.0:1789395271.435031:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.435131:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231983232 00000100:00100000:1.0:1789395271.435145:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231983232 00000100:00100000:1.0:1789395271.435260:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5311 00000100:00100000:1.0:1789395271.435273:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e3d04c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+209:22080:x1876316231983232:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395271.435815:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e3d04c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+210:22080:x1876316231983232:12345-192.168.203.54@tcp:35:bash.0 Request processed in 542us (797us total) trans 4294968781 rc 0/0 00000100:00100000:1.0:1789395271.435825:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5311 00000100:00100000:2.0:1789395271.441806:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.441983:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231983360 00000100:00100000:1.0:1789395271.441998:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231983360 00000100:00100000:1.0:1789395271.442082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24055 00000100:00100000:1.0:1789395271.442095:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+210:22080:x1876316231983360:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395271.442275:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+210:22080:x1876316231983360:12345-192.168.203.54@tcp:44:bash.0 Request processed in 182us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.443013:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24055 00000100:00100000:2.0:1789395271.446758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.447090:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231983616 00000100:00100000:1.0:1789395271.447104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231983616 00000100:00100000:1.0:1789395271.447183:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24056 00000100:00100000:1.0:1789395271.447196:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+210:22080:x1876316231983616:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.447223:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.447248:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e874 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a84 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.447462:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e87b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.447479:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e87b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.447492:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e87b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.447505:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a9:0x0]: returning size 7 00010000:00010000:1.0:1789395271.447645:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e874 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a84 expref: 213 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.447668:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e87b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a84 expref: 212 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.447921:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:1.0:1789395271.447925:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.447929:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215000, rc 0) 00000100:00100000:1.0:1789395271.448010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+212:22080:x1876316231983616:12345-192.168.203.54@tcp:101:bash.0 Request processed in 816us (1265us total) trans 4294968782 rc 0/0 00000100:00100000:1.0:1789395271.448018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24056 00000100:00100000:2.0:1789395271.453899:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.454018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231983872 00000100:00100000:0.0:1789395271.454032:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231983872 00000100:00100000:0.0:1789395271.454112:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24057 00000100:00100000:0.0:1789395271.454125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+212:22080:x1876316231983872:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:0.0:1789395271.454201:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789395271.454233:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215000/0xff35729af316e87b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a84 expref: 212 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.454260:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534600/0xff35729af316dc73 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210668d expref: 211 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.454273:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:0.0:1789395271.454288:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395271.454578:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.454593:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.454603:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395271.454650:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968783 00000004:00010000:0.0:1789395271.454934:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004db061a6 reply state 00000000e40c4aac transno 4294968784 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.454950:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.454957:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:0.0:1789395271.454960:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.454963:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395271.455123:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+213:22080:x1876316231983872:12345-192.168.203.54@tcp:36:bash.0 Request processed in 1000us (1237us total) trans 4294968784 rc 0/0 00000100:00100000:0.0:1789395271.455133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24057 00000020:00080000:0.0:1789395271.455139:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789395271.461353:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.461624:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231984000 00000100:00100000:0.0:1789395271.461638:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231984000 00000100:00100000:0.0:1789395271.461716:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24058 00000100:00100000:0.0:1789395271.461728:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+213:22080:x1876316231984000:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:0.0:1789395271.461757:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.461784:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316e890 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a8b expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.461860:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316e890 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a8b expref: 214 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.461876:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3df200/0xff35729af316e890 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a8b expref: 214 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.461899:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:0.0:1789395271.461913:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789395271.461918:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca3df200, rc 0) 00000100:00100000:0.0:1789395271.462022:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+214:22080:x1876316231984000:12345-192.168.203.54@tcp:101:bash.0 Request processed in 296us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.462030:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24058 00000100:00100000:2.0:1789395271.469171:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.469253:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231984128 00000100:00100000:1.0:1789395271.469265:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231984128 00002000:00010000:1.0:1789395271.469325:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/9 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.469331:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ea00 with x1876316231984128 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.469345:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988ea00. 00000100:00100000:1.0:1789395271.469433:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 128 00000100:00100000:1.0:1789395271.469444:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231984128:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395271.470017:0:22628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395271.470022:0:22628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.470025:0:22628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395271.470027:0:22628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.470030:0:22628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395271.470107:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231984128:12345-192.168.203.54@tcp:10:bash.0 Request processed in 664us (951us total) trans 4294970004 rc 0/0 00000100:00100000:1.0:1789395271.470116:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 128 00002000:00010000:1.0:1789395271.470120:0:22628:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/9 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.470123:0:22628:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ea00 with x1876316231984128 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.470129:0:22628:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988ea00. 00000100:00100000:2.0:1789395271.474749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.475350:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231984256 00000100:00100000:0.0:1789395271.475365:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231984256 00000100:00100000:0.0:1789395271.475560:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5448 00000100:00100000:0.0:1789395271.475573:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231984256:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.477651:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970004 is committed 00000100:00100000:0.0:1789395271.478135:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2397:x1876316231984256:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2557us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.478149:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5448 00000100:00100000:2.0:1789395271.482008:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.482340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231984512 00000100:00100000:0.0:1789395271.482355:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231984512 00000100:00100000:0.0:1789395271.482627:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5312 00000100:00100000:0.0:1789395271.482640:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+214:22080:x1876316231984512:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:0.0:1789395271.482976:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+215:22080:x1876316231984512:12345-192.168.203.54@tcp:35:bash.0 Request processed in 337us (981us total) trans 4294968785 rc 0/0 00000100:00100000:0.0:1789395271.482984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5312 00000100:00100000:1.0:1789395271.486347:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.486580:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231984640 00000100:00100000:3.0:1789395271.486595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231984640 00000100:00100000:3.0:1789395271.486783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24059 00000100:00100000:3.0:1789395271.486799:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+215:22080:x1876316231984640:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:3.0:1789395271.487003:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+215:22080:x1876316231984640:12345-192.168.203.54@tcp:44:bash.0 Request processed in 207us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395271.487200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24059 00000100:00100000:3.0:1789395271.494244:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.494341:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231984896 00000100:00100000:1.0:1789395271.494355:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231984896 00000100:00100000:1.0:1789395271.494516:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24060 00000100:00100000:1.0:1789395271.494528:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+215:22080:x1876316231984896:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.494553:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.494579:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e897 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a92 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.495082:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e89e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.495105:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e89e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.495118:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e89e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.495131:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1aa:0x0]: returning size 7 00010000:00010000:1.0:1789395271.495277:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e897 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a92 expref: 218 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.495303:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e89e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a92 expref: 217 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.495313:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395271.495316:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.495320:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214800, rc 0) 00000100:00100000:1.0:1789395271.495634:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+217:22080:x1876316231984896:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1106us (1401us total) trans 4294968786 rc 0/0 00000100:00100000:1.0:1789395271.495643:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24060 00000100:00100000:3.0:1789395271.500120:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.500208:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.500276:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231985280 00000100:00100000:1.0:1789395271.500290:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231985280 00000100:00100000:2.0:1789395271.500382:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231985024 00000100:00100000:2.0:1789395271.500410:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231985024 00000100:00100000:1.0:1789395271.500424:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24061 00000100:00100000:1.0:1789395271.500434:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+218:22080:x1876316231985280:12345-192.168.203.54@tcp:36:bash.0 00000100:00100000:2.0:1789395271.500448:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1461 00000100:00100000:2.0:1789395271.500455:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+218:2398:x1876316231985024:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395271.500476:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395271.500503:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e89e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a92 expref: 218 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.500508:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395271.500526:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395271.500528:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51be00/0xff35729af316dc96 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106694 expref: 217 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.500531:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789395271.500545:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395271.500547:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395271.500598:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+216:2398:x1876316231985024:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 143us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.500605:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1461 00010000:00010000:1.0:1789395271.500772:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.500788:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.500798:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789395271.500850:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968787 00000004:00010000:1.0:1789395271.500886:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcce2255 reply state 000000009b059874 transno 4294968788 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.500900:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.500917:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395271.500920:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789395271.500923:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789395271.500986:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+218:22080:x1876316231985280:12345-192.168.203.54@tcp:36:bash.0 Request processed in 552us (880us total) trans 4294968788 rc 0/0 00000100:00100000:1.0:1789395271.500993:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24061 00000020:00080000:1.0:1789395271.500997:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395271.505941:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.506028:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231985408 00000100:00100000:1.0:1789395271.506042:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231985408 00000100:00100000:1.0:1789395271.506122:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24062 00000100:00100000:1.0:1789395271.506145:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+218:22080:x1876316231985408:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.506174:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.506198:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e8b3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106a99 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.506277:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e8b3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a99 expref: 219 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.506293:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214200/0xff35729af316e8b3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106a99 expref: 219 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.506317:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:1.0:1789395271.506320:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395271.506324:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214200, rc 0) 00000100:00100000:1.0:1789395271.506598:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+219:22080:x1876316231985408:12345-192.168.203.54@tcp:101:bash.0 Request processed in 464us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.506606:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24062 00000100:00100000:3.0:1789395271.511683:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.511813:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231985536 00000100:00100000:1.0:1789395271.511826:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231985536 00002000:00010000:1.0:1789395271.511893:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/10 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.511899:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ff86ca80 with x1876316231985536 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.511924:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4ff86ca80. 00000100:00100000:1.0:1789395271.511962:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 129 00000100:00100000:1.0:1789395271.511975:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231985536:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395271.512316:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395271.512320:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.512323:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395271.512327:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:1.0:1789395271.512329:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395271.514038:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231985536:12345-192.168.203.54@tcp:10:bash.0 Request processed in 2048us (2352us total) trans 4294970032 rc 0/0 00000100:00100000:1.0:1789395271.514055:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 129 00002000:00010000:1.0:1789395271.514064:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/10 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.514068:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ff86ca80 with x1876316231985536 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.514079:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4ff86ca80. 00000100:00100000:3.0:1789395271.528679:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.528949:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231985664 00000100:00100000:2.0:1789395271.528964:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231985664 00000100:00100000:2.0:1789395271.529043:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5449 00000100:00100000:2.0:1789395271.529056:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231985664:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.531705:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970032 is committed 00000100:00100000:0.0:1789395271.531960:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231985664:12345-192.168.203.54@tcp:16:bash.0 Request processed in 2899us (3288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.531974:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5449 00000100:00100000:3.0:1789395271.537632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.538640:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231985920 00000100:00100000:1.0:1789395271.538658:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231985920 00000100:00100000:1.0:1789395271.538810:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5313 00000100:00100000:1.0:1789395271.538825:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+219:22080:x1876316231985920:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395271.539503:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+220:22080:x1876316231985920:12345-192.168.203.54@tcp:35:bash.0 Request processed in 676us (1880us total) trans 4294968789 rc 0/0 00000100:00100000:1.0:1789395271.539514:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5313 00000100:00100000:3.0:1789395271.543018:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.543355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231986048 00000100:00100000:2.0:1789395271.543453:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231986048 00000100:00100000:2.0:1789395271.544003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24063 00000100:00100000:2.0:1789395271.544020:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+220:22080:x1876316231986048:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:2.0:1789395271.544297:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+220:22080:x1876316231986048:12345-192.168.203.54@tcp:44:bash.0 Request processed in 283us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.544306:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24063 00000100:00100000:0.0:1789395271.552526:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.553495:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231986304 00000100:00100000:2.0:1789395271.553512:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231986304 00000100:00100000:2.0:1789395271.553647:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24064 00000100:00100000:2.0:1789395271.553661:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+220:22080:x1876316231986304:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395271.553691:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395271.553717:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8ba lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106aa0 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.553894:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8c1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.553919:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.553933:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395271.553945:0:21735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ab:0x0]: returning size 7 00010000:00010000:2.0:1789395271.554079:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8ba lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aa0 expref: 223 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.554112:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aa0 expref: 222 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.554122:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:2.0:1789395271.554125:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789395271.554128:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff4800, rc 0) 00000100:00100000:2.0:1789395271.554748:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+222:22080:x1876316231986304:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1075us (2221us total) trans 4294968790 rc 0/0 00000100:00100000:2.0:1789395271.554758:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24064 00000100:00100000:3.0:1789395271.561156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.561436:0:16674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231986432 00000100:00100000:0.0:1789395271.561450:0:16674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231986432 00000100:00100000:0.0:1789395271.561525:0:16674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1462 00000100:00100000:0.0:1789395271.561538:0:16674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+222:2398:x1876316231986432:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789395271.561555:0:16674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395271.561583:0:16674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8c1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aa0 expref: 222 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.561611:0:16674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:0.0:1789395271.561617:0:16674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789395271.561688:0:16674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+221:2398:x1876316231986432:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 153us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.561696:0:16674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1462 00000100:00100000:0.0:1789395271.566559:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.566715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231986688 00000100:00100000:3.0:1789395271.566739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231986688 00000100:00100000:3.0:1789395271.566813:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24065 00000100:00100000:3.0:1789395271.566826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+221:22080:x1876316231986688:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395271.566976:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395271.567008:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534c00/0xff35729af316dcb9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa445840210669b expref: 221 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.567032:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:3.0:1789395271.567037:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395271.568252:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.568344:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.568358:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789395271.569646:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968791 00000004:00010000:3.0:1789395271.569710:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001023cc87 reply state 0000000089428049 transno 4294968792 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.569746:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.569757:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:3.0:1789395271.569760:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789395271.569765:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789395271.570694:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+223:22080:x1876316231986688:12345-192.168.203.54@tcp:36:bash.0 Request processed in 3859us (4137us total) trans 4294968792 rc 0/0 00000100:00100000:3.0:1789395271.570707:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24065 00000020:00080000:3.0:1789395271.570715:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789395271.576596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.576709:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231986816 00000100:00100000:1.0:1789395271.576722:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231986816 00000100:00100000:1.0:1789395271.576855:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24066 00000100:00100000:1.0:1789395271.576868:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+223:22080:x1876316231986816:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.576895:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.576928:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e8d6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106aa7 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.577004:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e8d6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aa7 expref: 224 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.577020:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215c00/0xff35729af316e8d6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aa7 expref: 224 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.577044:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:1.0:1789395271.577047:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395271.577051:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215c00, rc 0) 00000100:00100000:1.0:1789395271.577134:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+224:22080:x1876316231986816:12345-192.168.203.54@tcp:101:bash.0 Request processed in 268us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.577142:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24066 00000100:00100000:2.0:1789395271.582774:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.582941:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231986944 00000100:00100000:3.0:1789395271.582954:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231986944 00002000:00010000:3.0:1789395271.583006:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/10 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.583011:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988d500 with x1876316231986944 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.583024:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988d500. 00000100:00100000:3.0:1789395271.583060:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 130 00000100:00100000:3.0:1789395271.583071:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231986944:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:3.0:1789395271.583478:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395271.583483:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395271.583486:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395271.583488:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1789395271 00002000:00010000:3.0:1789395271.583490:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395271.583560:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231986944:12345-192.168.203.54@tcp:10:bash.0 Request processed in 489us (799us total) trans 4294970005 rc 0/0 00000100:00100000:3.0:1789395271.583569:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 130 00002000:00010000:3.0:1789395271.583574:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/10 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.583576:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988d500 with x1876316231986944 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.583584:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988d500. 00000100:00100000:0.0:1789395271.588480:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.588749:0:14652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231987072 00000100:00100000:2.0:1789395271.588763:0:14652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231987072 00000100:00100000:2.0:1789395271.588830:0:14652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5450 00000100:00100000:2.0:1789395271.588843:0:14652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2395:x1876316231987072:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395271.591643:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970005 is committed 00000100:00100000:2.0:1789395271.591920:0:14652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2395:x1876316231987072:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3065us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.591935:0:14652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5450 00000100:00100000:0.0:1789395271.601699:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.602622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231987328 00000100:00100000:2.0:1789395271.602640:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231987328 00000100:00100000:2.0:1789395271.602723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5314 00000100:00100000:2.0:1789395271.602736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+224:22080:x1876316231987328:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:2.0:1789395271.603108:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+225:22080:x1876316231987328:12345-192.168.203.54@tcp:35:bash.0 Request processed in 373us (1421us total) trans 4294968793 rc 0/0 00000100:00100000:2.0:1789395271.603116:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5314 00000100:00100000:3.0:1789395271.606993:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.607127:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231987456 00000100:00100000:1.0:1789395271.607141:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231987456 00000100:00100000:1.0:1789395271.607218:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24067 00000100:00100000:1.0:1789395271.607230:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+225:22080:x1876316231987456:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:1.0:1789395271.607464:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+225:22080:x1876316231987456:12345-192.168.203.54@tcp:44:bash.0 Request processed in 235us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.607472:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24067 00000100:00100000:0.0:1789395271.616611:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.616726:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231987712 00000100:00100000:1.0:1789395271.616740:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231987712 00000100:00100000:1.0:1789395271.616816:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24068 00000100:00100000:1.0:1789395271.616828:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+225:22080:x1876316231987712:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.616854:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.616880:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e8dd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106aae expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.617032:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e8e4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.617049:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.617064:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.617077:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ac:0x0]: returning size 7 00010000:00010000:1.0:1789395271.617225:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e8dd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aae expref: 228 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.617256:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e8e4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aae expref: 227 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.617265:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:1.0:1789395271.617268:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395271.617272:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215800, rc 0) 00000100:00100000:0.0:1789395271.617899:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+227:22080:x1876316231987712:12345-192.168.203.54@tcp:101:bash.0 Request processed in 1068us (1297us total) trans 4294968794 rc 0/0 00000100:00100000:0.0:1789395271.617979:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24068 00000100:00100000:0.0:1789395271.624116:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.624199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231987968 00000100:00100000:2.0:1789395271.624211:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231987968 00000100:00100000:2.0:1789395271.624287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24069 00000100:00100000:2.0:1789395271.624297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+227:22080:x1876316231987968:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:2.0:1789395271.624381:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789395271.624440:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e8e4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aae expref: 227 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.624465:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df535a00/0xff35729af316dcdc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066a2 expref: 226 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.624478:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395271.624483:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789395271.624960:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.624976:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.624987:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395271.625039:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968795 00000004:00010000:2.0:1789395271.625062:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfe29197 reply state 0000000097175f48 transno 4294968796 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.625074:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.625081:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395271.625084:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395271.625087:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395271.625197:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+228:22080:x1876316231987968:12345-192.168.203.54@tcp:36:bash.0 Request processed in 901us (1093us total) trans 4294968796 rc 0/0 00000100:00100000:2.0:1789395271.625206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24069 00000020:00080000:2.0:1789395271.625212:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395271.634086:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.634625:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231988096 00000100:00100000:2.0:1789395271.634639:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231988096 00000100:00100000:2.0:1789395271.634722:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24070 00000100:00100000:2.0:1789395271.634734:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+228:22080:x1876316231988096:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1789395271.634762:0:21735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395271.634787:0:21735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8f9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106ab5 expref: -99 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.634861:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8f9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ab5 expref: 229 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.634882:0:21735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4800/0xff35729af316e8f9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ab5 expref: 229 pid: 21735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.634911:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:2.0:1789395271.634916:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789395271.634920:0:21735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a4feff4800, rc 0) 00000100:00100000:2.0:1789395271.635002:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+229:22080:x1876316231988096:12345-192.168.203.54@tcp:101:bash.0 Request processed in 270us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.635010:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24070 00000100:00100000:0.0:1789395271.641796:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.641982:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231988224 00000100:00100000:3.0:1789395271.641995:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231988224 00002000:00010000:3.0:1789395271.642047:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/11 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.642053:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f61f80 with x1876316231988224 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.642067:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4e7f61f80. 00000100:00100000:3.0:1789395271.642109:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 131 00000100:00100000:3.0:1789395271.642122:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231988224:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:3.0:1789395271.642769:0:20964:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395271.642774:0:20964:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1789395272 00002000:00010000:3.0:1789395271.642777:0:20964:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395271.642779:0:20964:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1789395272 00002000:00010000:3.0:1789395271.642781:0:20964:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395271.642867:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2396:x1876316231988224:12345-192.168.203.54@tcp:10:bash.0 Request processed in 746us (1087us total) trans 4294970033 rc 0/0 00000100:00100000:3.0:1789395271.642881:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 131 00002000:00010000:3.0:1789395271.642885:0:20964:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/11 (0->18446744073709551615) 00002000:00100000:3.0:1789395271.642888:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4e7f61f80 with x1876316231988224 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395271.642894:0:20964:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a4e7f61f80. 00000100:00100000:0.0:1789395271.650545:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.650854:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231988352 00000100:00100000:1.0:1789395271.650868:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231988352 00000100:00100000:1.0:1789395271.650952:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5451 00000100:00100000:1.0:1789395271.650965:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231988352:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:2.0:1789395271.654413:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970033 is committed 00000100:00100000:1.0:1789395271.654829:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231988352:12345-192.168.203.54@tcp:16:bash.0 Request processed in 3857us (4288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.654844:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5451 00000100:00100000:2.0:1789395271.664479:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.665463:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231988608 00000100:00100000:1.0:1789395271.665477:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231988608 00000100:00100000:1.0:1789395271.665603:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5315 00000100:00100000:1.0:1789395271.665615:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+229:22080:x1876316231988608:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:1.0:1789395271.666052:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+230:22080:x1876316231988608:12345-192.168.203.54@tcp:35:bash.0 Request processed in 437us (1585us total) trans 4294968797 rc 0/0 00000100:00100000:1.0:1789395271.666066:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5315 00000100:00100000:0.0:1789395271.669684:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.669965:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231988736 00000100:00100000:3.0:1789395271.669979:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231988736 00000100:00100000:3.0:1789395271.670051:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24071 00000100:00100000:3.0:1789395271.670062:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+230:22080:x1876316231988736:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:3.0:1789395271.670288:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+230:22080:x1876316231988736:12345-192.168.203.54@tcp:44:bash.0 Request processed in 220us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789395271.670297:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24071 00000100:00100000:0.0:1789395271.680604:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.680719:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231988992 00000100:00100000:1.0:1789395271.680733:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231988992 00000100:00100000:1.0:1789395271.680810:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24072 00000100:00100000:1.0:1789395271.680822:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+230:22080:x1876316231988992:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.680858:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.680883:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e900 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106abc expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.681051:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.681068:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.681080:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.681093:0:10512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ad:0x0]: returning size 7 00010000:00010000:0.0:1789395271.683083:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214e00/0xff35729af316e900 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 233 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.683114:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 232 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.683124:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:0.0:1789395271.683128:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395271.683132:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215800, rc 0) 00000100:00100000:0.0:1789395271.683235:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+232:22080:x1876316231988992:12345-192.168.203.54@tcp:101:bash.0 Request processed in 2414us (2644us total) trans 4294968798 rc 0/0 00000100:00100000:0.0:1789395271.683244:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24072 00000100:00100000:2.0:1789395271.688643:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.688702:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395271.688742:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231989376 00000100:00100000:3.0:1789395271.688756:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231989376 00000100:00100000:3.0:1789395271.688829:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24073 00000100:00100000:3.0:1789395271.688843:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+232:22080:x1876316231989376:12345-192.168.203.54@tcp:36:bash.0 00010000:00010000:3.0:1789395271.688966:0:21735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789395271.689000:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4df534e00/0xff35729af316dcff lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa44584021066a9 expref: 232 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.689022:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:3.0:1789395271.689027:0:21735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789395271.689249:0:21735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.689263:0:21735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 232 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.689506:0:21735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.689572:0:21735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 232 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789395271.689587:0:21735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 232 pid: 10512 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395271.689604:0:21735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ff86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21735:1876316239804160:192.168.203.54@tcp:104: 00000100:00100000:3.0:1789395271.689722:0:21735:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3cacaacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789395271.692032:0:20671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231989120 00000100:00100000:1.0:1789395271.692053:0:20671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231989120 00010000:00010000:1.0:1789395271.692108:0:20671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 233 pid: 10512 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789395271.692162:0:20671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1607 00000100:00100000:1.0:1789395271.692172:0:20671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+233:2398:x1876316231989120:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789395271.692190:0:20671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789395271.692197:0:20671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 233 pid: 10512 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.692212:0:20671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 233 pid: 10512 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.692235:0:20671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:1.0:1789395271.692248:0:20671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.692259:0:20671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.692267:0:20671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.692289:0:20671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789395271.692349:0:20671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+233:2398:x1876316231989120:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 177us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.692356:0:20671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1607 00010000:00010000:2.0:1789395271.693725:0:21735:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.54@tcp) returned -22 from blocking AST (req@00000000e8cac434 x1876316239804160) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 232 pid: 10512 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.693748:0:21735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215800/0xff35729af316e907 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106abc expref: 232 pid: 10512 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395271.693770:0:21735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ff86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21735:1876316239804160:192.168.203.54@tcp:104: 00010000:00010000:2.0:1789395271.693798:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395271.693805:0:21735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.693816:0:21735:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.693823:0:21735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789395271.693952:0:21735:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968799 00000004:00010000:2.0:1789395271.694008:0:21735:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031f5b774 reply state 00000000147e58ae transno 4294968800 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.694024:0:21735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.694032:0:21735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:2.0:1789395271.694034:0:21735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789395271.694037:0:21735:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789395271.694167:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+233:22080:x1876316231989376:12345-192.168.203.54@tcp:36:bash.0 Request processed in 5328us (5538us total) trans 4294968800 rc 0/0 00000100:00100000:2.0:1789395271.694177:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24073 00000020:00080000:2.0:1789395271.694183:0:21735:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395271.696664:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.696992:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231989504 00000100:00100000:1.0:1789395271.697006:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231989504 00000100:00100000:1.0:1789395271.697116:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24074 00000100:00100000:1.0:1789395271.697127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+233:22080:x1876316231989504:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:1.0:1789395271.697151:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.697174:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e91c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106ac3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.697245:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e91c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ac3 expref: 234 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.697268:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214800/0xff35729af316e91c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ac3 expref: 234 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.697299:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:1.0:1789395271.697303:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395271.697306:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9214800, rc 0) 00000100:00100000:1.0:1789395271.697431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+234:22080:x1876316231989504:12345-192.168.203.54@tcp:101:bash.0 Request processed in 261us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395271.697439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24074 00000100:00100000:3.0:1789395271.701967:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.702057:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231989632 00000100:00100000:1.0:1789395271.702071:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231989632 00002000:00010000:1.0:1789395271.702127:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/11 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.702132:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ff86d880 with x1876316231989632 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.702144:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ff86d880. 00000100:00100000:1.0:1789395271.702183:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 132 00000100:00100000:1.0:1789395271.702193:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2396:x1876316231989632:12345-192.168.203.54@tcp:10:bash.0 00002000:00010000:1.0:1789395271.702565:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789395271.702570:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1789395272 00002000:00010000:1.0:1789395271.702574:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789395271.702576:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1789395272 00002000:00010000:1.0:1789395271.702579:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789395271.702646:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2396:x1876316231989632:12345-192.168.203.54@tcp:10:bash.0 Request processed in 453us (695us total) trans 4294970006 rc 0/0 00000100:00100000:1.0:1789395271.702655:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 132 00002000:00010000:1.0:1789395271.702659:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/11 (0->18446744073709551615) 00002000:00100000:1.0:1789395271.702664:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a4ff86d880 with x1876316231989632 ext(0->18446744073709551615) 00002000:00010000:1.0:1789395271.702669:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a4ff86d880. 00000100:00100000:3.0:1789395271.706079:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.706491:0:14650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231989760 00000100:00100000:0.0:1789395271.706504:0:14650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231989760 00000100:00100000:0.0:1789395271.706612:0:14650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5452 00000100:00100000:0.0:1789395271.706626:0:14650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231989760:12345-192.168.203.54@tcp:16:bash.0 00000001:00080000:3.0:1789395271.708115:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970006 is committed 00000100:00100000:0.0:1789395271.708565:0:14650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:2398:x1876316231989760:12345-192.168.203.54@tcp:16:bash.0 Request processed in 1936us (2495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.708576:0:14650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5452 00000100:00100000:0.0:1789395271.711671:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.711833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231990016 00000100:00100000:2.0:1789395271.711847:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231990016 00000100:00100000:2.0:1789395271.711984:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5316 00000100:00100000:2.0:1789395271.711999:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+234:22080:x1876316231990016:12345-192.168.203.54@tcp:35:bash.0 00000100:00100000:2.0:1789395271.712315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+235:22080:x1876316231990016:12345-192.168.203.54@tcp:35:bash.0 Request processed in 318us (659us total) trans 4294968801 rc 0/0 00000100:00100000:2.0:1789395271.712324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5316 00000100:00100000:3.0:1789395271.715483:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.715603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231990144 00000100:00100000:2.0:1789395271.715616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231990144 00000100:00100000:2.0:1789395271.715695:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24075 00000100:00100000:2.0:1789395271.715709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+235:22080:x1876316231990144:12345-192.168.203.54@tcp:44:bash.0 00000100:00100000:2.0:1789395271.715912:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+235:22080:x1876316231990144:12345-192.168.203.54@tcp:44:bash.0 Request processed in 195us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.715920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24075 00000100:00100000:3.0:1789395271.855374:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.855875:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231990400 00000100:00100000:0.0:1789395271.855890:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231990400 00000100:00100000:0.0:1789395271.856001:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24076 00000100:00100000:0.0:1789395271.856014:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+235:22323:x1876316231990400:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395271.856039:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.856072:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e923 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106aca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.856472:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.856488:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.856501:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.856517:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.856524:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.856529:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.857051:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.857064:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.857077:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395271.857336:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00010000:00010000:0.0:1789395271.857370:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.857377:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862087:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862114:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862121:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.862128:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862140:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862161:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:0.0:1789395271.862165:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.862169:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862177:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b400/0xff35729af316e92a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789395271.862203:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fe4d483 reply state 000000002ded80fb transno 4294968802 ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862217:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862225:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff89a3ca1c2d00) 00010000:00010000:0.0:1789395271.862227:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395271.862232:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789395271.862308:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148bc00/0xff35729af316e923 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 238 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862326:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 237 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.862334:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a3ca1c2100) 00010000:00010000:0.0:1789395271.862337:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789395271.862340:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d400, rc 0) 00000001:00080000:3.0:1789395271.862561:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984136 is committed 00000100:00100000:0.0:1789395271.862657:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+238:22323:x1876316231990400:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 6646us (7303us total) trans 4294968802 rc 0/0 00000100:00100000:0.0:1789395271.862665:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24076 00000100:00100000:3.0:1789395271.870495:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.870633:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231990656 00000100:00100000:0.0:1789395271.870647:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231990656 00000100:00100000:0.0:1789395271.870728:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24077 00000100:00100000:0.0:1789395271.870740:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+238:22323:x1876316231990656:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:0.0:1789395271.870769:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395271.870796:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316e946 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106ad1 expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.870950:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.870970:0:7813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 239 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.870981:0:7813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 4/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.871027:0:7813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 239 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.871044:0:7813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 239 pid: 6511 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395271.871061:0:7813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239804288:192.168.203.54@tcp:104: 00000100:00100000:0.0:1789395271.871186:0:7813:0:(client.c:2716:ptlrpc_set_wait()) set ffff89a3c80eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789395271.881366:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.881621:0:7813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7813:1876316239804288:192.168.203.54@tcp:104: 00010000:00010000:1.0:1789395271.881660:0:7813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395271.887172:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231990784 00000100:00100000:2.0:1789395271.887195:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231990784 00010000:00010000:2.0:1789395271.887266:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 240 pid: 6511 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395271.887340:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1608 00000100:00100000:2.0:1789395271.887351:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+240:2395:x1876316231990784:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789395271.887660:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789395271.887669:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 240 pid: 6511 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.887685:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 240 pid: 6511 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.887710:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d400/0xff35729af316e938 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aca expref: 240 pid: 6511 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.887731:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a3ca1c2100) 00010000:00010000:2.0:1789395271.887737:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.887748:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.887756:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.887783:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789395271.887869:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+239:2395:x1876316231990784:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 519us (6516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.887878:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1608 00010000:00010000:1.0:1789395271.888156:0:7813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888168:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395271.888191:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00000004:00080000:1.0:1789395271.888440:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc:0x0], index 0: 0 00000004:00080000:1.0:1789395271.888448:0:7813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd:0x0], index 1: 0 00010000:00010000:1.0:1789395271.888580:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888589:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888597:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888604:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10c000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395271.888608:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888617:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888634:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a3ca1c2100) 00010000:00010000:1.0:1789395271.888636:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789395271.888640:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888646:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10c000/0xff35729af316e94d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888716:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316e946 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ad1 expref: 239 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888727:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:1.0:1789395271.888730:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395271.888734:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d000/0xff35729af316e946 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ad1 expref: 239 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.888743:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d000, rc 0) 00000100:00100000:1.0:1789395271.888798:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+238:22323:x1876316231990656:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 18060us (18319us total) trans 4294968803 rc 301/301 00000100:00100000:1.0:1789395271.888806:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24077 00000100:00100000:3.0:1789395271.893941:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.894637:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231991040 00000100:00100000:1.0:1789395271.894653:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231991040 00000100:00100000:1.0:1789395271.894870:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5317 00000100:00100000:1.0:1789395271.894884:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4d0230c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+238:22323:x1876316231991040:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:1.0:1789395271.895322:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4d0230c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+239:22323:x1876316231991040:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 439us (1391us total) trans 4294968804 rc 0/0 00000100:00100000:1.0:1789395271.895332:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5317 00000100:00100000:3.0:1789395271.900024:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.900795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231991168 00000100:00100000:2.0:1789395271.900810:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231991168 00000100:00100000:2.0:1789395271.900914:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24078 00000100:00100000:2.0:1789395271.900927:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+239:22323:x1876316231991168:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395271.900957:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395271.900988:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e95b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106ad8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.901063:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e95b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ad8 expref: 240 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.901079:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1800/0xff35729af316e95b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ad8 expref: 240 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.901101:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:2.0:1789395271.901104:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789395271.901108:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1800, rc 0) 00000100:00100000:2.0:1789395271.901185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+240:22323:x1876316231991168:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 260us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.901193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24078 00000100:00100000:3.0:1789395271.906205:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.908963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231991424 00000100:00100000:2.0:1789395271.908985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231991424 00000100:00100000:2.0:1789395271.909097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5318 00000100:00100000:2.0:1789395271.909110:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+240:22323:x1876316231991424:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:2.0:1789395271.909598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+241:22323:x1876316231991424:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 489us (3405us total) trans 4294968805 rc 0/0 00000100:00100000:2.0:1789395271.909607:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5318 00000100:00100000:3.0:1789395271.915601:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.915800:0:21735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231991552 00000100:00100000:2.0:1789395271.915814:0:21735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231991552 00000100:00100000:2.0:1789395271.915941:0:21735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24079 00000100:00100000:2.0:1789395271.915955:0:21735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+241:22323:x1876316231991552:12345-192.168.203.54@tcp:44:lfs.0 00000001:00080000:1.0:1789395271.919570:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968805 is committed 00010000:00010000:0.0:1789395271.920009:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920024:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920033:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920040:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca0e1000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920046:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920054:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920085:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff89a4cb041800) 00010000:00010000:0.0:1789395271.920088:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920093:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920100:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e652 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920125:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920138:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920144:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920151:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920154:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920159:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920167:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff89a4c7b89c00) 00010000:00010000:0.0:1789395271.920170:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920173:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920179:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b000/0xff35729af316e69f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920191:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920196:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920201:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920206:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377c00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920208:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920214:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920225:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff89a4cbc0e200) 00010000:00010000:0.0:1789395271.920227:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920229:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920235:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377c00/0xff35729af316e6c2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920246:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920251:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920257:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920262:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920265:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920270:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920289:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff89a4c92e3000) 00010000:00010000:0.0:1789395271.920292:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920296:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920301:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376400/0xff35729af316e6e5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920318:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920324:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920330:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920335:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ba00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920338:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920344:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920351:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff89a4cb041f00) 00010000:00010000:0.0:1789395271.920354:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920357:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920362:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ba00/0xff35729af316e708 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920382:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920431:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920437:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920443:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920446:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920452:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920459:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff89a4cb041a00) 00010000:00010000:0.0:1789395271.920462:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920464:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920470:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4600/0xff35729af316e72b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920481:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920486:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920491:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920496:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff5800 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920498:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920504:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920514:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff89a4f3d38d00) 00010000:00010000:0.0:1789395271.920516:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920519:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920525:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff5800/0xff35729af316e74e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920535:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920542:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920548:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920553:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51aa00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920556:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920563:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920571:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff89a3ca5d9f00) 00010000:00010000:0.0:1789395271.920573:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920576:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920581:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51aa00/0xff35729af316e771 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920596:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920603:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920609:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920614:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ac00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920617:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920622:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920629:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff89a4cb041600) 00010000:00010000:0.0:1789395271.920631:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920633:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920639:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ac00/0xff35729af316e794 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920650:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920656:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920662:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920668:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920671:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920676:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920683:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff89a4c7b89b00) 00010000:00010000:0.0:1789395271.920685:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920894:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920912:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376a00/0xff35729af316e7b7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920928:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920935:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920946:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920951:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca376600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.920954:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920960:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920972:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff89a4c7b89500) 00010000:00010000:0.0:1789395271.920974:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.920977:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920983:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca376600/0xff35729af316e7da lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.920995:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921001:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921006:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921011:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921013:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921019:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921026:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff89a3ca5d9100) 00010000:00010000:0.0:1789395271.921028:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921031:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921037:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4a00/0xff35729af316e7fd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921050:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921055:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921060:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921065:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca377a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921067:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921072:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921079:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff89a4f3d38f00) 00010000:00010000:0.0:1789395271.921082:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921084:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921089:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca377a00/0xff35729af316e820 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921100:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921105:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921110:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921115:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51ae00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921118:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921124:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921131:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff89a3c8b1db00) 00010000:00010000:0.0:1789395271.921133:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921136:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921142:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51ae00/0xff35729af316e843 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921151:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921156:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921162:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921167:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca51b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921170:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921176:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921188:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff89a4f3d38000) 00010000:00010000:0.0:1789395271.921190:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921193:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921199:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca51b200/0xff35729af316e866 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921328:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921336:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921342:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921347:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca3de400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921350:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921356:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921374:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff89a4f3d38500) 00010000:00010000:0.0:1789395271.921377:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921381:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921414:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca3de400/0xff35729af316e889 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921431:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921437:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921443:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921448:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215e00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921451:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921457:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921465:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff89a3c8b1df00) 00010000:00010000:0.0:1789395271.921468:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921471:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921477:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215e00/0xff35729af316e8ac lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921491:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921504:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921510:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921516:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9344a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921519:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921526:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921534:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff89a4f3d38e00) 00010000:00010000:0.0:1789395271.921537:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.921540:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921546:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9344a00/0xff35729af316e8cf lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921560:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921566:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921572:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921578:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4feff4400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.921580:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.921586:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789395271.922636:0:21735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+57:22323:x1876316231991552:12345-192.168.203.54@tcp:44:lfs.0 Request processed in 6667us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395271.922650:0:21735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24079 00010000:00010000:0.0:1789395271.924801:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff89a4f3d38800) 00010000:00010000:0.0:1789395271.924805:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.924814:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924822:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4feff4400/0xff35729af316e8f2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924855:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924863:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924870:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924876:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9b57000 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.924880:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924888:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924896:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff89a4f3d38600) 00010000:00010000:0.0:1789395271.924898:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.924912:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924918:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9b57000/0xff35729af316e915 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21735 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924936:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924990:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.924997:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.925002:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a4c148b200 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.925005:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.925011:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.925020:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff89a3ca1c2d00) 00010000:00010000:0.0:1789395271.925023:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.925026:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.925032:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a4c148b200/0xff35729af316e931 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789395271.943727:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.943921:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231991808 00000100:00100000:1.0:1789395271.943935:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231991808 00000100:00100000:1.0:1789395271.944029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24080 00000100:00100000:1.0:1789395271.944042:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22324:x1876316231991808:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:1.0:1789395271.944067:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395271.944092:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e962 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106adf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944189:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944205:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944218:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944237:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944243:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944250:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944588:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944598:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944605:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944612:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944618:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395271.944624:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944631:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944644:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:1.0:1789395271.944647:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395271.944652:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944658:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e969 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944677:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944683:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944689:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944695:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9215a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395271.944699:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944704:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944711:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff89a4d0749f00) 00010000:00010000:1.0:1789395271.944714:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395271.944717:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944723:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e970 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944764:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e962 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106adf expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944775:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:1.0:1789395271.944777:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789395271.944781:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215400/0xff35729af316e962 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106adf expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395271.944790:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215400, rc 0) 00000100:00100000:1.0:1789395271.946361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22324:x1876316231991808:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 2307us (2635us total) trans 0 rc 301/301 00000100:00100000:1.0:1789395271.946377:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24080 00000100:00100000:1.0:1789395271.954839:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395271.955243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231992064 00000100:00100000:2.0:1789395271.955257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231992064 00000100:00100000:2.0:1789395271.955343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24081 00000100:00100000:2.0:1789395271.955356:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+54:22324:x1876316231992064:12345-192.168.203.54@tcp:101:lfs.0 00010000:00010000:2.0:1789395271.955379:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789395271.955440:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106ae6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789395271.955749:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:2.0:1789395271.955894:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e977 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ae6 expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.955928:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a4f3d38700) 00010000:00010000:2.0:1789395271.955931:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789395271.955938:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca0e1000/0xff35729af316e977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106ae6 expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789395271.955961:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca0e1000, rc 0) 00000100:00100000:2.0:1789395271.956047:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+55:22324:x1876316231992064:12345-192.168.203.54@tcp:101:lfs.0 Request processed in 693us (1223us total) trans 4294968806 rc 301/301 00000100:00100000:2.0:1789395271.956055:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24081 00000100:00100000:3.0:1789395271.961265:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395271.961343:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231992192 00000100:00100000:0.0:1789395271.961356:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231992192 00000100:00100000:0.0:1789395271.961465:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24082 00000100:00100000:0.0:1789395271.961478:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+55:22324:x1876316231992192:12345-192.168.203.54@tcp:34:lfs.0 00010000:00010000:0.0:1789395271.961587:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961606:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961621:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961638:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961645:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961651:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961718:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961727:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961734:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789395271.961785:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00000004:00200000:0.0:1789395271.961790:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789395271.961805:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961823:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961834:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961841:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961849:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961855:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10dc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.961860:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961868:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961882:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:0.0:1789395271.961886:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.961891:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961909:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e985 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961926:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961932:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961937:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961943:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10cc00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.961946:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961952:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961959:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff89a3ca1c2d00) 00010000:00010000:0.0:1789395271.961962:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.961964:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961970:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e98c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961987:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961992:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.961998:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.962003:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3ca10d600 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:0.0:1789395271.962007:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.962013:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.962024:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:0.0:1789395271.962027:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789395271.962030:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395271.962036:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e993 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789395271.962124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+55:22324:x1876316231992192:12345-192.168.203.54@tcp:34:lfs.0 Request processed in 647us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395271.962133:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24082 00000100:00100000:3.0:1789395271.967007:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395271.968758:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231992448 00000100:00100000:1.0:1789395271.968779:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231992448 00000100:00100000:1.0:1789395271.968864:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5319 00000100:00100000:1.0:1789395271.968878:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+55:22324:x1876316231992448:12345-192.168.203.54@tcp:35:lfs.0 00000100:00100000:1.0:1789395271.969196:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22324:x1876316231992448:12345-192.168.203.54@tcp:35:lfs.0 Request processed in 320us (2203us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1789395271.969204:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5319 00000100:00100000:0.0:1789395272.025718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395272.026211:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231992704 00000100:00100000:1.0:1789395272.026224:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231992704 00000100:00100000:1.0:1789395272.026460:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24083 00000100:00100000:1.0:1789395272.026473:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+56:22327:x1876316231992704:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395272.026502:0:7813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395272.026529:0:7813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e99a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106aed expref: -99 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026712:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026734:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026764:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026783:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026790:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026797:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026871:0:7813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e9af lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026880:0:7813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e9af lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.026887:0:7813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e9af lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789395272.026909:0:7813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00010000:00010000:1.0:1789395272.027020:0:7813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027034:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027041:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027048:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027054:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214a00 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395272.027059:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027067:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027080:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff89a4fbb89200) 00010000:00010000:1.0:1789395272.027084:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395272.027090:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027096:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214a00/0xff35729af316e9a1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027112:0:7813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027117:0:7813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027122:0:7813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027127:0:7813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a3c9214400 already unused, calling callback (ffffffffc195d4f0) 00010000:00010000:1.0:1789395272.027129:0:7813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027135:0:7813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027142:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff89a4d0749f00) 00010000:00010000:1.0:1789395272.027145:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789395272.027147:0:7813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027153:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9214400/0xff35729af316e9a8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027202:0:7813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215a00/0xff35729af316e99a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aed expref: 59 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027222:0:7813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e9af lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aed expref: 58 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.027229:0:7813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:1.0:1789395272.027231:0:7813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789395272.027234:0:7813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215200, rc 0) 00000100:00100000:1.0:1789395272.027341:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22327:x1876316231992704:12345-192.168.203.54@tcp:101:dd.0 Request processed in 870us (1639us total) trans 4294968808 rc 0/0 00000100:00100000:1.0:1789395272.027349:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24083 00000100:00100000:3.0:1789395272.033630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395272.035939:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231992832 00000100:00100000:0.0:1789395272.035963:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231992832 00000100:00100000:0.0:1789395272.036061:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24084 00000100:00100000:0.0:1789395272.036073:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+58:22327:x1876316231992832:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395272.036099:0:10512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395272.036122:0:10512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e9bd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106af4 expref: -99 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.036157:0:10512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e9c4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.036170:0:10512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.036180:0:10512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10512 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.036413:0:10512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10d600/0xff35729af316e9bd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106af4 expref: 60 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.036435:0:10512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10cc00/0xff35729af316e9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106af4 expref: 59 pid: 10512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.036444:0:10512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:0.0:1789395272.036447:0:10512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789395272.036451:0:10512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10cc00, rc 0) 00000100:00100000:0.0:1789395272.036542:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:22327:x1876316231992832:12345-192.168.203.54@tcp:101:dd.0 Request processed in 470us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395272.036549:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24084 00000100:00100000:2.0:1789395272.043908:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395272.045364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993088 00000100:00100000:0.0:1789395272.045382:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993088 00000100:00100000:0.0:1789395272.045496:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24085 00000100:00100000:0.0:1789395272.045508:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+59:22327:x1876316231993088:12345-192.168.203.54@tcp:36:dd.0 00010000:00010000:0.0:1789395272.045577:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789395272.045610:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a3c9215200/0xff35729af316e9af lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106aed expref: 59 pid: 7813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.045636:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:0.0:1789395272.045642:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789395272.045884:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e9cb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.045911:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e9cb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.045924:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e9cb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789395272.045981:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968809 00000004:00010000:0.0:1789395272.046009:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdcec837 reply state 00000000198cb964 transno 4294968810 ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e9cb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.046023:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a3ca10dc00/0xff35729af316e9cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.046029:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff89a4f3d38c00) 00010000:00010000:0.0:1789395272.046031:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789395272.046034:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789395272.046158:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+61:22327:x1876316231993088:12345-192.168.203.54@tcp:36:dd.0 Request processed in 652us (2275us total) trans 4294968810 rc 0/0 00000100:00100000:0.0:1789395272.046167:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24085 00000020:00080000:0.0:1789395272.046173:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789395272.052035:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395272.052208:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993216 00000100:00100000:1.0:1789395272.052221:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993216 00000100:00080000:0.0:1789395272.052289:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395272.052603:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5453 00000100:00100000:1.0:1789395272.052617:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+16:22327:x1876316231993216:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:1.0:1789395272.052640:0:14655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789395272.052666:0:14655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000479a7f14/0xff35729af316e9d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106afb expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789395272.052697:0:14655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789395272.052725:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=723s v=(0 0) 00010000:00010000:1.0:1789395272.052730:0:14655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789395272.052792:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000479a7f14/0xff35729af316e9d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106afb expref: 17 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.052816:0:14655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000479a7f14/0xff35729af316e9d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106afb expref: 17 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789395272.052837:0:14655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3c9215a00, rc 0) 00000100:00100000:1.0:1789395272.052913:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22327:x1876316231993216:12345-192.168.203.54@tcp:101:dd.0 Request processed in 299us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.052921:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5453 00000100:00100000:3.0:1789395272.058184:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395272.058805:0:14651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993344 00000100:00100000:0.0:1789395272.058819:0:14651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993344 00000100:00100000:0.0:1789395272.058895:0:14651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5454 00000100:00100000:0.0:1789395272.058917:0:14651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:22327:x1876316231993344:12345-192.168.203.54@tcp:101:dd.0 00010000:00010000:0.0:1789395272.058941:0:14651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789395272.058968:0:14651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316e9d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fa4458402106b02 expref: -99 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789395272.059002:0:14651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789395272.059030:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1789395272.059036:0:14651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789395272.059046:0:14651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316e9d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106b02 expref: 18 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.059068:0:14651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa3d9d0f/0xff35729af316e9d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.54@tcp remote: 0x5fa4458402106b02 expref: 18 pid: 14651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789395272.059082:0:14651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a3ca10d600, rc 0) 00000100:00100000:0.0:1789395272.059163:0:14651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:22327:x1876316231993344:12345-192.168.203.54@tcp:101:dd.0 Request processed in 249us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395272.059171:0:14651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5454 00000100:00100000:2.0:1789395272.070997:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395272.071046:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395272.071142:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993472 00000100:00100000:3.0:1789395272.071155:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993472 00002000:00010000:3.0:1789395272.071209:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/12 (0->18446744073709551615) 00002000:00100000:3.0:1789395272.071215:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988c000 with x1876316231993472 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395272.071229:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988c000. 00000100:00100000:3.0:1789395272.071263:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993600 00000100:00100000:3.0:1789395272.071267:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993600 00002000:00010000:3.0:1789395272.071282:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/13 (0->18446744073709551615) 00002000:00100000:3.0:1789395272.071286:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ca80 with x1876316231993600 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395272.071292:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c988ca80. 00000100:00100000:3.0:1789395272.071323:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 133 00000100:00100000:3.0:1789395272.071335:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231993472:12345-192.168.203.54@tcp:10:dd.0 00002000:00010000:3.0:1789395272.071603:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395272.071608:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1789395272 00002000:00010000:3.0:1789395272.071611:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395272.071613:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1789395272 00002000:00010000:3.0:1789395272.071616:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395272.071698:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231993472:12345-192.168.203.54@tcp:10:dd.0 Request processed in 365us (715us total) trans 4294970007 rc 0/0 00000100:00100000:3.0:1789395272.071707:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 133 00002000:00010000:3.0:1789395272.071711:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/12 (0->18446744073709551615) 00002000:00100000:3.0:1789395272.071714:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988c000 with x1876316231993472 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395272.071720:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c988c000. 00000100:00100000:3.0:1789395272.071744:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 134 00000100:00100000:3.0:1789395272.071751:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231993600:12345-192.168.203.54@tcp:10:dd.0 00002000:00010000:3.0:1789395272.071836:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789395272.071840:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1789395272 00002000:00010000:3.0:1789395272.071842:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789395272.071844:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1789395272 00002000:00010000:3.0:1789395272.071846:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789395272.071866:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231993600:12345-192.168.203.54@tcp:10:dd.0 Request processed in 116us (819us total) trans 4294970034 rc 0/0 00000100:00100000:3.0:1789395272.071873:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 134 00002000:00010000:3.0:1789395272.071877:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/13 (0->18446744073709551615) 00002000:00100000:3.0:1789395272.071879:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c988ca80 with x1876316231993600 ext(0->18446744073709551615) 00002000:00010000:3.0:1789395272.071884:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c988ca80. 00000100:00100000:3.0:1789395272.281892:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1789395272.284025:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395272.284047:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993728 00000100:00100000:2.0:1789395272.284067:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993728 00000100:00100000:3.0:1789395272.284089:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00002000:00100000:2.0:1789395272.284151:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff89a3c77d6d80 x1876316231993728/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:738/0 lens 488/0 e 0 to 0 dl 1789395283 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395272.284166:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d6d80 with x1876316231993728 ext(0->1048575) 00002000:00010000:2.0:1789395272.284174:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c77d6d80 00000100:00100000:1.0:1789395272.284198:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993856 00000100:00100000:1.0:1789395272.284205:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993856 00000100:00100000:2.0:1789395272.284231:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 135 00000100:00100000:2.0:1789395272.284244:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231993728:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395272.284248:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5455 00000100:00100000:1.0:1789395272.284266:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231993856:12345-192.168.203.54@tcp:16:kworker.0 00000100:00100000:0.0:1789395272.284286:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231993984 00000100:00100000:0.0:1789395272.284297:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231993984 00000100:00100000:0.0:1789395272.284357:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5456 00000100:00100000:0.0:1789395272.284371:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231993984:12345-192.168.203.54@tcp:16:kworker.0 00000001:00080000:1.0:1789395272.289979:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970034 is committed 00000100:00100000:0.0:1789395272.293414:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231993984:12345-192.168.203.54@tcp:16:kworker.0 Request processed in 9037us (9315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395272.293427:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5456 00000001:00080000:3.0:1789395272.294854:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970007 is committed 00000100:00100000:1.0:1789395272.295645:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231993856:12345-192.168.203.54@tcp:16:kworker.0 Request processed in 11117us (11377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.295656:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5455 00000100:00100000:3.0:1789395272.310128:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395272.310945:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994112 00000100:00100000:1.0:1789395272.310960:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994112 00000100:00100000:1.0:1789395272.311115:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5457 00000100:00100000:1.0:1789395272.311128:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231994112:12345-192.168.203.54@tcp:16:kworker.0 00000100:00100000:1.0:1789395272.311481:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231994112:12345-192.168.203.54@tcp:16:kworker.0 Request processed in 355us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.317794:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5457 00000100:00100000:2.0:1789395272.318890:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231993728:12345-192.168.203.54@tcp:4:dd.0 Request processed in 34635us (37000us total) trans 4294970008 rc 0/0 00000100:00100000:2.0:1789395272.318915:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 135 00002000:00100000:2.0:1789395272.318932:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff89a3c77d6d80 x1876316231993728/t4294970008(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:738/0 lens 488/448 e 0 to 0 dl 1789395283 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395272.318944:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d6d80 with x1876316231993728 ext(0->1048575) 00002000:00010000:2.0:1789395272.318952:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c77d6d80 00000100:00100000:3.0:1789395272.360276:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395272.360438:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994240 00000100:00100000:2.0:1789395272.360451:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994240 00002000:00100000:2.0:1789395272.360514:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (0->1048575) req@ffff89a3c77d7480 x1876316231994240/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:738/0 lens 488/0 e 0 to 0 dl 1789395283 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395272.360527:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d7480 with x1876316231994240 ext(0->1048575) 00002000:00010000:2.0:1789395272.360534:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c77d7480 00000100:00100000:2.0:1789395272.360579:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 136 00000100:00100000:2.0:1789395272.360589:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2395:x1876316231994240:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395272.370272:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395272.370304:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239804800:0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.370366:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239804928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370407:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370469:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239804416:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370512:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370541:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239805312:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370584:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239805824:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370603:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239804544:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370671:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239805056:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370699:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370715:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239805568:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370738:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370757:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789395272.370762:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239804672:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370808:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239805184:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370852:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239805696:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.370918:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239804672 00000100:00100000:1.0:1789395272.370929:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239804672 00000100:00100000:2.0:1789395272.370950:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395272.370979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239805440:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.370985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239804928 00000100:00100000:1.0:1789395272.370991:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239804928 00000100:00100000:2.0:1789395272.371011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.371023:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636 00000100:00100000:1.0:1789395272.371037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239804672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.371038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239805952:0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.371069:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789395272.371114:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637 00000100:00100000:1.0:1789395272.371120:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:3638:x1876316239804672:12345-0@lo:400:kworker.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.371128:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239804928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371134:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636 00000100:00100000:2.0:1789395272.371181:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876316239804928:12345-0@lo:400:kworker.0 Request processed in 57us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.371189:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637 00000100:00100000:1.0:1789395272.371190:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294984136 gen 2 00000004:00080000:1.0:1789395272.371200:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294984136 committed transno 4294984136 00000100:00100000:2.0:1789395272.371219:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805312 00000100:00100000:2.0:1789395272.371225:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805312 00000100:00100000:1.0:1789395272.371231:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239804672:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371260:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239804800 00000100:00100000:1.0:1789395272.371265:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239804800 00000100:00100000:2.0:1789395272.371267:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805824 00000100:00100000:2.0:1789395272.371273:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805824 00000100:00100000:1.0:1789395272.371294:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239804544 00000100:00100000:1.0:1789395272.371299:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239804544 00000100:00100000:2.0:1789395272.371307:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805440 00000100:00100000:2.0:1789395272.371314:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805440 00000100:00100000:1.0:1789395272.371319:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805056 00000100:00100000:1.0:1789395272.371324:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805056 00000100:00100000:2.0:1789395272.371345:0:10007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805952 00000100:00100000:1.0:1789395272.371349:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805568 00000100:00100000:2.0:1789395272.371350:0:10007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805952 00000100:00100000:1.0:1789395272.371354:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805568 00000100:00100000:1.0:1789395272.371381:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805184 00000100:00100000:2.0:1789395272.371406:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789395272.371411:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805184 00000100:00100000:2.0:1789395272.371418:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239805312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371431:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239805696 00000100:00100000:1.0:1789395272.371436:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239805696 00000100:00100000:1.0:1789395272.371455:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1789395272.371464:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239804800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.371482:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4e7f61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239805312:12345-0@lo:400:kworker.0 Request processed in 66us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.371491:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1789395272.371513:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1789395272.371513:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876316239804800:12345-0@lo:400:kworker.0 Request processed in 47us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.371522:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239805824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371525:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1789395272.371542:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1789395272.371549:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239804544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371583:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a501db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876316239804544:12345-0@lo:400:kworker.0 Request processed in 35us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.371589:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1789395272.371614:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876316239804544:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371636:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1789395272.371642:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239805056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371673:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c8baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876316239805056:12345-0@lo:400:kworker.0 Request processed in 32us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.371679:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1789395272.371700:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1876316239805056:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371719:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789395272.371725:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239805568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371757:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876316239805568:12345-0@lo:400:kworker.0 Request processed in 32us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.371763:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789395272.371786:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1876316239805568:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371805:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789395272.371812:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239805184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371845:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876316239805184:12345-0@lo:400:kworker.0 Request processed in 34us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.371853:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1789395272.371875:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239805824:12345-0@lo:400:kworker.0 Request processed in 354us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.371883:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1876316239805184:0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.371885:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1789395272.371916:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1789395272.371928:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789395272.371929:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239805440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.371942:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239805696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.371971:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239805440:12345-0@lo:400:kworker.0 Request processed in 47us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.371978:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1789395272.371992:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3ca140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876316239805696:12345-0@lo:400:kworker.0 Request processed in 53us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.371997:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1789395272.372006:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789395272.372011:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239805952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.372039:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1876316239805696:0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.372052:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876316239805952:12345-0@lo:400:kworker.0 Request processed in 45us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395272.372059:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1789395272.372132:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239804928:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.372138:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239805312:0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.372153:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239805440:0@lo:400:kworker.0 00000100:00100000:0.0:1789395272.372255:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239804416 00000100:00100000:0.0:1789395272.372262:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239804416 00000100:00100000:0.0:1789395272.372305:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1789395272.372312:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239804416:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789395272.374296:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789395272.374308:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789395272.374312:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789395272.374315:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789395272.376891:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239805824:0@lo:400:kworker.0 00000100:00100000:2.0:1789395272.379314:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1876316239805952:0@lo:400:kworker.0 00000100:00100000:0.0:1789395272.379369:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d0428a-b483-45e6-97c2-4fac3e6d8266+24:3636:x1876316239804416:12345-0@lo:400:kworker.0 Request processed in 7054us (8852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395272.379403:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789395272.381089:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876316239804800:0@lo:400:kworker.0 00000100:00100000:1.0:1789395272.381111:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d0428a-b483-45e6-97c2-4fac3e6d8266:3636:1876316239804416:0@lo:400:kworker.0 00000100:00100000:0.0:1789395272.386082:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231994240:12345-192.168.203.54@tcp:4:dd.0 Request processed in 25482us (25809us total) trans 4294970035 rc 0/0 00000100:00100000:0.0:1789395272.386095:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 136 00002000:00100000:0.0:1789395272.386109:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (0->1048575) req@ffff89a3c77d7480 x1876316231994240/t4294970035(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:738/0 lens 488/448 e 0 to 0 dl 1789395283 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395272.386120:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d7480 with x1876316231994240 ext(0->1048575) 00002000:00010000:0.0:1789395272.386126:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c77d7480 00010000:00010000:3.0:1789395272.433649:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789395272.881693:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239806080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789395272.881776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395272.882109:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239806080 00000100:00100000:0.0:1789395272.882117:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239806080 00000100:00100000:0.0:1789395272.882172:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789395272.882182:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239806080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395272.882205:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a4ffb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239806208:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395272.882206:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 485918400 pending 1073152 free 3923431424 avail 3691909120 00000100:00100000:3.0:1789395272.882237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395272.882244:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876316239806080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395272.882251:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789395272.882266:0:10090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239806208 00000100:00100000:0.0:1789395272.882270:0:10090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239806208 00000100:00100000:0.0:1789395272.882287:0:10090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1789395272.882293:0:10090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239806208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789395272.882302:0:10090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 274622144 pending 1073152 free 3923488768 avail 3691966464 00000100:00100000:3.0:1789395272.882313:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789395272.882320:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239806592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789395272.882328:0:10090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876316239806208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395272.882334:0:10090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789395272.882344:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789395272.882381:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239806208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789395272.882587:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239806592 00000100:00100000:1.0:1789395272.882592:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239806592 00000100:00100000:1.0:1789395272.882630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3638 00000100:00100000:1.0:1789395272.882638:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239806592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789395272.882663:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1298812928 00000100:00100000:1.0:1789395272.882710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1876316239806592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.882716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3638 00000100:00100000:1.0:1789395272.882769:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239806336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789395272.882797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.882821:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789395272.882827:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239806464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395272.882851:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789395272.882874:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239806336 00000100:00100000:1.0:1789395272.882877:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239806336 00000100:00100000:1.0:1789395272.882909:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239806464 00000100:00100000:1.0:1789395272.882912:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239806464 00000100:00100000:1.0:1789395272.882927:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789395272.882934:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239806336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789395272.882945:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 485918400 pending 1073152 free 3923431424 avail 3691909120 00000100:00100000:1.0:1789395272.882975:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876316239806336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.882981:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789395272.882992:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1789395272.882998:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239806464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789395272.883006:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 274622144 pending 1073152 free 3923488768 avail 3691966464 00000100:00100000:1.0:1789395272.883030:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876316239806464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395272.883035:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1789395272.883067:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1876316239806464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789395272.883080:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1876316239806336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789395272.883524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a4ffb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1876316239806080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789395272.886174:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3c77d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1876316239806592:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789395273.458338:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789395273.657990:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395273.658084:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994368 00000100:00100000:1.0:1789395273.658093:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994368 00002000:00100000:1.0:1789395273.658145:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (4194304->8388607) req@ffff89a3cadc4a80 x1876316231994368/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/0 e 0 to 0 dl 1789395284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395273.658156:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc4a80 with x1876316231994368 ext(4194304->8388607) 00002000:00010000:1.0:1789395273.658163:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadc4a80 00000100:00100000:1.0:1789395273.658194:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 137 00000100:00100000:1.0:1789395273.658204:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+19:2397:x1876316231994368:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:1.0:1789395273.736078:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2397:x1876316231994368:12345-192.168.203.54@tcp:4:dd.0 Request processed in 77856us (78077us total) trans 4294970009 rc 0/0 00000100:00100000:1.0:1789395273.736096:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 137 00002000:00100000:1.0:1789395273.736114:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (4194304->8388607) req@ffff89a3cadc4a80 x1876316231994368/t4294970009(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/448 e 0 to 0 dl 1789395284 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395273.736326:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3cadc4a80 with x1876316231994368 ext(4194304->8388607) 00002000:00010000:1.0:1789395273.736335:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3cadc4a80 00000100:00100000:3.0:1789395273.801002:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395273.801083:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994496 00000100:00100000:2.0:1789395273.801097:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994496 00002000:00100000:2.0:1789395273.801163:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (1048576->4194303) req@ffff89a3c77d5880 x1876316231994496/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/0 e 0 to 0 dl 1789395284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395273.801176:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5880 with x1876316231994496 ext(1048576->4194303) 00002000:00010000:2.0:1789395273.801183:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c77d5880 00000100:00100000:2.0:1789395273.801227:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 138 00000100:00100000:2.0:1789395273.801238:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+21:2396:x1876316231994496:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:3.0:1789395273.831350:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395273.833125:0:20964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994624 00000100:00100000:2.0:1789395273.833145:0:20964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994624 00002000:00100000:2.0:1789395273.833236:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (4194304->8388607) req@ffff89a3c77d5180 x1876316231994624/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/0 e 0 to 0 dl 1789395284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395273.833250:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5180 with x1876316231994624 ext(4194304->8388607) 00002000:00010000:2.0:1789395273.833258:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c77d5180 00000100:00100000:2.0:1789395273.833304:0:20964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 139 00000100:00100000:2.0:1789395273.833315:0:20964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+20:2395:x1876316231994624:12345-192.168.203.54@tcp:4:dd.0 00000100:00080000:3.0:1789395273.835068:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789395273.877594:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2396:x1876316231994496:12345-192.168.203.54@tcp:4:dd.0 Request processed in 76347us (76596us total) trans 4294970010 rc 0/0 00000100:00100000:2.0:1789395273.877608:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 138 00002000:00100000:2.0:1789395273.877623:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (1048576->4194303) req@ffff89a3c77d5880 x1876316231994496/t4294970010(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/448 e 0 to 0 dl 1789395284 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395273.877639:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5880 with x1876316231994496 ext(1048576->4194303) 00002000:00010000:2.0:1789395273.877646:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a3c77d5880 00000100:00100000:3.0:1789395273.882358:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395273.884839:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994752 00000100:00100000:1.0:1789395273.884862:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994752 00002000:00100000:1.0:1789395273.886716:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xd:0x0] (1048576->4194303) req@ffff89a3c77d5500 x1876316231994752/t0(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/0 e 0 to 0 dl 1789395284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789395273.886784:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5500 with x1876316231994752 ext(1048576->4194303) 00002000:00010000:1.0:1789395273.886793:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c77d5500 00000100:00100000:1.0:1789395273.886969:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 140 00000100:00100000:1.0:1789395273.886982:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+22:2395:x1876316231994752:12345-192.168.203.54@tcp:4:dd.0 00000100:00100000:2.0:1789395273.923569:0:20964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2395:x1876316231994624:12345-192.168.203.54@tcp:4:dd.0 Request processed in 90246us (92226us total) trans 4294970036 rc 0/0 00000100:00100000:2.0:1789395273.923581:0:20964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 139 00002000:00100000:2.0:1789395273.923594:0:20964:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (4194304->8388607) req@ffff89a3c77d5180 x1876316231994624/t4294970036(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/448 e 0 to 0 dl 1789395284 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789395273.923605:0:20964:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5180 with x1876316231994624 ext(4194304->8388607) 00002000:00010000:2.0:1789395273.923612:0:20964:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c77d5180 00000100:00100000:0.0:1789395273.950676:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c77d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2395:x1876316231994752:12345-192.168.203.54@tcp:4:dd.0 Request processed in 63687us (68322us total) trans 4294970037 rc 0/0 00000100:00100000:0.0:1789395273.950690:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 140 00002000:00100000:0.0:1789395273.950705:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xd:0x0] (1048576->4194303) req@ffff89a3c77d5500 x1876316231994752/t4294970037(0) o4->14c4a56e-be91-426b-99f9-0a123b14fc7a@192.168.203.54@tcp:739/0 lens 488/448 e 0 to 0 dl 1789395284 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789395273.951118:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89a3c77d5500 with x1876316231994752 ext(1048576->4194303) 00002000:00010000:0.0:1789395273.951126:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a3c77d5500 00000100:00100000:0.0:1789395274.027267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1789395274.027316:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395274.027434:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231994880 00000100:00100000:2.0:1789395274.027446:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231994880 00000100:00100000:2.0:1789395274.027515:0:14639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995008 00000100:00100000:2.0:1789395274.027518:0:14639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995008 00000100:00100000:2.0:1789395274.027543:0:14639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5458 00000100:00100000:2.0:1789395274.027553:0:14639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+23:2398:x1876316231994880:12345-192.168.203.54@tcp:16:dd.0 00000100:00100000:2.0:1789395274.027623:0:10007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5459 00000100:00100000:2.0:1789395274.027648:0:10007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+24:2398:x1876316231995008:12345-192.168.203.54@tcp:16:dd.0 00000100:00080000:3.0:1789395274.028073:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789395274.031965:0:9503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970037 is committed 00000100:00100000:2.0:1789395274.032159:0:10007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2398:x1876316231995008:12345-192.168.203.54@tcp:16:dd.0 Request processed in 4505us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395274.032171:0:10007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5459 00000001:00080000:3.0:1789395274.033412:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970010 is committed 00000100:00100000:2.0:1789395274.033854:0:14639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2398:x1876316231994880:12345-192.168.203.54@tcp:16:dd.0 Request processed in 6298us (6592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395274.033864:0:14639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5458 00000100:00100000:0.0:1789395274.042525:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395274.042806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995264 00000100:00100000:2.0:1789395274.042821:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995264 00000100:00100000:2.0:1789395274.042930:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5320 00000100:00100000:2.0:1789395274.042945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+61:22327:x1876316231995264:12345-192.168.203.54@tcp:35:dd.0 00000100:00080000:3.0:1789395274.043017:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:2.0:1789395274.043187:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968811 00000100:00100000:2.0:1789395274.043304:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3cadc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:22327:x1876316231995264:12345-192.168.203.54@tcp:35:dd.0 Request processed in 363us (793us total) trans 4294968812 rc 0/0 00000100:00100000:2.0:1789395274.043313:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5320 00000020:00080000:2.0:1789395274.043320:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789395274.046952:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1789395274.047127:0:7813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995392 00000100:00100000:2.0:1789395274.047139:0:7813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995392 00000100:00100000:2.0:1789395274.047251:0:7813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24086 00000100:00100000:2.0:1789395274.047262:0:7813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:22327:x1876316231995392:12345-192.168.203.54@tcp:44:dd.0 00000100:00100000:2.0:1789395274.047481:0:7813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:22327:x1876316231995392:12345-192.168.203.54@tcp:44:dd.0 Request processed in 220us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789395274.047489:0:7813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24086 00010000:00010000:2.0:1789395274.481840:0:9511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789395275.317612:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395275.317663:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395275.317691:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395275.317721:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395275.317749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1789395275.317783:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995520 00000100:00100000:1.0:1789395275.317795:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995520 00000100:00100000:1.0:1789395275.317857:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 491 00000100:00100000:1.0:1789395275.317869:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4f3dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231995520:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395275.317972:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4f3dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1982440d-052f-4574-9279-fc90ec7de84f+10:2398:x1876316231995520:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395275.317981:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 491 00000100:00100000:1.0:1789395275.318022:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995904 00000100:00100000:1.0:1789395275.318026:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995904 00000100:00100000:1.0:1789395275.318058:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231996032 00000100:00100000:1.0:1789395275.318061:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231996032 00000100:00100000:1.0:1789395275.318095:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 553 00000100:00100000:1.0:1789395275.318103:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231995904:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395275.318134:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231995904:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395275.318141:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 553 00000100:00100000:1.0:1789395275.318152:0:14638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 554 00000100:00100000:1.0:1789395275.318159:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231996032:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395275.318183:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:14c4a56e-be91-426b-99f9-0a123b14fc7a+18:2397:x1876316231996032:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395275.318189:0:14638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 554 00000100:00100000:1.0:1789395275.318207:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995648 00000100:00100000:1.0:1789395275.318210:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995648 00000100:00100000:1.0:1789395275.318239:0:10512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316231995776 00000100:00100000:1.0:1789395275.318242:0:10512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316231995776 00000100:00100000:1.0:1789395275.318277:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 805 00000100:00100000:1.0:1789395275.318284:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231995648:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395275.318319:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+17:2397:x1876316231995648:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 36us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395275.318325:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 805 00000100:00100000:1.0:1789395275.318337:0:10512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 806 00000100:00100000:1.0:1789395275.318477:0:10512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:2398:x1876316231995776:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1789395275.318505:0:10512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a4ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14c4a56e-be91-426b-99f9-0a123b14fc7a+63:2398:x1876316231995776:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 162us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789395275.318513:0:10512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 806 00000100:00080000:1.0:1789395275.319161:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789395275.319169:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789395275.508457:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789395275.659646:0:23268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_63c: @@@@@@ FAIL: expect OST striped 90 == 85 + 2 00000100:00100000:3.0:1789395276.466283:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89a3cadc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239806720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789395276.466419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789395276.466555:0:20561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876316239806720 00000100:00100000:0.0:1789395276.466566:0:20561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876316239806720 00000100:00100000:0.0:1789395276.466633:0:20561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639 00000100:00100000:0.0:1789395276.466644:0:20561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239806720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789395276.466686:0:20561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443876864 avail 1297637376 00000100:00100000:0.0:1789395276.466742:0:20561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a3c9a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:3639:x1876316239806720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789395276.466749:0:20561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639 00000100:00100000:3.0:1789395276.467021:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89a3cadc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1876316239806720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789395276.529543:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68399 lines, 68399 kept, 0 dropped, 0 bad.